2024-09-14T08:25:44.016 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T08:25:44.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T08:25:44.129 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500 branch: main description: rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900500' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi no_nested_subset: false openstack: - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: extra_packages: - rbd-nbd flavor: default sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - - client.0 seed: 5839 sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 sleep_before_teardown: 0 subset: 99/128 suite: rbd suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwc19mbHzq60PogVajK1w8PXvNGXuJgzxCEVZnED2GkveV7GX4R9EwwFmPxcGIeIc9kNyMsfXCCMYTqY8viW0c= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzI5J0xztUrmtyyZ/IU2+5MZ3QtSYqK+ojUk+Dl3ooQSggLB1RHyKZW7qrNJEYSi7Sd/6MNbjGVeJlVY5/5UZc= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ8HVYQC/YbMRsQSfgwRk3AgwG3yUhh1Rb/Ez4QIBrcbK+mI6dx/WaOHQR1Bje7dqa88VzAFJTJZwfq4db3yQ4= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 holebdy: 512 nbd: true ops: 6000 punch_holes: true readbdy: 512 truncbdy: 512 writebdy: 512 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_20:16:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T08:25:44.130 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa; will attempt to use it 2024-09-14T08:25:44.130 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa/tasks 2024-09-14T08:25:44.131 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T08:25:44.132 INFO:teuthology.task.internal:Checking packages... 2024-09-14T08:25:44.155 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7f24e589328ae9e639c0009d93340e5b235d0a47' 2024-09-14T08:25:44.155 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T08:25:44.155 INFO:teuthology.packaging:ref: None 2024-09-14T08:25:44.155 INFO:teuthology.packaging:tag: None 2024-09-14T08:25:44.155 INFO:teuthology.packaging:branch: main 2024-09-14T08:25:44.155 INFO:teuthology.packaging:sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T08:25:44.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-14T08:25:44.383 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4907-ga2782315-1jammy 2024-09-14T08:25:44.385 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T08:25:44.393 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T08:25:44.393 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T08:25:44.453 INFO:teuthology.task.internal:Saving configuration 2024-09-14T08:25:44.468 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T08:25:44.481 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T08:25:44.507 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 08:20:07.846564', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHE8xL3QOwYc3Oc8zSPq9G8fLZ/lJVBPCcYGbHul0tRY'} 2024-09-14T08:25:44.532 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 08:20:07.849552', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEkDPl+ihfOTatLEp+SHig0X5rY5RCSDnch1g+aYJouZ'} 2024-09-14T08:25:44.553 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 08:20:07.843139', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH3kCV5G9So/8h/1oBGHJT5nNa7DUKH/QyQzqnrx+yJg'} 2024-09-14T08:25:44.553 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T08:25:44.560 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2024-09-14T08:25:44.560 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5'] 2024-09-14T08:25:44.560 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['client.0'] 2024-09-14T08:25:44.560 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T08:25:44.712 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8c21743400>, signals=[15]) 2024-09-14T08:25:44.712 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T08:25:44.731 INFO:teuthology.task.internal:Opening connections... 2024-09-14T08:25:44.731 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:25:44.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:25:44.846 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-14T08:25:44.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:25:44.922 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2024-09-14T08:25:44.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:25:45.004 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T08:25:45.012 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-09-14T08:25:45.018 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-09-14T08:25:45.018 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="22.04" 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=jammy 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T08:25:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T08:25:45.066 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=jammy 2024-09-14T08:25:45.066 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-09-14T08:25:45.093 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-14T08:25:45.099 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-14T08:25:45.099 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-14T08:25:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T08:25:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Ubuntu" 2024-09-14T08:25:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="22.04" 2024-09-14T08:25:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T08:25:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_CODENAME=jammy 2024-09-14T08:25:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:ID=ubuntu 2024-09-14T08:25:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE=debian 2024-09-14T08:25:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T08:25:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T08:25:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T08:25:45.147 INFO:teuthology.orchestra.run.smithi112.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T08:25:45.147 INFO:teuthology.orchestra.run.smithi112.stdout:UBUNTU_CODENAME=jammy 2024-09-14T08:25:45.147 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-14T08:25:45.169 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-09-14T08:25:45.175 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-09-14T08:25:45.175 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-09-14T08:25:45.227 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T08:25:45.227 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Ubuntu" 2024-09-14T08:25:45.227 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="22.04" 2024-09-14T08:25:45.228 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T08:25:45.228 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_CODENAME=jammy 2024-09-14T08:25:45.228 INFO:teuthology.orchestra.run.smithi188.stdout:ID=ubuntu 2024-09-14T08:25:45.228 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE=debian 2024-09-14T08:25:45.228 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T08:25:45.228 INFO:teuthology.orchestra.run.smithi188.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T08:25:45.228 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T08:25:45.228 INFO:teuthology.orchestra.run.smithi188.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T08:25:45.228 INFO:teuthology.orchestra.run.smithi188.stdout:UBUNTU_CODENAME=jammy 2024-09-14T08:25:45.228 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-09-14T08:25:45.252 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T08:25:45.261 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T08:25:45.277 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T08:25:45.277 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-09-14T08:25:45.280 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-14T08:25:45.283 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2024-09-14T08:25:45.288 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T08:25:45.328 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T08:25:45.328 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-09-14T08:25:45.330 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-14T08:25:45.333 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2024-09-14T08:25:45.419 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T08:25:45.491 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T08:25:45.589 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T08:25:45.590 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T08:25:45.590 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T08:25:45.591 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T08:25:45.591 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T08:25:45.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:25:45.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:25:45.597 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-14T08:25:45.597 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-14T08:25:45.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:25:45.598 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-09-14T08:25:45.642 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-56-generic 2024-09-14T08:25:45.642 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.15.0-56-generic 2024-09-14T08:25:45.642 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-14T08:25:45.644 INFO:teuthology.orchestra.run.smithi188.stdout:5.15.0-56-generic 2024-09-14T08:25:45.644 INFO:teuthology.task.kernel:Running kernel on smithi188: 5.15.0-56-generic 2024-09-14T08:25:45.644 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get clean 2024-09-14T08:25:45.645 INFO:teuthology.orchestra.run.smithi089.stdout:5.15.0-56-generic 2024-09-14T08:25:45.645 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.15.0-56-generic 2024-09-14T08:25:45.645 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get clean 2024-09-14T08:25:45.776 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-14T08:25:45.777 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2024-09-14T08:25:45.783 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-09-14T08:25:45.936 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T08:25:45.936 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T08:25:45.936 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T08:25:45.942 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T08:25:46.009 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T08:25:46.045 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T08:25:46.045 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T08:25:46.062 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T08:25:46.127 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T08:25:46.128 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T08:25:46.157 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T08:25:46.163 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T08:25:46.235 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T08:25:46.236 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T08:25:46.242 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T08:25:46.275 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T08:25:46.277 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T08:25:46.282 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T08:25:46.287 INFO:teuthology.orchestra.run.smithi188.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T08:25:46.287 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T08:25:46.288 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T08:25:46.294 INFO:teuthology.orchestra.run.smithi188.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T08:25:46.298 INFO:teuthology.orchestra.run.smithi188.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T08:25:46.299 INFO:teuthology.orchestra.run.smithi188.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T08:25:46.302 INFO:teuthology.orchestra.run.smithi188.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T08:25:46.302 INFO:teuthology.orchestra.run.smithi188.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T08:25:46.307 INFO:teuthology.orchestra.run.smithi188.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T08:25:46.311 INFO:teuthology.orchestra.run.smithi188.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T08:25:46.319 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T08:25:46.320 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T08:25:46.324 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T08:25:46.325 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T08:25:46.332 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T08:25:46.338 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T08:25:46.339 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T08:25:46.340 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T08:25:46.340 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T08:25:46.357 INFO:teuthology.orchestra.run.smithi188.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T08:25:46.357 INFO:teuthology.orchestra.run.smithi188.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T08:25:46.358 INFO:teuthology.orchestra.run.smithi188.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T08:25:46.358 INFO:teuthology.orchestra.run.smithi188.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T08:25:46.358 INFO:teuthology.orchestra.run.smithi188.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T08:25:46.358 INFO:teuthology.orchestra.run.smithi188.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T08:25:46.361 INFO:teuthology.orchestra.run.smithi188.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T08:25:46.361 INFO:teuthology.orchestra.run.smithi188.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T08:25:46.362 INFO:teuthology.orchestra.run.smithi188.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T08:25:46.387 INFO:teuthology.orchestra.run.smithi188.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T08:25:46.391 INFO:teuthology.orchestra.run.smithi188.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T08:25:46.392 INFO:teuthology.orchestra.run.smithi188.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T08:25:46.399 INFO:teuthology.orchestra.run.smithi188.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T08:25:46.407 INFO:teuthology.orchestra.run.smithi188.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T08:25:46.409 INFO:teuthology.orchestra.run.smithi188.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T08:25:46.409 INFO:teuthology.orchestra.run.smithi188.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T08:25:46.413 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T08:25:46.413 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T08:25:46.429 INFO:teuthology.orchestra.run.smithi188.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T08:25:46.430 INFO:teuthology.orchestra.run.smithi188.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T08:25:46.430 INFO:teuthology.orchestra.run.smithi188.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T08:25:46.430 INFO:teuthology.orchestra.run.smithi188.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T08:25:46.430 INFO:teuthology.orchestra.run.smithi188.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T08:25:46.431 INFO:teuthology.orchestra.run.smithi188.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T08:25:46.431 INFO:teuthology.orchestra.run.smithi188.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T08:25:46.431 INFO:teuthology.orchestra.run.smithi188.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T08:25:46.446 INFO:teuthology.orchestra.run.smithi188.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T08:25:46.447 INFO:teuthology.orchestra.run.smithi188.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T08:25:46.463 INFO:teuthology.orchestra.run.smithi188.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T08:25:46.482 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T08:25:46.484 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T08:25:46.485 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T08:25:46.620 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T08:25:46.621 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T08:25:46.825 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T08:25:46.908 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T08:25:46.924 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T08:25:46.932 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T08:25:46.933 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T08:25:46.938 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T08:25:46.973 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T08:25:46.974 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T08:25:46.987 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T08:25:46.988 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T08:25:46.988 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T08:25:46.988 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T08:25:47.029 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T08:25:47.030 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T08:25:47.041 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T08:25:47.057 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T08:25:47.059 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T08:25:47.064 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T08:25:47.064 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T08:25:47.065 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T08:25:47.074 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T08:25:47.074 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T08:25:47.075 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T08:25:47.075 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T08:25:47.075 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T08:25:47.090 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T08:25:47.093 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T08:25:47.094 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T08:25:47.095 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T08:25:47.097 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T08:25:47.106 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T08:25:47.125 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T08:25:47.125 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T08:25:47.130 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T08:25:47.131 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T08:25:47.131 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T08:25:47.132 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T08:25:47.137 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T08:25:47.138 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T08:25:47.170 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T08:25:47.170 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T08:25:47.182 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T08:25:47.183 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T08:25:47.183 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T08:25:47.185 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T08:25:47.208 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T08:25:47.209 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T08:25:47.209 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T08:25:47.210 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T08:25:47.212 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T08:25:47.215 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T08:25:47.216 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T08:25:47.216 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T08:25:47.217 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T08:25:47.218 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T08:25:47.218 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T08:25:47.219 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T08:25:47.219 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T08:25:47.264 INFO:teuthology.orchestra.run.smithi089.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T08:25:47.300 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T08:25:47.300 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T08:25:52.432 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 16.0 MB in 2s (7,492 kB/s) 2024-09-14T08:25:52.548 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 16.0 MB in 2s (7,506 kB/s) 2024-09-14T08:25:53.132 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 16.0 MB in 3s (5,798 kB/s) 2024-09-14T08:25:53.953 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-09-14T08:25:53.970 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T08:25:53.976 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-09-14T08:25:53.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T08:25:54.030 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-09-14T08:25:54.098 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-09-14T08:25:54.241 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-09-14T08:25:54.242 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-09-14T08:25:54.318 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2024-09-14T08:25:54.318 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2024-09-14T08:25:54.418 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T08:25:54.418 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T08:25:54.418 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T08:25:54.419 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T08:25:54.419 INFO:teuthology.orchestra.run.smithi188.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T08:25:54.419 INFO:teuthology.orchestra.run.smithi188.stdout: python2.7-minimal 2024-09-14T08:25:54.419 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T08:25:54.420 INFO:teuthology.orchestra.run.smithi188.stdout:The following additional packages will be installed: 2024-09-14T08:25:54.421 INFO:teuthology.orchestra.run.smithi188.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T08:25:54.421 INFO:teuthology.orchestra.run.smithi188.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T08:25:54.421 INFO:teuthology.orchestra.run.smithi188.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T08:25:54.422 INFO:teuthology.orchestra.run.smithi188.stdout:Suggested packages: 2024-09-14T08:25:54.422 INFO:teuthology.orchestra.run.smithi188.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T08:25:54.422 INFO:teuthology.orchestra.run.smithi188.stdout:Recommended packages: 2024-09-14T08:25:54.422 INFO:teuthology.orchestra.run.smithi188.stdout: thermald 2024-09-14T08:25:54.470 INFO:teuthology.orchestra.run.smithi188.stdout:The following NEW packages will be installed: 2024-09-14T08:25:54.471 INFO:teuthology.orchestra.run.smithi188.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T08:25:54.471 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T08:25:54.471 INFO:teuthology.orchestra.run.smithi188.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T08:25:54.472 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages will be upgraded: 2024-09-14T08:25:54.472 INFO:teuthology.orchestra.run.smithi188.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T08:25:54.502 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T08:25:54.502 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T08:25:54.502 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T08:25:54.502 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T08:25:54.502 INFO:teuthology.orchestra.run.smithi089.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T08:25:54.503 INFO:teuthology.orchestra.run.smithi089.stdout: python2.7-minimal 2024-09-14T08:25:54.503 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T08:25:54.504 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2024-09-14T08:25:54.505 INFO:teuthology.orchestra.run.smithi089.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T08:25:54.505 INFO:teuthology.orchestra.run.smithi089.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T08:25:54.505 INFO:teuthology.orchestra.run.smithi089.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T08:25:54.506 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2024-09-14T08:25:54.506 INFO:teuthology.orchestra.run.smithi089.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T08:25:54.506 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2024-09-14T08:25:54.506 INFO:teuthology.orchestra.run.smithi089.stdout: thermald 2024-09-14T08:25:54.510 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-14T08:25:54.522 INFO:teuthology.orchestra.run.smithi188.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T08:25:54.523 INFO:teuthology.orchestra.run.smithi188.stdout:Need to get 113 MB of archives. 2024-09-14T08:25:54.523 INFO:teuthology.orchestra.run.smithi188.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T08:25:54.523 INFO:teuthology.orchestra.run.smithi188.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T08:25:54.528 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T08:25:54.551 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2024-09-14T08:25:54.551 INFO:teuthology.orchestra.run.smithi089.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T08:25:54.551 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T08:25:54.552 INFO:teuthology.orchestra.run.smithi089.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T08:25:54.553 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2024-09-14T08:25:54.553 INFO:teuthology.orchestra.run.smithi089.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T08:25:54.581 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-14T08:25:54.733 INFO:teuthology.orchestra.run.smithi089.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T08:25:54.733 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 113 MB of archives. 2024-09-14T08:25:54.733 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T08:25:54.733 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T08:25:54.765 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-14T08:25:54.766 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-14T08:25:54.931 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T08:25:54.931 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T08:25:54.931 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T08:25:54.932 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T08:25:54.932 INFO:teuthology.orchestra.run.smithi112.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T08:25:54.932 INFO:teuthology.orchestra.run.smithi112.stdout: python2.7-minimal 2024-09-14T08:25:54.932 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T08:25:54.933 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-14T08:25:54.933 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T08:25:54.933 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T08:25:54.934 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T08:25:54.935 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-14T08:25:54.935 INFO:teuthology.orchestra.run.smithi112.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T08:25:54.935 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-14T08:25:54.935 INFO:teuthology.orchestra.run.smithi112.stdout: thermald 2024-09-14T08:25:54.941 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T08:25:54.980 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-14T08:25:54.980 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T08:25:54.981 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T08:25:54.981 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T08:25:54.982 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2024-09-14T08:25:54.983 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T08:25:55.034 INFO:teuthology.orchestra.run.smithi112.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T08:25:55.034 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 113 MB of archives. 2024-09-14T08:25:55.034 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T08:25:55.035 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T08:25:55.037 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T08:25:55.466 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T08:25:55.566 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T08:25:55.884 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T08:25:55.884 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T08:25:55.884 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T08:25:56.007 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T08:25:56.028 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T08:25:56.192 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T08:25:56.329 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T08:25:56.329 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T08:25:56.329 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T08:25:56.473 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 113 MB in 2s (73.1 MB/s) 2024-09-14T08:25:56.501 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T08:25:56.541 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T08:25:56.564 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T08:25:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T08:25:56.996 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 113 MB in 2s (71.8 MB/s) 2024-09-14T08:25:57.182 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T08:25:58.712 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T08:25:58.716 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:25:58.768 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T08:25:58.769 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T08:25:58.769 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T08:25:58.807 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:25:59.097 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T08:25:59.170 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T08:25:59.175 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:25:59.176 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T08:25:59.229 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:25:59.585 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-09-14T08:25:59.780 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T08:26:00.984 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T08:26:01.005 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:26:01.083 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:01.406 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T08:26:01.428 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:26:01.530 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:01.579 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T08:26:01.600 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:26:01.637 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:01.782 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T08:26:01.786 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:26:01.920 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:02.009 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T08:26:02.030 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:26:02.059 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:04.155 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T08:26:04.175 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:26:04.277 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:04.906 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T08:26:04.927 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:26:05.174 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:08.873 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T08:26:08.927 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T08:26:09.017 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T08:26:09.029 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T08:26:09.296 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T08:26:09.375 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T08:26:09.416 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T08:26:09.479 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T08:26:09.752 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T08:26:09.765 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T08:26:09.766 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T08:26:09.776 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T08:26:09.810 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T08:26:09.814 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T08:26:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T08:26:12.344 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T08:26:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T08:26:12.848 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T08:26:13.134 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T08:26:13.145 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T08:26:13.175 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T08:26:15.075 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T08:26:15.112 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:26:15.158 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:15.818 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T08:26:15.855 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:26:15.901 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:17.801 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T08:26:17.929 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T08:26:18.261 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T08:26:18.366 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:18.467 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T08:26:18.570 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:18.626 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T08:26:18.739 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T08:26:19.075 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T08:26:19.089 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T08:26:19.113 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T08:26:19.166 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:19.211 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:19.337 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T08:26:19.465 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:19.891 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T08:26:19.891 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T08:26:19.891 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T08:26:19.892 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:20.048 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:20.835 INFO:teuthology.orchestra.run.smithi188.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T08:26:20.836 INFO:teuthology.orchestra.run.smithi188.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T08:26:20.836 INFO:teuthology.orchestra.run.smithi188.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T08:26:20.836 INFO:teuthology.orchestra.run.smithi188.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:20.994 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:22.157 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:22.636 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:23.597 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T08:26:23.739 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T08:26:23.858 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T08:26:23.959 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T08:26:24.012 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T08:26:24.060 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:24.114 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T08:26:24.127 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T08:26:24.127 INFO:teuthology.orchestra.run.smithi112.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:24.130 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T08:26:24.261 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:24.282 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:24.347 INFO:teuthology.orchestra.run.smithi188.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T08:26:24.347 INFO:teuthology.orchestra.run.smithi188.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:24.379 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T08:26:24.507 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:25.852 INFO:teuthology.orchestra.run.smithi089.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T08:26:25.852 INFO:teuthology.orchestra.run.smithi089.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T08:26:25.852 INFO:teuthology.orchestra.run.smithi089.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T08:26:25.852 INFO:teuthology.orchestra.run.smithi089.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:26.044 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:28.280 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:29.672 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T08:26:29.773 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T08:26:29.874 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T08:26:29.969 INFO:teuthology.orchestra.run.smithi089.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T08:26:29.969 INFO:teuthology.orchestra.run.smithi089.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:38.258 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T08:26:38.258 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub' 2024-09-14T08:26:38.273 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T08:26:38.292 INFO:teuthology.orchestra.run.smithi112.stdout:Generating grub configuration file ... 2024-09-14T08:26:38.553 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T08:26:38.569 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:38.856 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T08:26:38.862 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T08:26:38.930 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T08:26:38.935 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T08:26:39.085 INFO:teuthology.orchestra.run.smithi112.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T08:26:39.085 INFO:teuthology.orchestra.run.smithi112.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T08:26:39.085 INFO:teuthology.orchestra.run.smithi112.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T08:26:39.130 INFO:teuthology.orchestra.run.smithi112.stdout:done 2024-09-14T08:26:39.139 INFO:teuthology.orchestra.run.smithi188.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T08:26:39.139 INFO:teuthology.orchestra.run.smithi188.stdout:Sourcing file `/etc/default/grub' 2024-09-14T08:26:39.157 INFO:teuthology.orchestra.run.smithi188.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T08:26:39.193 INFO:teuthology.orchestra.run.smithi188.stdout:Generating grub configuration file ... 2024-09-14T08:26:39.474 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T08:26:39.495 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:39.571 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-14T08:26:39.596 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-14T08:26:39.596 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-14T08:26:39.596 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-14T08:26:39.596 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-14T08:26:39.596 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-14T08:26:39.596 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T08:26:39.597 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-14T08:26:39.597 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-14T08:26:39.597 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.121.121 2024-09-14T08:26:39.597 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T08:26:39.597 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T08:26:39.597 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-14T08:26:39.597 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-14T08:26:39.597 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-14T08:26:39.597 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-14T08:26:39.597 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T08:26:39.598 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T08:26:39.598 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T08:26:39.598 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T08:26:39.598 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T08:26:39.598 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-14T08:26:39.781 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-14T08:26:39.790 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T08:26:39.796 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T08:26:39.867 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T08:26:39.872 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T08:26:39.895 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T08:26:39.904 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T08:26:39.922 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T08:26:40.017 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T08:26:40.041 INFO:teuthology.orchestra.run.smithi188.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T08:26:40.041 INFO:teuthology.orchestra.run.smithi188.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T08:26:40.041 INFO:teuthology.orchestra.run.smithi188.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T08:26:40.092 INFO:teuthology.orchestra.run.smithi188.stdout:done 2024-09-14T08:26:40.581 DEBUG:teuthology.orchestra.run.smithi188:> dpkg -s linux-image-generic 2024-09-14T08:26:40.602 INFO:teuthology.orchestra.run.smithi188.stdout:Package: linux-image-generic 2024-09-14T08:26:40.603 INFO:teuthology.orchestra.run.smithi188.stdout:Status: install ok installed 2024-09-14T08:26:40.603 INFO:teuthology.orchestra.run.smithi188.stdout:Priority: optional 2024-09-14T08:26:40.603 INFO:teuthology.orchestra.run.smithi188.stdout:Section: kernel 2024-09-14T08:26:40.603 INFO:teuthology.orchestra.run.smithi188.stdout:Installed-Size: 21 2024-09-14T08:26:40.603 INFO:teuthology.orchestra.run.smithi188.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T08:26:40.604 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: amd64 2024-09-14T08:26:40.604 INFO:teuthology.orchestra.run.smithi188.stdout:Source: linux-meta 2024-09-14T08:26:40.604 INFO:teuthology.orchestra.run.smithi188.stdout:Version: 5.15.0.121.121 2024-09-14T08:26:40.604 INFO:teuthology.orchestra.run.smithi188.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T08:26:40.604 INFO:teuthology.orchestra.run.smithi188.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T08:26:40.604 INFO:teuthology.orchestra.run.smithi188.stdout:Recommends: thermald 2024-09-14T08:26:40.605 INFO:teuthology.orchestra.run.smithi188.stdout:Description: Generic Linux kernel image 2024-09-14T08:26:40.605 INFO:teuthology.orchestra.run.smithi188.stdout: This package will always depend on the latest generic kernel image 2024-09-14T08:26:40.605 INFO:teuthology.orchestra.run.smithi188.stdout: available. 2024-09-14T08:26:40.605 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T08:26:40.605 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T08:26:40.606 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T08:26:40.606 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-14T08:26:40.606 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T08:26:40.606 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get clean 2024-09-14T08:26:40.748 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-09-14T08:26:40.864 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T08:26:40.865 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T08:26:40.876 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T08:26:40.893 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T08:26:41.380 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-14T08:26:41.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T08:26:41.461 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-14T08:26:41.670 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-14T08:26:41.670 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-14T08:26:41.850 INFO:teuthology.orchestra.run.smithi112.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T08:26:41.850 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T08:26:41.850 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T08:26:41.850 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T08:26:41.850 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T08:26:41.851 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T08:26:41.851 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T08:26:41.851 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T08:26:41.889 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T08:26:41.891 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-14T08:26:41.906 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-14T08:26:41.906 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-14T08:26:41.906 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-14T08:26:41.906 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-14T08:26:41.906 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-14T08:26:41.907 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T08:26:41.907 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-14T08:26:41.907 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-14T08:26:41.907 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.121.121 2024-09-14T08:26:41.907 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T08:26:41.907 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T08:26:41.907 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-14T08:26:41.907 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-14T08:26:41.907 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-14T08:26:41.907 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-14T08:26:41.908 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-14T08:26:41.952 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.m8MyNm7htc 2024-09-14T08:26:41.953 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub/grub.cfg /tmp/tmp.m8MyNm7htc 2024-09-14T08:26:42.006 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.m8MyNm7htc 2024-09-14T08:26:42.124 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.m8MyNm7htc is 10KB 2024-09-14T08:26:42.136 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.m8MyNm7htc 2024-09-14T08:26:42.141 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T08:26:42.195 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:26:42.196 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T08:26:42.196 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T08:26:42.259 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T08:26:42.259 DEBUG:teuthology.orchestra.run.smithi112:> sudo update-grub 2024-09-14T08:26:42.306 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-09-14T08:26:42.325 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T08:26:42.387 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-09-14T08:26:42.596 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-09-14T08:26:42.596 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-09-14T08:26:42.784 INFO:teuthology.orchestra.run.smithi188.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T08:26:42.784 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T08:26:42.784 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T08:26:42.784 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T08:26:42.784 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T08:26:42.785 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T08:26:42.785 INFO:teuthology.orchestra.run.smithi188.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T08:26:42.785 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T08:26:42.824 INFO:teuthology.orchestra.run.smithi188.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T08:26:42.826 DEBUG:teuthology.orchestra.run.smithi188:> dpkg -s linux-image-generic 2024-09-14T08:26:42.839 INFO:teuthology.orchestra.run.smithi188.stdout:Package: linux-image-generic 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Status: install ok installed 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Priority: optional 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Section: kernel 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Installed-Size: 21 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: amd64 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Source: linux-meta 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Version: 5.15.0.121.121 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Recommends: thermald 2024-09-14T08:26:42.840 INFO:teuthology.orchestra.run.smithi188.stdout:Description: Generic Linux kernel image 2024-09-14T08:26:42.841 INFO:teuthology.orchestra.run.smithi188.stdout: This package will always depend on the latest generic kernel image 2024-09-14T08:26:42.841 INFO:teuthology.orchestra.run.smithi188.stdout: available. 2024-09-14T08:26:42.841 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-09-14T08:26:42.886 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.LMlLInGJIe 2024-09-14T08:26:42.886 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub/grub.cfg /tmp/tmp.LMlLInGJIe 2024-09-14T08:26:42.941 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.LMlLInGJIe 2024-09-14T08:26:43.052 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.LMlLInGJIe is 10KB 2024-09-14T08:26:43.065 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.LMlLInGJIe 2024-09-14T08:26:43.070 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T08:26:43.126 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-14T08:26:43.126 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T08:26:43.126 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T08:26:43.218 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T08:26:43.219 DEBUG:teuthology.orchestra.run.smithi188:> sudo update-grub 2024-09-14T08:26:43.488 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub' 2024-09-14T08:26:43.489 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T08:26:43.500 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-14T08:26:43.679 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T08:26:43.686 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:43.927 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T08:26:43.933 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T08:26:43.976 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T08:26:43.981 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T08:26:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T08:26:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T08:26:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T08:26:44.113 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-14T08:26:44.132 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-14T08:26:44.286 INFO:teuthology.orchestra.run.smithi089.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T08:26:44.286 INFO:teuthology.orchestra.run.smithi089.stdout:Sourcing file `/etc/default/grub' 2024-09-14T08:26:44.310 INFO:teuthology.orchestra.run.smithi089.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T08:26:44.328 INFO:teuthology.orchestra.run.smithi089.stdout:Generating grub configuration file ... 2024-09-14T08:26:44.589 INFO:teuthology.orchestra.run.smithi188.stderr:Sourcing file `/etc/default/grub' 2024-09-14T08:26:44.590 INFO:teuthology.orchestra.run.smithi188.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T08:26:44.593 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2024-09-14T08:26:44.683 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T08:26:44.700 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:44.893 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T08:26:44.898 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:45.044 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T08:26:45.050 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T08:26:45.124 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T08:26:45.130 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T08:26:45.205 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T08:26:45.211 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T08:26:45.254 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T08:26:45.259 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T08:26:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T08:26:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T08:26:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T08:26:45.345 INFO:teuthology.orchestra.run.smithi089.stdout:done 2024-09-14T08:26:45.378 INFO:teuthology.orchestra.run.smithi188.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T08:26:45.378 INFO:teuthology.orchestra.run.smithi188.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T08:26:45.378 INFO:teuthology.orchestra.run.smithi188.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T08:26:45.394 INFO:teuthology.orchestra.run.smithi188.stderr:done 2024-09-14T08:26:45.397 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2024-09-14T08:26:45.828 DEBUG:teuthology.orchestra.run.smithi089:> dpkg -s linux-image-generic 2024-09-14T08:26:45.850 INFO:teuthology.orchestra.run.smithi089.stdout:Package: linux-image-generic 2024-09-14T08:26:45.850 INFO:teuthology.orchestra.run.smithi089.stdout:Status: install ok installed 2024-09-14T08:26:45.850 INFO:teuthology.orchestra.run.smithi089.stdout:Priority: optional 2024-09-14T08:26:45.850 INFO:teuthology.orchestra.run.smithi089.stdout:Section: kernel 2024-09-14T08:26:45.850 INFO:teuthology.orchestra.run.smithi089.stdout:Installed-Size: 21 2024-09-14T08:26:45.850 INFO:teuthology.orchestra.run.smithi089.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T08:26:45.850 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: amd64 2024-09-14T08:26:45.851 INFO:teuthology.orchestra.run.smithi089.stdout:Source: linux-meta 2024-09-14T08:26:45.851 INFO:teuthology.orchestra.run.smithi089.stdout:Version: 5.15.0.121.121 2024-09-14T08:26:45.851 INFO:teuthology.orchestra.run.smithi089.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T08:26:45.851 INFO:teuthology.orchestra.run.smithi089.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T08:26:45.851 INFO:teuthology.orchestra.run.smithi089.stdout:Recommends: thermald 2024-09-14T08:26:45.851 INFO:teuthology.orchestra.run.smithi089.stdout:Description: Generic Linux kernel image 2024-09-14T08:26:45.851 INFO:teuthology.orchestra.run.smithi089.stdout: This package will always depend on the latest generic kernel image 2024-09-14T08:26:45.851 INFO:teuthology.orchestra.run.smithi089.stdout: available. 2024-09-14T08:26:45.851 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T08:26:45.851 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T08:26:45.851 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T08:26:45.852 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T08:26:45.852 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T08:26:45.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get clean 2024-09-14T08:26:46.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2024-09-14T08:26:46.125 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T08:26:46.134 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T08:26:46.152 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T08:26:46.247 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T08:26:47.497 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-09-14T08:26:47.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T08:26:47.577 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-09-14T08:26:47.792 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2024-09-14T08:26:47.793 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2024-09-14T08:26:47.970 INFO:teuthology.orchestra.run.smithi089.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T08:26:47.970 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T08:26:47.970 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T08:26:47.971 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T08:26:47.971 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T08:26:47.971 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T08:26:47.971 INFO:teuthology.orchestra.run.smithi089.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T08:26:47.971 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T08:26:48.010 INFO:teuthology.orchestra.run.smithi089.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T08:26:48.013 DEBUG:teuthology.orchestra.run.smithi089:> dpkg -s linux-image-generic 2024-09-14T08:26:48.029 INFO:teuthology.orchestra.run.smithi089.stdout:Package: linux-image-generic 2024-09-14T08:26:48.029 INFO:teuthology.orchestra.run.smithi089.stdout:Status: install ok installed 2024-09-14T08:26:48.029 INFO:teuthology.orchestra.run.smithi089.stdout:Priority: optional 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout:Section: kernel 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout:Installed-Size: 21 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: amd64 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout:Source: linux-meta 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout:Version: 5.15.0.121.121 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout:Recommends: thermald 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout:Description: Generic Linux kernel image 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout: This package will always depend on the latest generic kernel image 2024-09-14T08:26:48.030 INFO:teuthology.orchestra.run.smithi089.stdout: available. 2024-09-14T08:26:48.031 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-14T08:26:48.075 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.fMPktWGbHD 2024-09-14T08:26:48.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub/grub.cfg /tmp/tmp.fMPktWGbHD 2024-09-14T08:26:48.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.fMPktWGbHD 2024-09-14T08:26:48.240 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.fMPktWGbHD is 10KB 2024-09-14T08:26:48.253 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.fMPktWGbHD 2024-09-14T08:26:48.258 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T08:26:48.311 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:26:48.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T08:26:48.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T08:26:48.384 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T08:26:48.384 DEBUG:teuthology.orchestra.run.smithi089:> sudo update-grub 2024-09-14T08:26:49.825 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2024-09-14T08:26:49.825 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T08:26:49.829 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-09-14T08:26:50.015 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T08:26:50.021 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T08:26:50.269 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T08:26:50.274 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T08:26:50.313 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T08:26:50.317 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T08:26:50.456 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T08:26:50.456 INFO:teuthology.orchestra.run.smithi089.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T08:26:50.456 INFO:teuthology.orchestra.run.smithi089.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T08:26:50.467 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-09-14T08:26:50.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-09-14T08:27:14.157 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T08:27:14.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-14T08:27:14.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:27:15.445 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-14T08:27:15.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-14T08:27:15.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:27:20.484 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T08:27:20.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-14T08:27:20.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:27:32.541 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-14T08:27:33.825 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-09-14T08:27:38.941 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-14T08:27:41.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-14T08:27:41.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:27:42.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-14T08:27:42.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:27:44.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-14T08:27:45.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-09-14T08:27:47.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-14T08:27:47.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:27:51.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-14T08:27:56.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-14T08:27:56.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:27:57.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-14T08:27:57.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:28:03.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-14T08:28:03.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:28:15.041 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-14T08:28:16.317 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-09-14T08:28:21.441 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-14T08:28:30.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-14T08:28:30.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:28:30.522 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-14T08:28:31.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-14T08:28:31.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:28:31.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-14T08:28:31.321 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-14T08:28:31.321 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-14T08:28:31.392 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-121-generic 2024-09-14T08:28:31.393 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T08:28:31.393 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T08:28:31.393 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T08:28:31.576 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-09-14T08:28:32.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-14T08:28:32.084 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.15.0-121-generic"... 2024-09-14T08:28:32.084 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-09-14T08:28:32.131 INFO:teuthology.orchestra.run.smithi188.stdout:5.15.0-121-generic 2024-09-14T08:28:32.131 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T08:28:32.131 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T08:28:32.132 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T08:28:32.394 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T08:28:32.394 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T08:28:32.472 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-09-14T08:28:32.508 DEBUG:teuthology.parallel:result is None 2024-09-14T08:28:33.133 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-09-14T08:28:33.133 DEBUG:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T08:28:33.196 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2024-09-14T08:28:33.221 DEBUG:teuthology.parallel:result is None 2024-09-14T08:28:36.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-14T08:28:36.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:28:36.804 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-14T08:28:37.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-14T08:28:37.623 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-14T08:28:37.623 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-14T08:28:37.672 INFO:teuthology.orchestra.run.smithi089.stdout:5.15.0-121-generic 2024-09-14T08:28:37.672 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T08:28:37.672 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T08:28:37.672 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T08:28:38.674 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T08:28:38.674 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T08:28:38.860 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-09-14T08:28:38.893 DEBUG:teuthology.parallel:result is None 2024-09-14T08:28:38.894 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T08:28:38.901 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T08:28:38.901 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T08:28:38.903 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T08:28:38.906 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T08:28:38.912 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T08:28:38.958 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T08:28:38.997 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T08:28:38.998 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T08:28:39.000 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T08:28:39.002 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T08:28:39.090 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T08:28:39.097 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T08:28:39.097 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T08:28:39.099 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T08:28:39.101 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T08:28:39.119 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T08:28:39.121 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T08:28:39.122 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T08:28:39.127 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T08:28:39.129 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T08:28:39.130 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T08:28:39.132 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T08:28:39.138 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T08:28:39.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T08:28:39.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T08:28:39.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T08:28:39.209 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T08:28:39.219 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T08:28:39.219 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T08:28:39.253 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T08:28:39.255 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T08:28:39.260 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T08:28:39.308 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T08:28:39.359 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:28:39.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T08:28:39.425 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T08:28:39.431 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T08:28:39.479 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:28:39.479 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T08:28:39.539 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T08:28:39.545 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T08:28:39.592 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-14T08:28:39.592 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T08:28:39.648 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-09-14T08:28:39.651 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-14T08:28:39.653 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2024-09-14T08:28:39.741 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T08:28:39.748 INFO:teuthology.task.internal:Starting timer... 2024-09-14T08:28:39.748 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T08:28:39.790 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T08:28:39.844 DEBUG:teuthology.task.selinux:Excluding smithi089: OS 'ubuntu' does not support SELinux 2024-09-14T08:28:39.845 DEBUG:teuthology.task.selinux:Excluding smithi112: OS 'ubuntu' does not support SELinux 2024-09-14T08:28:39.845 DEBUG:teuthology.task.selinux:Excluding smithi188: OS 'ubuntu' does not support SELinux 2024-09-14T08:28:39.845 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T08:28:39.845 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-14T08:28:39.845 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T08:28:39.845 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T08:28:39.884 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T08:28:39.897 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T08:28:39.898 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi112.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T08:36:12.281 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2024-09-14T08:36:12.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-14T08:36:12.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:36:12.366 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-14T08:36:12.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-14T08:36:12.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-14T08:36:12.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:36:12.521 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-14T08:36:12.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-14T08:36:12.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-14T08:36:12.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:36:12.682 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-09-14T08:36:12.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-14T08:36:12.758 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T08:36:12.771 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T08:36:12.771 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T08:36:12.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T08:36:12.774 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T08:36:12.774 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T08:36:12.777 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T08:36:12.777 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T08:36:12.802 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T08:36:12.802 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: Command line: ntpd -gq 2024-09-14T08:36:12.802 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: ---------------------------------------------------- 2024-09-14T08:36:12.802 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T08:36:12.802 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T08:36:12.802 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: corporation. Support and training for ntp-4 are 2024-09-14T08:36:12.802 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: available at https://www.nwtime.org/support 2024-09-14T08:36:12.803 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: ---------------------------------------------------- 2024-09-14T08:36:12.803 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: proto: precision = 0.070 usec (-24) 2024-09-14T08:36:12.803 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: basedate set to 2022-02-04 2024-09-14T08:36:12.803 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: gps base set to 2022-02-06 (week 2196) 2024-09-14T08:36:12.804 INFO:teuthology.orchestra.run.smithi112.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T08:36:12.804 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T08:36:12.804 INFO:teuthology.orchestra.run.smithi112.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T08:36:12.805 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T08:36:12.805 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T08:36:12.805 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T08:36:12.805 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T08:36:12.805 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: Listen normally on 3 enp3s0f1 172.21.15.112:123 2024-09-14T08:36:12.806 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: Listen normally on 4 lo [::1]:123 2024-09-14T08:36:12.806 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb69%5]:123 2024-09-14T08:36:12.806 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:12 ntpd[18459]: Listening on routing socket on fd #22 for interface updates 2024-09-14T08:36:12.806 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: Command line: ntpd -gq 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: ---------------------------------------------------- 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: corporation. Support and training for ntp-4 are 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: available at https://www.nwtime.org/support 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: ---------------------------------------------------- 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: proto: precision = 0.045 usec (-24) 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: basedate set to 2022-02-04 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: gps base set to 2022-02-06 (week 2196) 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T08:36:12.807 INFO:teuthology.orchestra.run.smithi089.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T08:36:12.808 INFO:teuthology.orchestra.run.smithi089.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T08:36:12.808 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T08:36:12.809 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T08:36:12.809 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T08:36:12.809 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T08:36:12.809 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: Listen normally on 3 enp3s0f1 172.21.15.89:123 2024-09-14T08:36:12.809 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: Listen normally on 4 lo [::1]:123 2024-09-14T08:36:12.809 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d501%5]:123 2024-09-14T08:36:12.809 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:12 ntpd[18497]: Listening on routing socket on fd #22 for interface updates 2024-09-14T08:36:12.827 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T08:36:12.827 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: Command line: ntpd -gq 2024-09-14T08:36:12.827 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: ---------------------------------------------------- 2024-09-14T08:36:12.827 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T08:36:12.827 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T08:36:12.827 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: corporation. Support and training for ntp-4 are 2024-09-14T08:36:12.827 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: available at https://www.nwtime.org/support 2024-09-14T08:36:12.827 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: ---------------------------------------------------- 2024-09-14T08:36:12.828 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: proto: precision = 0.054 usec (-24) 2024-09-14T08:36:12.828 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: basedate set to 2022-02-04 2024-09-14T08:36:12.828 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: gps base set to 2022-02-06 (week 2196) 2024-09-14T08:36:12.828 INFO:teuthology.orchestra.run.smithi188.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T08:36:12.829 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T08:36:12.829 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T08:36:12.829 INFO:teuthology.orchestra.run.smithi188.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T08:36:12.830 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T08:36:12.830 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T08:36:12.830 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T08:36:12.830 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: Listen normally on 3 enp3s0f1 172.21.15.188:123 2024-09-14T08:36:12.830 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: Listen normally on 4 lo [::1]:123 2024-09-14T08:36:12.831 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8039%5]:123 2024-09-14T08:36:12.831 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:12 ntpd[18495]: Listening on routing socket on fd #22 for interface updates 2024-09-14T08:36:13.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:13 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:13.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:13 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:13.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:13 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:13.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:13 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:13.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:13 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:13.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:13 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:13.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:13.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:13.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:13.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:13.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:13.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:13.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:13.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:13.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:13.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:13.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:13.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:13 ntpd[18495]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:15 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:15.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:15.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:15.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:15.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:15 ntpd[18497]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:15.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:15.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:15.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:15.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:15.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:15.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:15 ntpd[18495]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:16 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:16 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:16 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:16 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:16 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:16 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:16 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:16 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:16.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:16 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:16.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:16 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:16.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:16 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:16.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:16 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:16.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:16 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:16.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:16 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:16.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:16 ntpd[18495]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:16.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:16 ntpd[18495]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:17.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:17.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:17.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:17.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:17 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:17.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:17.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:17.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:17.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:17.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.808 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:17.808 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:17 ntpd[18497]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:17.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:17.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:17.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:17.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:17.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:17.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:17 ntpd[18495]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:18 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:18 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:18 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:18 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:18 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:18 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:18.827 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:18 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:18.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:18 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:18.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:18 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:18.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:18 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:18.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:18 ntpd[18495]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:18.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:18 ntpd[18495]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:19 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:19 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:19 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:19 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:19 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:19 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:19 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:19 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:19.804 INFO:teuthology.orchestra.run.smithi112.stdout:14 Sep 08:36:19 ntpd[18459]: ntpd: time slew +0.002994 s 2024-09-14T08:36:19.804 INFO:teuthology.orchestra.run.smithi112.stdout:ntpd: time slew +0.002994s 2024-09-14T08:36:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:19 ntpd[18459]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T08:36:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:14 Sep 08:36:19 ntpd[18459]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T08:36:19.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:19.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:19.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:19.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:19.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:19.807 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:19 ntpd[18497]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:19.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:19 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:19 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:19 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:19 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:19 ntpd[18495]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:19.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:19 ntpd[18495]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:19.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:19 ntpd[18495]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:19.828 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:19 ntpd[18495]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:19.829 INFO:teuthology.orchestra.run.smithi188.stdout:14 Sep 08:36:19 ntpd[18495]: ntpd: time slew -0.002655 s 2024-09-14T08:36:19.829 INFO:teuthology.orchestra.run.smithi188.stdout:ntpd: time slew -0.002655s 2024-09-14T08:36:19.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:19 ntpd[18495]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T08:36:19.829 INFO:teuthology.orchestra.run.smithi188.stderr:14 Sep 08:36:19 ntpd[18495]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T08:36:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T08:36:19.854 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-14T08:36:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:19.890 INFO:teuthology.orchestra.run.smithi188.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T08:36:19.890 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================== 2024-09-14T08:36:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:21.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:21.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:21.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:21.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:21.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:21.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:21.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T08:36:21.805 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T08:36:21.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T08:36:21.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T08:36:21.806 INFO:teuthology.orchestra.run.smithi089.stdout:14 Sep 08:36:21 ntpd[18497]: ntpd: time slew +0.003582 s 2024-09-14T08:36:21.806 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd: time slew +0.003582s 2024-09-14T08:36:21.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T08:36:21.806 INFO:teuthology.orchestra.run.smithi089.stderr:14 Sep 08:36:21 ntpd[18497]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T08:36:21.866 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T08:36:21.866 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2024-09-14T08:36:21.866 INFO:teuthology.orchestra.run.smithi089.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:21.866 INFO:teuthology.orchestra.run.smithi089.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:21.866 INFO:teuthology.orchestra.run.smithi089.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:21.867 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:36:21.868 INFO:teuthology.run_tasks:Running task install... 2024-09-14T08:36:21.876 DEBUG:teuthology.task.install:project ceph 2024-09-14T08:36:21.876 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}} 2024-09-14T08:36:21.876 DEBUG:teuthology.task.install:config {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'} 2024-09-14T08:36:21.876 INFO:teuthology.task.install:Using flavor: default 2024-09-14T08:36:21.881 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T08:36:21.881 INFO:teuthology.task.install:extra packages: ['rbd-nbd'] 2024-09-14T08:36:21.882 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-key list | grep Ceph 2024-09-14T08:36:21.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-key list | grep Ceph 2024-09-14T08:36:21.883 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-key list | grep Ceph 2024-09-14T08:36:21.947 INFO:teuthology.orchestra.run.smithi188.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T08:36:21.948 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T08:36:21.965 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T08:36:21.974 INFO:teuthology.orchestra.run.smithi188.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T08:36:21.974 INFO:teuthology.orchestra.run.smithi188.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T08:36:21.975 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, rbd-nbd on remote deb x86_64 2024-09-14T08:36:21.976 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T08:36:21.981 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T08:36:21.981 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T08:36:21.981 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, rbd-nbd on remote deb x86_64 2024-09-14T08:36:21.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T08:36:21.993 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T08:36:21.993 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T08:36:21.993 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, rbd-nbd on remote deb x86_64 2024-09-14T08:36:21.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T08:36:22.116 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default/ 2024-09-14T08:36:22.116 INFO:teuthology.task.install.deb:Package version is 19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:36:22.126 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default/ 2024-09-14T08:36:22.126 INFO:teuthology.task.install.deb:Package version is 19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:36:22.131 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default/ 2024-09-14T08:36:22.131 INFO:teuthology.task.install.deb:Package version is 19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:36:22.226 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-14T08:36:22.226 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T08:36:22.235 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:36:22.236 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T08:36:22.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-09-14T08:36:22.243 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:36:22.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T08:36:22.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-14T08:36:22.257 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2024-09-14T08:36:22.409 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T08:36:22.409 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T08:36:22.418 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T08:36:22.425 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T08:36:22.426 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T08:36:22.435 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T08:36:22.436 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T08:36:22.452 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T08:36:22.463 INFO:teuthology.orchestra.run.smithi188.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T08:36:22.467 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T08:36:22.479 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T08:36:22.488 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T08:36:22.488 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T08:36:22.504 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T08:36:22.510 INFO:teuthology.orchestra.run.smithi188.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T08:36:22.511 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T08:36:22.525 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T08:36:22.531 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T08:36:22.533 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-14T08:36:22.546 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-14T08:36:22.551 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T08:36:22.551 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T08:36:22.558 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-14T08:36:22.572 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T08:36:22.573 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T08:36:22.619 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T08:36:22.755 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 29.3 kB in 0s (87.5 kB/s) 2024-09-14T08:36:22.783 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 158 kB in 0s (464 kB/s) 2024-09-14T08:36:22.977 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T08:36:23.149 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 157 kB in 1s (221 kB/s) 2024-09-14T08:36:23.775 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-09-14T08:36:23.793 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4775-g7f24e589-1jammy cephadm=19.3.0-4775-g7f24e589-1jammy ceph-mds=19.3.0-4775-g7f24e589-1jammy ceph-mgr=19.3.0-4775-g7f24e589-1jammy ceph-common=19.3.0-4775-g7f24e589-1jammy ceph-fuse=19.3.0-4775-g7f24e589-1jammy ceph-test=19.3.0-4775-g7f24e589-1jammy ceph-volume=19.3.0-4775-g7f24e589-1jammy radosgw=19.3.0-4775-g7f24e589-1jammy python3-rados=19.3.0-4775-g7f24e589-1jammy python3-rgw=19.3.0-4775-g7f24e589-1jammy python3-cephfs=19.3.0-4775-g7f24e589-1jammy python3-rbd=19.3.0-4775-g7f24e589-1jammy libcephfs2=19.3.0-4775-g7f24e589-1jammy libcephfs-dev=19.3.0-4775-g7f24e589-1jammy librados2=19.3.0-4775-g7f24e589-1jammy librbd1=19.3.0-4775-g7f24e589-1jammy rbd-fuse=19.3.0-4775-g7f24e589-1jammy rbd-nbd=19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:36:23.809 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-09-14T08:36:23.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4775-g7f24e589-1jammy cephadm=19.3.0-4775-g7f24e589-1jammy ceph-mds=19.3.0-4775-g7f24e589-1jammy ceph-mgr=19.3.0-4775-g7f24e589-1jammy ceph-common=19.3.0-4775-g7f24e589-1jammy ceph-fuse=19.3.0-4775-g7f24e589-1jammy ceph-test=19.3.0-4775-g7f24e589-1jammy ceph-volume=19.3.0-4775-g7f24e589-1jammy radosgw=19.3.0-4775-g7f24e589-1jammy python3-rados=19.3.0-4775-g7f24e589-1jammy python3-rgw=19.3.0-4775-g7f24e589-1jammy python3-cephfs=19.3.0-4775-g7f24e589-1jammy python3-rbd=19.3.0-4775-g7f24e589-1jammy libcephfs2=19.3.0-4775-g7f24e589-1jammy libcephfs-dev=19.3.0-4775-g7f24e589-1jammy librados2=19.3.0-4775-g7f24e589-1jammy librbd1=19.3.0-4775-g7f24e589-1jammy rbd-fuse=19.3.0-4775-g7f24e589-1jammy rbd-nbd=19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:36:23.858 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-09-14T08:36:23.890 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-09-14T08:36:24.069 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-09-14T08:36:24.069 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-09-14T08:36:24.099 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2024-09-14T08:36:24.100 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2024-09-14T08:36:24.167 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-14T08:36:24.185 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4775-g7f24e589-1jammy cephadm=19.3.0-4775-g7f24e589-1jammy ceph-mds=19.3.0-4775-g7f24e589-1jammy ceph-mgr=19.3.0-4775-g7f24e589-1jammy ceph-common=19.3.0-4775-g7f24e589-1jammy ceph-fuse=19.3.0-4775-g7f24e589-1jammy ceph-test=19.3.0-4775-g7f24e589-1jammy ceph-volume=19.3.0-4775-g7f24e589-1jammy radosgw=19.3.0-4775-g7f24e589-1jammy python3-rados=19.3.0-4775-g7f24e589-1jammy python3-rgw=19.3.0-4775-g7f24e589-1jammy python3-cephfs=19.3.0-4775-g7f24e589-1jammy python3-rbd=19.3.0-4775-g7f24e589-1jammy libcephfs2=19.3.0-4775-g7f24e589-1jammy libcephfs-dev=19.3.0-4775-g7f24e589-1jammy librados2=19.3.0-4775-g7f24e589-1jammy librbd1=19.3.0-4775-g7f24e589-1jammy rbd-fuse=19.3.0-4775-g7f24e589-1jammy rbd-nbd=19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:36:24.239 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-14T08:36:24.275 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T08:36:24.276 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T08:36:24.276 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T08:36:24.276 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T08:36:24.276 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T08:36:24.277 INFO:teuthology.orchestra.run.smithi188.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T08:36:24.277 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T08:36:24.277 INFO:teuthology.orchestra.run.smithi188.stdout:The following additional packages will be installed: 2024-09-14T08:36:24.277 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T08:36:24.278 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T08:36:24.278 INFO:teuthology.orchestra.run.smithi188.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T08:36:24.278 INFO:teuthology.orchestra.run.smithi188.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T08:36:24.278 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T08:36:24.279 INFO:teuthology.orchestra.run.smithi188.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T08:36:24.279 INFO:teuthology.orchestra.run.smithi188.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T08:36:24.279 INFO:teuthology.orchestra.run.smithi188.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T08:36:24.279 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T08:36:24.279 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T08:36:24.279 INFO:teuthology.orchestra.run.smithi188.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T08:36:24.280 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T08:36:24.281 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet zip 2024-09-14T08:36:24.281 INFO:teuthology.orchestra.run.smithi188.stdout:Suggested packages: 2024-09-14T08:36:24.281 INFO:teuthology.orchestra.run.smithi188.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T08:36:24.281 INFO:teuthology.orchestra.run.smithi188.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T08:36:24.281 INFO:teuthology.orchestra.run.smithi188.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T08:36:24.281 INFO:teuthology.orchestra.run.smithi188.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T08:36:24.281 INFO:teuthology.orchestra.run.smithi188.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T08:36:24.281 INFO:teuthology.orchestra.run.smithi188.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T08:36:24.281 INFO:teuthology.orchestra.run.smithi188.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T08:36:24.282 INFO:teuthology.orchestra.run.smithi188.stdout:Recommended packages: 2024-09-14T08:36:24.282 INFO:teuthology.orchestra.run.smithi188.stdout: btrfs-tools 2024-09-14T08:36:24.306 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T08:36:24.306 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T08:36:24.306 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T08:36:24.306 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T08:36:24.306 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T08:36:24.306 INFO:teuthology.orchestra.run.smithi089.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T08:36:24.306 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T08:36:24.307 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T08:36:24.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T08:36:24.309 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet zip 2024-09-14T08:36:24.310 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2024-09-14T08:36:24.310 INFO:teuthology.orchestra.run.smithi089.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T08:36:24.310 INFO:teuthology.orchestra.run.smithi089.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T08:36:24.310 INFO:teuthology.orchestra.run.smithi089.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T08:36:24.310 INFO:teuthology.orchestra.run.smithi089.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T08:36:24.310 INFO:teuthology.orchestra.run.smithi089.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T08:36:24.310 INFO:teuthology.orchestra.run.smithi089.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T08:36:24.310 INFO:teuthology.orchestra.run.smithi089.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T08:36:24.310 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2024-09-14T08:36:24.310 INFO:teuthology.orchestra.run.smithi089.stdout: btrfs-tools 2024-09-14T08:36:24.388 INFO:teuthology.orchestra.run.smithi188.stdout:The following NEW packages will be installed: 2024-09-14T08:36:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T08:36:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T08:36:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T08:36:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T08:36:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T08:36:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T08:36:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T08:36:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T08:36:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T08:36:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T08:36:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T08:36:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T08:36:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T08:36:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T08:36:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: radosgw rbd-fuse rbd-nbd socat unzip xmlstarlet zip 2024-09-14T08:36:24.415 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2024-09-14T08:36:24.415 INFO:teuthology.orchestra.run.smithi089.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T08:36:24.415 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T08:36:24.415 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T08:36:24.417 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T08:36:24.417 INFO:teuthology.orchestra.run.smithi089.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T08:36:24.417 INFO:teuthology.orchestra.run.smithi089.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T08:36:24.417 INFO:teuthology.orchestra.run.smithi089.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T08:36:24.417 INFO:teuthology.orchestra.run.smithi089.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T08:36:24.417 INFO:teuthology.orchestra.run.smithi089.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T08:36:24.417 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T08:36:24.417 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T08:36:24.417 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T08:36:24.417 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T08:36:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: radosgw rbd-fuse rbd-nbd socat unzip xmlstarlet zip 2024-09-14T08:36:24.423 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-14T08:36:24.424 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-14T08:36:24.477 INFO:teuthology.orchestra.run.smithi089.stdout:0 upgraded, 120 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T08:36:24.477 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 251 MB of archives. 2024-09-14T08:36:24.477 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T08:36:24.477 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T08:36:24.530 INFO:teuthology.orchestra.run.smithi188.stdout:0 upgraded, 120 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T08:36:24.530 INFO:teuthology.orchestra.run.smithi188.stdout:Need to get 251 MB of archives. 2024-09-14T08:36:24.530 INFO:teuthology.orchestra.run.smithi188.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T08:36:24.530 INFO:teuthology.orchestra.run.smithi188.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4775-g7f24e589-1jammy [3,631 kB] 2024-09-14T08:36:24.562 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4775-g7f24e589-1jammy [3,631 kB] 2024-09-14T08:36:24.565 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T08:36:24.568 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T08:36:24.575 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T08:36:24.585 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T08:36:24.607 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T08:36:24.608 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T08:36:24.608 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T08:36:24.608 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T08:36:24.608 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T08:36:24.608 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T08:36:24.609 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T08:36:24.610 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-14T08:36:24.610 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T08:36:24.610 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T08:36:24.610 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T08:36:24.610 INFO:teuthology.orchestra.run.smithi112.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T08:36:24.611 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T08:36:24.612 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T08:36:24.612 INFO:teuthology.orchestra.run.smithi112.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T08:36:24.612 INFO:teuthology.orchestra.run.smithi112.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T08:36:24.612 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T08:36:24.612 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T08:36:24.612 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet zip 2024-09-14T08:36:24.612 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-14T08:36:24.612 INFO:teuthology.orchestra.run.smithi112.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T08:36:24.612 INFO:teuthology.orchestra.run.smithi112.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T08:36:24.612 INFO:teuthology.orchestra.run.smithi112.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T08:36:24.613 INFO:teuthology.orchestra.run.smithi112.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T08:36:24.613 INFO:teuthology.orchestra.run.smithi112.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T08:36:24.613 INFO:teuthology.orchestra.run.smithi112.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T08:36:24.613 INFO:teuthology.orchestra.run.smithi112.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T08:36:24.613 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-14T08:36:24.613 INFO:teuthology.orchestra.run.smithi112.stdout: btrfs-tools 2024-09-14T08:36:24.647 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T08:36:24.651 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T08:36:24.663 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T08:36:24.669 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T08:36:24.671 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T08:36:24.672 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T08:36:24.673 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T08:36:24.683 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T08:36:24.685 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T08:36:24.687 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T08:36:24.688 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T08:36:24.701 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T08:36:24.704 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T08:36:24.707 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T08:36:24.710 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T08:36:24.710 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T08:36:24.715 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-14T08:36:24.716 INFO:teuthology.orchestra.run.smithi112.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T08:36:24.716 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T08:36:24.716 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T08:36:24.717 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T08:36:24.717 INFO:teuthology.orchestra.run.smithi112.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T08:36:24.717 INFO:teuthology.orchestra.run.smithi112.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T08:36:24.718 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T08:36:24.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T08:36:24.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T08:36:24.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T08:36:24.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T08:36:24.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T08:36:24.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T08:36:24.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T08:36:24.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T08:36:24.719 INFO:teuthology.orchestra.run.smithi112.stdout: radosgw rbd-fuse rbd-nbd socat unzip xmlstarlet zip 2024-09-14T08:36:24.720 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T08:36:24.720 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T08:36:24.720 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T08:36:24.720 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T08:36:24.721 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T08:36:24.735 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T08:36:24.735 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T08:36:24.735 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T08:36:24.738 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T08:36:24.739 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T08:36:24.741 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4775-g7f24e589-1jammy [3,330 kB] 2024-09-14T08:36:24.751 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T08:36:24.752 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T08:36:24.752 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T08:36:24.753 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T08:36:24.753 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T08:36:24.757 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4775-g7f24e589-1jammy [3,330 kB] 2024-09-14T08:36:24.768 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T08:36:24.769 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T08:36:24.770 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T08:36:24.778 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T08:36:24.778 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T08:36:24.785 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T08:36:24.785 INFO:teuthology.orchestra.run.smithi089.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T08:36:24.786 INFO:teuthology.orchestra.run.smithi089.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T08:36:24.788 INFO:teuthology.orchestra.run.smithi089.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T08:36:24.789 INFO:teuthology.orchestra.run.smithi089.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T08:36:24.801 INFO:teuthology.orchestra.run.smithi089.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T08:36:24.802 INFO:teuthology.orchestra.run.smithi089.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T08:36:24.806 INFO:teuthology.orchestra.run.smithi089.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T08:36:24.807 INFO:teuthology.orchestra.run.smithi089.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T08:36:24.808 INFO:teuthology.orchestra.run.smithi089.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T08:36:24.818 INFO:teuthology.orchestra.run.smithi089.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T08:36:24.835 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4775-g7f24e589-1jammy [722 kB] 2024-09-14T08:36:24.857 INFO:teuthology.orchestra.run.smithi089.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4775-g7f24e589-1jammy [722 kB] 2024-09-14T08:36:24.868 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4775-g7f24e589-1jammy [356 kB] 2024-09-14T08:36:24.874 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4775-g7f24e589-1jammy [32.8 kB] 2024-09-14T08:36:24.875 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4775-g7f24e589-1jammy [180 kB] 2024-09-14T08:36:24.876 INFO:teuthology.orchestra.run.smithi089.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T08:36:24.877 INFO:teuthology.orchestra.run.smithi089.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T08:36:24.878 INFO:teuthology.orchestra.run.smithi089.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T08:36:24.878 INFO:teuthology.orchestra.run.smithi089.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T08:36:24.879 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4775-g7f24e589-1jammy [71.2 kB] 2024-09-14T08:36:24.879 INFO:teuthology.orchestra.run.smithi089.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T08:36:24.880 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4775-g7f24e589-1jammy [338 kB] 2024-09-14T08:36:24.886 INFO:teuthology.orchestra.run.smithi188.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4775-g7f24e589-1jammy [7,984 kB] 2024-09-14T08:36:24.892 INFO:teuthology.orchestra.run.smithi089.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4775-g7f24e589-1jammy [356 kB] 2024-09-14T08:36:24.897 INFO:teuthology.orchestra.run.smithi089.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4775-g7f24e589-1jammy [32.8 kB] 2024-09-14T08:36:24.898 INFO:teuthology.orchestra.run.smithi089.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4775-g7f24e589-1jammy [180 kB] 2024-09-14T08:36:24.899 INFO:teuthology.orchestra.run.smithi089.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T08:36:24.901 INFO:teuthology.orchestra.run.smithi089.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4775-g7f24e589-1jammy [71.2 kB] 2024-09-14T08:36:24.902 INFO:teuthology.orchestra.run.smithi089.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T08:36:24.903 INFO:teuthology.orchestra.run.smithi089.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T08:36:24.903 INFO:teuthology.orchestra.run.smithi089.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4775-g7f24e589-1jammy [338 kB] 2024-09-14T08:36:24.905 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 120 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T08:36:24.906 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 251 MB of archives. 2024-09-14T08:36:24.906 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T08:36:24.906 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T08:36:24.908 INFO:teuthology.orchestra.run.smithi089.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4775-g7f24e589-1jammy [7,984 kB] 2024-09-14T08:36:24.922 INFO:teuthology.orchestra.run.smithi089.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T08:36:24.922 INFO:teuthology.orchestra.run.smithi089.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T08:36:24.922 INFO:teuthology.orchestra.run.smithi089.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T08:36:24.922 INFO:teuthology.orchestra.run.smithi089.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T08:36:24.923 INFO:teuthology.orchestra.run.smithi089.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T08:36:24.923 INFO:teuthology.orchestra.run.smithi089.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T08:36:24.928 INFO:teuthology.orchestra.run.smithi089.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T08:36:24.929 INFO:teuthology.orchestra.run.smithi089.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T08:36:24.931 INFO:teuthology.orchestra.run.smithi089.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T08:36:24.945 INFO:teuthology.orchestra.run.smithi089.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T08:36:24.947 INFO:teuthology.orchestra.run.smithi089.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T08:36:24.947 INFO:teuthology.orchestra.run.smithi089.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T08:36:24.952 INFO:teuthology.orchestra.run.smithi089.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T08:36:24.955 INFO:teuthology.orchestra.run.smithi089.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T08:36:24.956 INFO:teuthology.orchestra.run.smithi089.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T08:36:24.957 INFO:teuthology.orchestra.run.smithi089.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T08:36:24.963 INFO:teuthology.orchestra.run.smithi089.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T08:36:24.964 INFO:teuthology.orchestra.run.smithi089.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T08:36:24.967 INFO:teuthology.orchestra.run.smithi089.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T08:36:24.978 INFO:teuthology.orchestra.run.smithi089.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T08:36:24.979 INFO:teuthology.orchestra.run.smithi089.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T08:36:24.979 INFO:teuthology.orchestra.run.smithi089.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T08:36:24.980 INFO:teuthology.orchestra.run.smithi089.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T08:36:24.981 INFO:teuthology.orchestra.run.smithi089.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T08:36:24.987 INFO:teuthology.orchestra.run.smithi089.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T08:36:24.991 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4775-g7f24e589-1jammy [3,631 kB] 2024-09-14T08:36:24.995 INFO:teuthology.orchestra.run.smithi089.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T08:36:24.995 INFO:teuthology.orchestra.run.smithi089.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T08:36:24.996 INFO:teuthology.orchestra.run.smithi188.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T08:36:24.998 INFO:teuthology.orchestra.run.smithi089.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T08:36:24.998 INFO:teuthology.orchestra.run.smithi089.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T08:36:25.009 INFO:teuthology.orchestra.run.smithi188.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T08:36:25.090 INFO:teuthology.orchestra.run.smithi188.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T08:36:25.154 INFO:teuthology.orchestra.run.smithi188.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4775-g7f24e589-1jammy [112 kB] 2024-09-14T08:36:25.156 INFO:teuthology.orchestra.run.smithi188.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4775-g7f24e589-1jammy [473 kB] 2024-09-14T08:36:25.164 INFO:teuthology.orchestra.run.smithi188.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4775-g7f24e589-1jammy [28.3 MB] 2024-09-14T08:36:25.187 INFO:teuthology.orchestra.run.smithi089.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4775-g7f24e589-1jammy [112 kB] 2024-09-14T08:36:25.190 INFO:teuthology.orchestra.run.smithi089.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4775-g7f24e589-1jammy [473 kB] 2024-09-14T08:36:25.199 INFO:teuthology.orchestra.run.smithi089.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4775-g7f24e589-1jammy [28.3 MB] 2024-09-14T08:36:25.326 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T08:36:25.328 INFO:teuthology.orchestra.run.smithi188.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T08:36:25.337 INFO:teuthology.orchestra.run.smithi188.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T08:36:25.338 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T08:36:25.366 INFO:teuthology.orchestra.run.smithi188.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T08:36:25.375 INFO:teuthology.orchestra.run.smithi188.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T08:36:25.377 INFO:teuthology.orchestra.run.smithi188.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T08:36:25.378 INFO:teuthology.orchestra.run.smithi188.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T08:36:25.379 INFO:teuthology.orchestra.run.smithi188.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T08:36:25.398 INFO:teuthology.orchestra.run.smithi188.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T08:36:25.404 INFO:teuthology.orchestra.run.smithi188.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T08:36:25.410 INFO:teuthology.orchestra.run.smithi188.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T08:36:25.419 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T08:36:25.490 INFO:teuthology.orchestra.run.smithi188.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T08:36:25.491 INFO:teuthology.orchestra.run.smithi188.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T08:36:25.495 INFO:teuthology.orchestra.run.smithi188.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T08:36:25.500 INFO:teuthology.orchestra.run.smithi188.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T08:36:25.503 INFO:teuthology.orchestra.run.smithi188.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T08:36:25.504 INFO:teuthology.orchestra.run.smithi188.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T08:36:25.505 INFO:teuthology.orchestra.run.smithi188.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T08:36:25.507 INFO:teuthology.orchestra.run.smithi188.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T08:36:25.507 INFO:teuthology.orchestra.run.smithi188.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T08:36:25.573 INFO:teuthology.orchestra.run.smithi188.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T08:36:25.590 INFO:teuthology.orchestra.run.smithi188.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T08:36:25.591 INFO:teuthology.orchestra.run.smithi188.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T08:36:25.592 INFO:teuthology.orchestra.run.smithi188.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T08:36:25.592 INFO:teuthology.orchestra.run.smithi188.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T08:36:25.598 INFO:teuthology.orchestra.run.smithi188.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T08:36:25.599 INFO:teuthology.orchestra.run.smithi188.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T08:36:25.647 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T08:36:25.655 INFO:teuthology.orchestra.run.smithi188.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T08:36:25.656 INFO:teuthology.orchestra.run.smithi188.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T08:36:25.658 INFO:teuthology.orchestra.run.smithi188.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T08:36:25.658 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T08:36:25.688 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T08:36:25.697 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T08:36:25.699 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T08:36:25.701 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T08:36:25.702 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T08:36:25.720 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T08:36:25.724 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T08:36:25.729 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T08:36:25.736 INFO:teuthology.orchestra.run.smithi188.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T08:36:25.737 INFO:teuthology.orchestra.run.smithi188.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T08:36:25.739 INFO:teuthology.orchestra.run.smithi188.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T08:36:25.741 INFO:teuthology.orchestra.run.smithi188.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T08:36:25.742 INFO:teuthology.orchestra.run.smithi188.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T08:36:25.753 INFO:teuthology.orchestra.run.smithi188.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T08:36:25.810 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T08:36:25.811 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T08:36:25.815 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T08:36:25.817 INFO:teuthology.orchestra.run.smithi188.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T08:36:25.818 INFO:teuthology.orchestra.run.smithi188.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T08:36:25.820 INFO:teuthology.orchestra.run.smithi188.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T08:36:25.820 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T08:36:25.822 INFO:teuthology.orchestra.run.smithi188.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T08:36:25.823 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T08:36:25.824 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T08:36:25.825 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T08:36:25.827 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T08:36:25.827 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T08:36:25.892 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T08:36:25.898 INFO:teuthology.orchestra.run.smithi188.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T08:36:25.900 INFO:teuthology.orchestra.run.smithi188.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T08:36:25.903 INFO:teuthology.orchestra.run.smithi188.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T08:36:25.905 INFO:teuthology.orchestra.run.smithi188.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T08:36:25.909 INFO:teuthology.orchestra.run.smithi188.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T08:36:25.910 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T08:36:25.910 INFO:teuthology.orchestra.run.smithi188.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T08:36:25.911 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T08:36:25.911 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T08:36:25.912 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T08:36:25.917 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T08:36:25.918 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T08:36:25.974 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T08:36:25.974 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T08:36:25.976 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T08:36:25.982 INFO:teuthology.orchestra.run.smithi188.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T08:36:25.987 INFO:teuthology.orchestra.run.smithi188.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T08:36:26.055 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T08:36:26.055 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T08:36:26.057 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T08:36:26.059 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T08:36:26.060 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T08:36:26.071 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T08:36:26.136 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T08:36:26.137 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T08:36:26.138 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T08:36:26.140 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T08:36:26.207 INFO:teuthology.orchestra.run.smithi188.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T08:36:26.217 INFO:teuthology.orchestra.run.smithi112.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T08:36:26.218 INFO:teuthology.orchestra.run.smithi112.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T08:36:26.221 INFO:teuthology.orchestra.run.smithi112.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T08:36:26.223 INFO:teuthology.orchestra.run.smithi112.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T08:36:26.227 INFO:teuthology.orchestra.run.smithi112.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T08:36:26.229 INFO:teuthology.orchestra.run.smithi112.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T08:36:26.244 INFO:teuthology.orchestra.run.smithi112.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4775-g7f24e589-1jammy [3,330 kB] 2024-09-14T08:36:26.290 INFO:teuthology.orchestra.run.smithi089.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4775-g7f24e589-1jammy [5,206 kB] 2024-09-14T08:36:26.292 INFO:teuthology.orchestra.run.smithi188.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T08:36:26.293 INFO:teuthology.orchestra.run.smithi188.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4775-g7f24e589-1jammy [5,206 kB] 2024-09-14T08:36:26.295 INFO:teuthology.orchestra.run.smithi188.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T08:36:26.295 INFO:teuthology.orchestra.run.smithi188.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T08:36:26.298 INFO:teuthology.orchestra.run.smithi112.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T08:36:26.298 INFO:teuthology.orchestra.run.smithi188.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T08:36:26.303 INFO:teuthology.orchestra.run.smithi112.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T08:36:26.344 INFO:teuthology.orchestra.run.smithi188.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T08:36:26.348 INFO:teuthology.orchestra.run.smithi188.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T08:36:26.348 INFO:teuthology.orchestra.run.smithi188.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T08:36:26.370 INFO:teuthology.orchestra.run.smithi089.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4775-g7f24e589-1jammy [251 kB] 2024-09-14T08:36:26.373 INFO:teuthology.orchestra.run.smithi188.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4775-g7f24e589-1jammy [251 kB] 2024-09-14T08:36:26.376 INFO:teuthology.orchestra.run.smithi188.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4775-g7f24e589-1jammy [124 kB] 2024-09-14T08:36:26.377 INFO:teuthology.orchestra.run.smithi188.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4775-g7f24e589-1jammy [1,561 kB] 2024-09-14T08:36:26.383 INFO:teuthology.orchestra.run.smithi089.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4775-g7f24e589-1jammy [124 kB] 2024-09-14T08:36:26.385 INFO:teuthology.orchestra.run.smithi089.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4775-g7f24e589-1jammy [1,561 kB] 2024-09-14T08:36:26.393 INFO:teuthology.orchestra.run.smithi188.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T08:36:26.394 INFO:teuthology.orchestra.run.smithi188.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T08:36:26.428 INFO:teuthology.orchestra.run.smithi188.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4775-g7f24e589-1jammy [6,311 kB] 2024-09-14T08:36:26.438 INFO:teuthology.orchestra.run.smithi089.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4775-g7f24e589-1jammy [6,311 kB] 2024-09-14T08:36:26.468 INFO:teuthology.orchestra.run.smithi112.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T08:36:26.470 INFO:teuthology.orchestra.run.smithi112.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T08:36:26.471 INFO:teuthology.orchestra.run.smithi188.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T08:36:26.472 INFO:teuthology.orchestra.run.smithi188.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T08:36:26.473 INFO:teuthology.orchestra.run.smithi112.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T08:36:26.473 INFO:teuthology.orchestra.run.smithi188.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T08:36:26.473 INFO:teuthology.orchestra.run.smithi112.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T08:36:26.474 INFO:teuthology.orchestra.run.smithi188.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T08:36:26.475 INFO:teuthology.orchestra.run.smithi188.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T08:36:26.476 INFO:teuthology.orchestra.run.smithi112.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T08:36:26.476 INFO:teuthology.orchestra.run.smithi188.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T08:36:26.483 INFO:teuthology.orchestra.run.smithi188.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T08:36:26.511 INFO:teuthology.orchestra.run.smithi112.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T08:36:26.514 INFO:teuthology.orchestra.run.smithi112.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T08:36:26.514 INFO:teuthology.orchestra.run.smithi112.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T08:36:26.552 INFO:teuthology.orchestra.run.smithi188.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T08:36:26.556 INFO:teuthology.orchestra.run.smithi188.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T08:36:26.557 INFO:teuthology.orchestra.run.smithi188.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T08:36:26.574 INFO:teuthology.orchestra.run.smithi112.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T08:36:26.574 INFO:teuthology.orchestra.run.smithi112.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T08:36:26.633 INFO:teuthology.orchestra.run.smithi188.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T08:36:26.635 INFO:teuthology.orchestra.run.smithi112.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T08:36:26.636 INFO:teuthology.orchestra.run.smithi112.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T08:36:26.637 INFO:teuthology.orchestra.run.smithi112.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T08:36:26.638 INFO:teuthology.orchestra.run.smithi112.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T08:36:26.639 INFO:teuthology.orchestra.run.smithi112.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T08:36:26.640 INFO:teuthology.orchestra.run.smithi112.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T08:36:26.640 INFO:teuthology.orchestra.run.smithi188.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T08:36:26.643 INFO:teuthology.orchestra.run.smithi188.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T08:36:26.644 INFO:teuthology.orchestra.run.smithi188.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T08:36:26.647 INFO:teuthology.orchestra.run.smithi112.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T08:36:26.656 INFO:teuthology.orchestra.run.smithi112.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4775-g7f24e589-1jammy [722 kB] 2024-09-14T08:36:26.656 INFO:teuthology.orchestra.run.smithi188.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T08:36:26.657 INFO:teuthology.orchestra.run.smithi188.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T08:36:26.665 INFO:teuthology.orchestra.run.smithi188.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T08:36:26.666 INFO:teuthology.orchestra.run.smithi188.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4775-g7f24e589-1jammy [23.1 MB] 2024-09-14T08:36:26.682 INFO:teuthology.orchestra.run.smithi089.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4775-g7f24e589-1jammy [23.1 MB] 2024-09-14T08:36:26.711 INFO:teuthology.orchestra.run.smithi112.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4775-g7f24e589-1jammy [356 kB] 2024-09-14T08:36:26.714 INFO:teuthology.orchestra.run.smithi188.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T08:36:26.716 INFO:teuthology.orchestra.run.smithi112.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T08:36:26.716 INFO:teuthology.orchestra.run.smithi188.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T08:36:26.717 INFO:teuthology.orchestra.run.smithi188.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T08:36:26.720 INFO:teuthology.orchestra.run.smithi112.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T08:36:26.721 INFO:teuthology.orchestra.run.smithi112.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T08:36:26.760 INFO:teuthology.orchestra.run.smithi112.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4775-g7f24e589-1jammy [32.8 kB] 2024-09-14T08:36:26.761 INFO:teuthology.orchestra.run.smithi112.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4775-g7f24e589-1jammy [180 kB] 2024-09-14T08:36:26.796 INFO:teuthology.orchestra.run.smithi188.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T08:36:26.797 INFO:teuthology.orchestra.run.smithi112.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T08:36:26.798 INFO:teuthology.orchestra.run.smithi188.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T08:36:26.804 INFO:teuthology.orchestra.run.smithi112.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T08:36:26.806 INFO:teuthology.orchestra.run.smithi112.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4775-g7f24e589-1jammy [71.2 kB] 2024-09-14T08:36:26.807 INFO:teuthology.orchestra.run.smithi112.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T08:36:26.808 INFO:teuthology.orchestra.run.smithi112.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T08:36:26.809 INFO:teuthology.orchestra.run.smithi112.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4775-g7f24e589-1jammy [338 kB] 2024-09-14T08:36:26.818 INFO:teuthology.orchestra.run.smithi188.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T08:36:26.819 INFO:teuthology.orchestra.run.smithi188.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T08:36:26.819 INFO:teuthology.orchestra.run.smithi112.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T08:36:26.820 INFO:teuthology.orchestra.run.smithi188.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T08:36:26.821 INFO:teuthology.orchestra.run.smithi112.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T08:36:26.825 INFO:teuthology.orchestra.run.smithi188.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T08:36:26.827 INFO:teuthology.orchestra.run.smithi188.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T08:36:26.828 INFO:teuthology.orchestra.run.smithi112.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T08:36:26.848 INFO:teuthology.orchestra.run.smithi112.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4775-g7f24e589-1jammy [7,984 kB] 2024-09-14T08:36:26.879 INFO:teuthology.orchestra.run.smithi112.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T08:36:26.880 INFO:teuthology.orchestra.run.smithi112.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T08:36:26.881 INFO:teuthology.orchestra.run.smithi112.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T08:36:26.960 INFO:teuthology.orchestra.run.smithi112.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T08:36:26.962 INFO:teuthology.orchestra.run.smithi112.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T08:36:26.981 INFO:teuthology.orchestra.run.smithi112.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T08:36:26.982 INFO:teuthology.orchestra.run.smithi112.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T08:36:26.983 INFO:teuthology.orchestra.run.smithi112.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T08:36:26.989 INFO:teuthology.orchestra.run.smithi112.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T08:36:26.990 INFO:teuthology.orchestra.run.smithi112.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T08:36:27.518 INFO:teuthology.orchestra.run.smithi112.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4775-g7f24e589-1jammy [112 kB] 2024-09-14T08:36:27.565 INFO:teuthology.orchestra.run.smithi112.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4775-g7f24e589-1jammy [473 kB] 2024-09-14T08:36:27.575 INFO:teuthology.orchestra.run.smithi112.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4775-g7f24e589-1jammy [28.3 MB] 2024-09-14T08:36:27.686 INFO:teuthology.orchestra.run.smithi188.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4775-g7f24e589-1jammy [14.1 kB] 2024-09-14T08:36:27.686 INFO:teuthology.orchestra.run.smithi188.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4775-g7f24e589-1jammy [880 kB] 2024-09-14T08:36:27.703 INFO:teuthology.orchestra.run.smithi188.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4775-g7f24e589-1jammy [2,452 kB] 2024-09-14T08:36:27.725 INFO:teuthology.orchestra.run.smithi089.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4775-g7f24e589-1jammy [14.1 kB] 2024-09-14T08:36:27.726 INFO:teuthology.orchestra.run.smithi089.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4775-g7f24e589-1jammy [880 kB] 2024-09-14T08:36:27.744 INFO:teuthology.orchestra.run.smithi089.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4775-g7f24e589-1jammy [2,452 kB] 2024-09-14T08:36:27.745 INFO:teuthology.orchestra.run.smithi188.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4775-g7f24e589-1jammy [812 kB] 2024-09-14T08:36:27.765 INFO:teuthology.orchestra.run.smithi188.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4775-g7f24e589-1jammy [160 kB] 2024-09-14T08:36:27.769 INFO:teuthology.orchestra.run.smithi188.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4775-g7f24e589-1jammy [61.4 MB] 2024-09-14T08:36:27.791 INFO:teuthology.orchestra.run.smithi089.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4775-g7f24e589-1jammy [812 kB] 2024-09-14T08:36:27.806 INFO:teuthology.orchestra.run.smithi089.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4775-g7f24e589-1jammy [160 kB] 2024-09-14T08:36:27.809 INFO:teuthology.orchestra.run.smithi089.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4775-g7f24e589-1jammy [61.4 MB] 2024-09-14T08:36:29.235 INFO:teuthology.orchestra.run.smithi112.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4775-g7f24e589-1jammy [5,206 kB] 2024-09-14T08:36:29.423 INFO:teuthology.orchestra.run.smithi112.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4775-g7f24e589-1jammy [251 kB] 2024-09-14T08:36:29.451 INFO:teuthology.orchestra.run.smithi112.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4775-g7f24e589-1jammy [124 kB] 2024-09-14T08:36:29.454 INFO:teuthology.orchestra.run.smithi112.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4775-g7f24e589-1jammy [1,561 kB] 2024-09-14T08:36:29.522 INFO:teuthology.orchestra.run.smithi112.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4775-g7f24e589-1jammy [6,311 kB] 2024-09-14T08:36:29.841 INFO:teuthology.orchestra.run.smithi112.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4775-g7f24e589-1jammy [23.1 MB] 2024-09-14T08:36:30.984 INFO:teuthology.orchestra.run.smithi188.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4775-g7f24e589-1jammy [8,625 kB] 2024-09-14T08:36:31.031 INFO:teuthology.orchestra.run.smithi112.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4775-g7f24e589-1jammy [14.1 kB] 2024-09-14T08:36:31.032 INFO:teuthology.orchestra.run.smithi112.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4775-g7f24e589-1jammy [880 kB] 2024-09-14T08:36:31.048 INFO:teuthology.orchestra.run.smithi112.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4775-g7f24e589-1jammy [2,452 kB] 2024-09-14T08:36:31.090 INFO:teuthology.orchestra.run.smithi112.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4775-g7f24e589-1jammy [812 kB] 2024-09-14T08:36:31.096 INFO:teuthology.orchestra.run.smithi089.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4775-g7f24e589-1jammy [8,625 kB] 2024-09-14T08:36:31.100 INFO:teuthology.orchestra.run.smithi112.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4775-g7f24e589-1jammy [160 kB] 2024-09-14T08:36:31.102 INFO:teuthology.orchestra.run.smithi112.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4775-g7f24e589-1jammy [61.4 MB] 2024-09-14T08:36:31.133 INFO:teuthology.orchestra.run.smithi188.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4775-g7f24e589-1jammy [14.2 kB] 2024-09-14T08:36:31.133 INFO:teuthology.orchestra.run.smithi188.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4775-g7f24e589-1jammy [55.8 MB] 2024-09-14T08:36:31.375 INFO:teuthology.orchestra.run.smithi089.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4775-g7f24e589-1jammy [14.2 kB] 2024-09-14T08:36:31.375 INFO:teuthology.orchestra.run.smithi089.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4775-g7f24e589-1jammy [55.8 MB] 2024-09-14T08:36:34.155 INFO:teuthology.orchestra.run.smithi188.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4775-g7f24e589-1jammy [130 kB] 2024-09-14T08:36:34.158 INFO:teuthology.orchestra.run.smithi188.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4775-g7f24e589-1jammy [39.0 kB] 2024-09-14T08:36:34.159 INFO:teuthology.orchestra.run.smithi188.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4775-g7f24e589-1jammy [15.9 MB] 2024-09-14T08:36:34.264 INFO:teuthology.orchestra.run.smithi112.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4775-g7f24e589-1jammy [8,625 kB] 2024-09-14T08:36:34.446 INFO:teuthology.orchestra.run.smithi112.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4775-g7f24e589-1jammy [14.2 kB] 2024-09-14T08:36:34.446 INFO:teuthology.orchestra.run.smithi112.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4775-g7f24e589-1jammy [55.8 MB] 2024-09-14T08:36:34.467 INFO:teuthology.orchestra.run.smithi089.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4775-g7f24e589-1jammy [130 kB] 2024-09-14T08:36:34.470 INFO:teuthology.orchestra.run.smithi089.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4775-g7f24e589-1jammy [39.0 kB] 2024-09-14T08:36:34.471 INFO:teuthology.orchestra.run.smithi089.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4775-g7f24e589-1jammy [15.9 MB] 2024-09-14T08:36:34.637 INFO:teuthology.orchestra.run.smithi188.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4775-g7f24e589-1jammy [91.3 kB] 2024-09-14T08:36:34.639 INFO:teuthology.orchestra.run.smithi188.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.3.0-4775-g7f24e589-1jammy [178 kB] 2024-09-14T08:36:35.093 INFO:teuthology.orchestra.run.smithi089.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4775-g7f24e589-1jammy [91.3 kB] 2024-09-14T08:36:35.095 INFO:teuthology.orchestra.run.smithi089.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.3.0-4775-g7f24e589-1jammy [178 kB] 2024-09-14T08:36:35.212 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 251 MB in 10s (24.5 MB/s) 2024-09-14T08:36:35.380 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T08:36:35.481 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T08:36:35.486 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T08:36:35.562 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T08:36:35.670 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 251 MB in 11s (23.5 MB/s) 2024-09-14T08:36:35.837 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T08:36:35.848 INFO:teuthology.orchestra.run.smithi112.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4775-g7f24e589-1jammy [130 kB] 2024-09-14T08:36:35.851 INFO:teuthology.orchestra.run.smithi112.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4775-g7f24e589-1jammy [39.0 kB] 2024-09-14T08:36:35.914 INFO:teuthology.orchestra.run.smithi112.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4775-g7f24e589-1jammy [15.9 MB] 2024-09-14T08:36:35.915 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T08:36:35.937 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T08:36:35.942 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T08:36:35.943 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T08:36:35.999 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T08:36:36.027 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T08:36:36.228 INFO:teuthology.orchestra.run.smithi112.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4775-g7f24e589-1jammy [91.3 kB] 2024-09-14T08:36:36.229 INFO:teuthology.orchestra.run.smithi112.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.3.0-4775-g7f24e589-1jammy [178 kB] 2024-09-14T08:36:36.318 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T08:36:36.345 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T08:36:36.356 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T08:36:36.371 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T08:36:36.385 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T08:36:36.406 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T08:36:36.738 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T08:36:36.742 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T08:36:36.765 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T08:36:36.768 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T08:36:36.797 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 251 MB in 12s (21.8 MB/s) 2024-09-14T08:36:36.805 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:36:36.809 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T08:36:36.958 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T08:36:37.019 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T08:36:37.024 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T08:36:37.123 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T08:36:37.167 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T08:36:37.193 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T08:36:37.225 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:36:37.254 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T08:36:37.281 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T08:36:37.329 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:36:37.427 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T08:36:37.453 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T08:36:37.493 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T08:36:37.570 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T08:36:37.596 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T08:36:37.636 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:36:37.657 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T08:36:37.684 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T08:36:37.715 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:36:37.813 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T08:36:37.839 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T08:36:37.879 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T08:36:38.023 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T08:36:38.049 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T08:36:38.052 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T08:36:38.078 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T08:36:38.089 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T08:36:38.119 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:36:38.316 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T08:36:38.343 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T08:36:38.359 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librados2. 2024-09-14T08:36:38.374 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../007-librados2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:38.391 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:36:38.409 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librados2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:38.464 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T08:36:38.490 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T08:36:38.530 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T08:36:38.778 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T08:36:38.800 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T08:36:38.825 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librados2. 2024-09-14T08:36:38.836 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:36:38.851 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../007-librados2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:38.883 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librados2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:38.887 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libnbd0. 2024-09-14T08:36:38.913 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T08:36:38.953 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T08:36:39.164 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T08:36:39.191 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T08:36:39.206 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librbd1. 2024-09-14T08:36:39.221 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../009-librbd1_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:39.230 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:36:39.256 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librbd1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:39.361 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libnbd0. 2024-09-14T08:36:39.387 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T08:36:39.427 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T08:36:39.576 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T08:36:39.602 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T08:36:39.642 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T08:36:39.705 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librbd1. 2024-09-14T08:36:39.709 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T08:36:39.731 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../009-librbd1_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:39.735 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:39.764 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librbd1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:39.776 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libcephfs2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:39.937 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librados2. 2024-09-14T08:36:39.963 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../007-librados2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librados2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:40.062 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rados. 2024-09-14T08:36:40.084 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:40.128 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rados (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:40.225 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T08:36:40.251 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:40.308 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:40.440 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T08:36:40.456 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libnbd0. 2024-09-14T08:36:40.466 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:36:40.482 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T08:36:40.498 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-ceph-argparse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:40.523 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T08:36:40.586 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rados. 2024-09-14T08:36:40.612 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:40.652 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rados (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:40.717 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T08:36:40.733 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:40.775 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cephfs (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:40.859 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librbd1. 2024-09-14T08:36:40.886 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../009-librbd1_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:40.926 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librbd1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:41.005 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T08:36:41.031 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:36:41.072 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-argparse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:41.300 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T08:36:41.314 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:41.328 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T08:36:41.349 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cephfs (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:41.355 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:36:41.362 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T08:36:41.389 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:41.394 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:41.428 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:41.660 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T08:36:41.686 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:36:41.723 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T08:36:41.727 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:41.750 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T08:36:41.789 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T08:36:41.848 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rados. 2024-09-14T08:36:41.874 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:41.906 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rados (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:42.049 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T08:36:42.075 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T08:36:42.084 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T08:36:42.111 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T08:36:42.115 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T08:36:42.142 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T08:36:42.226 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T08:36:42.252 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:36:42.292 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-argparse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:42.378 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T08:36:42.393 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:42.401 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T08:36:42.428 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T08:36:42.436 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:42.460 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T08:36:42.545 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T08:36:42.571 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:42.611 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cephfs (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:42.695 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T08:36:42.711 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:42.754 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:42.790 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T08:36:42.816 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T08:36:42.856 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T08:36:42.922 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T08:36:42.948 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:36:42.989 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:43.099 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T08:36:43.125 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T08:36:43.134 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T08:36:43.160 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T08:36:43.165 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T08:36:43.200 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T08:36:43.292 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T08:36:43.318 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T08:36:43.352 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T08:36:43.443 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T08:36:43.458 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T08:36:43.501 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T08:36:43.511 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T08:36:43.527 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T08:36:43.561 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T08:36:43.653 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T08:36:43.679 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T08:36:43.753 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T08:36:43.829 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T08:36:43.844 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T08:36:43.895 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T08:36:43.907 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua5.1. 2024-09-14T08:36:43.933 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T08:36:43.965 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T08:36:44.014 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T08:36:44.040 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:44.080 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:44.199 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua5.1. 2024-09-14T08:36:44.225 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T08:36:44.266 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T08:36:44.293 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-any. 2024-09-14T08:36:44.308 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T08:36:44.351 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T08:36:44.425 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T08:36:44.438 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T08:36:44.475 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T08:36:44.552 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua-any. 2024-09-14T08:36:44.567 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T08:36:44.595 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package zip. 2024-09-14T08:36:44.610 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T08:36:44.611 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T08:36:44.654 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T08:36:44.761 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T08:36:44.776 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T08:36:44.819 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T08:36:44.854 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package zip. 2024-09-14T08:36:44.870 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T08:36:44.904 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T08:36:44.974 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package unzip. 2024-09-14T08:36:45.001 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T08:36:45.040 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T08:36:45.130 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T08:36:45.156 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T08:36:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T08:36:45.394 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package luarocks. 2024-09-14T08:36:45.420 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T08:36:45.433 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package unzip. 2024-09-14T08:36:45.459 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T08:36:45.461 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T08:36:45.484 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua5.1. 2024-09-14T08:36:45.499 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T08:36:45.510 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T08:36:45.542 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T08:36:45.845 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-any. 2024-09-14T08:36:45.845 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librgw2. 2024-09-14T08:36:45.870 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package luarocks. 2024-09-14T08:36:45.871 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T08:36:45.872 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../026-librgw2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:45.896 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T08:36:45.911 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T08:36:45.912 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librgw2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:45.936 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T08:36:46.164 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package zip. 2024-09-14T08:36:46.190 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T08:36:46.231 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T08:36:46.261 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librgw2. 2024-09-14T08:36:46.275 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../026-librgw2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:46.319 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librgw2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:46.517 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package unzip. 2024-09-14T08:36:46.540 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T08:36:46.544 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T08:36:46.556 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:46.576 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T08:36:46.598 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:46.918 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T08:36:46.930 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T08:36:46.945 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T08:36:46.956 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:46.962 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package luarocks. 2024-09-14T08:36:46.984 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T08:36:46.989 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T08:36:46.996 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:47.029 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T08:36:47.296 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T08:36:47.322 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:47.333 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T08:36:47.359 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T08:36:47.362 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libradosstriper1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:47.399 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T08:36:47.420 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librgw2. 2024-09-14T08:36:47.447 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../026-librgw2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:47.487 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librgw2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:47.686 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T08:36:47.712 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:47.752 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libradosstriper1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:47.766 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-common. 2024-09-14T08:36:47.792 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:47.832 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:48.073 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T08:36:48.088 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:48.122 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:48.155 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-common. 2024-09-14T08:36:48.182 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:48.222 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:48.467 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T08:36:48.494 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T08:36:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T08:36:48.845 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T08:36:48.871 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:48.912 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libradosstriper1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:49.307 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-common. 2024-09-14T08:36:49.333 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:49.362 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-base. 2024-09-14T08:36:49.365 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:49.389 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:49.438 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-base (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:49.736 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-base. 2024-09-14T08:36:49.762 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:49.812 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-base (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:50.059 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T08:36:50.086 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T08:36:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T08:36:50.365 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T08:36:50.387 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T08:36:50.391 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T08:36:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T08:36:50.431 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T08:36:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T08:36:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T08:36:50.735 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T08:36:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T08:36:50.772 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T08:36:50.778 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-base. 2024-09-14T08:36:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T08:36:50.805 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:36:50.839 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T08:36:50.855 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-base (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:36:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T08:36:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T08:36:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T08:36:51.142 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T08:36:51.169 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T08:36:51.209 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T08:36:51.390 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T08:36:51.407 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T08:36:51.416 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T08:36:51.434 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T08:36:51.456 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T08:36:51.483 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T08:36:51.678 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T08:36:51.705 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T08:36:51.736 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T08:36:51.785 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T08:36:51.785 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T08:36:51.811 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T08:36:51.812 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T08:36:51.851 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T08:36:51.852 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T08:36:52.006 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T08:36:52.033 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T08:36:52.072 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T08:36:52.137 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T08:36:52.164 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T08:36:52.195 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T08:36:52.342 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-portend. 2024-09-14T08:36:52.363 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T08:36:52.369 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T08:36:52.389 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T08:36:52.400 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T08:36:52.430 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T08:36:52.473 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-portend. 2024-09-14T08:36:52.500 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T08:36:52.540 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T08:36:52.703 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T08:36:52.731 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T08:36:52.791 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T08:36:52.795 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T08:36:52.818 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T08:36:52.851 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T08:36:52.858 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T08:36:52.878 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T08:36:52.918 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T08:36:53.098 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T08:36:53.125 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T08:36:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T08:36:53.173 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T08:36:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T08:36:53.221 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T08:36:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T08:36:53.247 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T08:36:53.287 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T08:36:53.502 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T08:36:53.529 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T08:36:53.530 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T08:36:53.556 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T08:36:53.568 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T08:36:53.596 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T08:36:53.658 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T08:36:53.684 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T08:36:53.724 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T08:36:53.899 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-portend. 2024-09-14T08:36:53.901 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T08:36:53.926 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T08:36:53.928 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T08:36:53.971 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T08:36:53.974 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T08:36:54.035 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T08:36:54.062 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T08:36:54.102 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T08:36:54.236 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T08:36:54.262 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T08:36:54.274 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T08:36:54.294 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T08:36:54.301 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T08:36:54.341 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T08:36:54.355 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T08:36:54.370 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T08:36:54.404 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T08:36:54.580 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T08:36:54.606 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T08:36:54.644 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-mako. 2024-09-14T08:36:54.646 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T08:36:54.670 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T08:36:54.699 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-mako. 2024-09-14T08:36:54.710 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T08:36:54.726 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T08:36:54.766 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T08:36:54.992 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T08:36:55.013 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T08:36:55.018 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T08:36:55.036 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T08:36:55.058 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T08:36:55.080 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T08:36:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T08:36:55.129 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T08:36:55.169 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T08:36:55.370 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T08:36:55.396 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T08:36:55.436 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T08:36:55.441 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T08:36:55.468 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T08:36:55.497 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T08:36:55.516 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T08:36:55.523 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T08:36:55.563 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T08:36:55.672 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T08:36:55.687 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T08:36:55.730 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T08:36:55.850 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webob. 2024-09-14T08:36:55.865 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T08:36:55.899 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T08:36:56.178 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T08:36:56.204 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T08:36:56.239 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T08:36:56.530 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T08:36:56.557 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T08:36:56.597 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T08:36:56.653 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-webob. 2024-09-14T08:36:56.680 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T08:36:56.719 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T08:36:56.775 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-mako. 2024-09-14T08:36:56.802 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T08:36:56.842 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T08:36:56.908 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-paste. 2024-09-14T08:36:56.935 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T08:36:56.977 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T08:36:57.064 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T08:36:57.090 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T08:36:57.134 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T08:36:57.154 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T08:36:57.180 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T08:36:57.220 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T08:36:57.286 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T08:36:57.302 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T08:36:57.336 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T08:36:57.451 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T08:36:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T08:36:57.517 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T08:36:57.523 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T08:36:57.549 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T08:36:57.590 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T08:36:57.614 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T08:36:57.629 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T08:36:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T08:36:57.820 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-paste. 2024-09-14T08:36:57.847 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T08:36:57.876 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webob. 2024-09-14T08:36:57.886 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T08:36:57.902 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T08:36:57.942 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T08:36:58.174 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T08:36:58.189 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T08:36:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T08:36:58.295 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T08:36:58.322 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T08:36:58.366 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T08:36:58.520 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T08:36:58.545 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T08:36:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T08:36:58.673 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T08:36:58.700 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T08:36:58.740 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T08:36:58.826 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T08:36:58.852 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T08:36:58.887 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T08:36:58.892 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T08:36:58.914 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T08:36:58.954 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T08:36:59.051 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-paste. 2024-09-14T08:36:59.078 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T08:36:59.118 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T08:36:59.162 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T08:36:59.188 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T08:36:59.245 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T08:36:59.265 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T08:36:59.292 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T08:36:59.331 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T08:36:59.437 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T08:36:59.453 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T08:36:59.496 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T08:36:59.558 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T08:36:59.585 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T08:36:59.616 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T08:36:59.678 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T08:36:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T08:36:59.745 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T08:36:59.798 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T08:36:59.825 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T08:36:59.865 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T08:36:59.936 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-idna. 2024-09-14T08:36:59.962 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T08:37:00.002 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T08:37:00.106 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-idna. 2024-09-14T08:37:00.133 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T08:37:00.152 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T08:37:00.178 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T08:37:00.181 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T08:37:00.210 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T08:37:00.280 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T08:37:00.307 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T08:37:00.346 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T08:37:00.454 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T08:37:00.469 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T08:37:00.512 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T08:37:00.559 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T08:37:00.586 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T08:37:00.634 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T08:37:00.658 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-requests. 2024-09-14T08:37:00.685 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T08:37:00.725 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T08:37:00.834 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T08:37:00.861 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T08:37:00.901 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T08:37:01.021 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-requests. 2024-09-14T08:37:01.037 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T08:37:01.047 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T08:37:01.063 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T08:37:01.095 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T08:37:01.103 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T08:37:01.220 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-idna. 2024-09-14T08:37:01.247 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T08:37:01.287 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T08:37:01.381 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T08:37:01.404 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:01.439 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:01.440 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T08:37:01.467 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T08:37:01.507 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T08:37:01.606 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T08:37:01.633 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T08:37:01.673 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T08:37:01.801 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T08:37:01.817 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:01.819 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T08:37:01.846 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:01.886 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:02.001 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests. 2024-09-14T08:37:02.002 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:02.028 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T08:37:02.068 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T08:37:02.197 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T08:37:02.223 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T08:37:02.263 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T08:37:02.371 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T08:37:02.390 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T08:37:02.398 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T08:37:02.417 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:02.457 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:02.550 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T08:37:02.576 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T08:37:02.608 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T08:37:02.637 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T08:37:02.726 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T08:37:02.749 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T08:37:02.784 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T08:37:02.911 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T08:37:02.924 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T08:37:02.937 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:02.951 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:02.977 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:02.990 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:03.079 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T08:37:03.105 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T08:37:03.145 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T08:37:03.370 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T08:37:03.397 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:03.414 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T08:37:03.437 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:03.441 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:03.480 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mon (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:03.490 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T08:37:03.517 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:03.557 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:03.748 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T08:37:03.775 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T08:37:03.814 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T08:37:03.952 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T08:37:03.978 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:04.009 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mon (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:04.043 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T08:37:04.070 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:04.109 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-osd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:04.117 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T08:37:04.144 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T08:37:04.184 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T08:37:04.487 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T08:37:04.514 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:04.553 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:04.605 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T08:37:04.632 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:04.671 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-osd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:04.906 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T08:37:04.921 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:04.956 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mon (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:05.237 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph. 2024-09-14T08:37:05.252 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../067-ceph_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:05.295 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:05.615 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T08:37:05.641 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:05.652 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T08:37:05.679 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:05.681 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:05.718 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-osd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:05.749 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph. 2024-09-14T08:37:05.765 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../067-ceph_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:05.808 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:06.059 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T08:37:06.086 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:06.094 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T08:37:06.121 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:06.126 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mds (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:06.160 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:06.479 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephadm. 2024-09-14T08:37:06.497 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T08:37:06.505 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../070-cephadm_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:06.523 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:06.545 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:06.563 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mds (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:06.788 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph. 2024-09-14T08:37:06.815 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../067-ceph_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:06.854 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:06.856 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T08:37:06.883 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T08:37:06.948 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T08:37:06.992 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package cephadm. 2024-09-14T08:37:07.018 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../070-cephadm_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:07.058 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:07.174 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T08:37:07.201 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:07.240 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:07.242 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T08:37:07.258 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T08:37:07.301 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:07.361 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T08:37:07.388 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T08:37:07.427 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T08:37:07.602 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T08:37:07.629 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:07.668 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mds (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:07.763 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T08:37:07.790 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T08:37:07.830 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:08.046 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephadm. 2024-09-14T08:37:08.073 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../070-cephadm_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:08.113 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:08.297 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-babel. 2024-09-14T08:37:08.324 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T08:37:08.364 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:08.424 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T08:37:08.451 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T08:37:08.490 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T08:37:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T08:37:08.727 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T08:37:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T08:37:08.793 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T08:37:08.821 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T08:37:08.860 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:08.861 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-babel. 2024-09-14T08:37:08.887 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T08:37:08.926 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:09.120 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T08:37:09.148 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:09.186 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:09.221 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T08:37:09.236 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T08:37:09.271 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T08:37:09.507 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T08:37:09.533 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T08:37:09.573 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T08:37:09.599 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T08:37:09.627 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:09.666 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:09.823 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-babel. 2024-09-14T08:37:09.851 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T08:37:09.884 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-routes. 2024-09-14T08:37:09.889 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:09.911 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T08:37:09.951 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T08:37:10.003 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T08:37:10.030 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T08:37:10.069 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T08:37:10.218 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T08:37:10.245 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T08:37:10.287 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T08:37:10.292 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T08:37:10.314 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:10.353 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:10.355 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-routes. 2024-09-14T08:37:10.382 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T08:37:10.421 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T08:37:10.654 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T08:37:10.681 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:10.720 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:10.800 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T08:37:10.828 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:10.866 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:11.057 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T08:37:11.084 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T08:37:11.123 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T08:37:11.410 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-routes. 2024-09-14T08:37:11.425 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T08:37:11.459 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T08:37:11.813 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T08:37:11.840 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:11.896 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:13.475 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T08:37:13.492 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T08:37:13.533 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T08:37:13.613 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T08:37:13.630 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T08:37:13.680 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T08:37:13.962 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T08:37:13.989 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T08:37:14.020 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T08:37:14.217 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T08:37:14.244 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T08:37:14.292 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T08:37:14.340 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T08:37:14.356 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T08:37:14.390 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T08:37:14.679 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T08:37:14.706 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T08:37:14.726 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T08:37:14.745 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T08:37:14.754 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T08:37:14.845 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T08:37:14.874 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T08:37:14.878 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T08:37:14.911 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T08:37:15.006 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T08:37:15.034 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T08:37:15.158 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T08:37:15.390 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T08:37:15.417 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T08:37:15.456 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T08:37:15.530 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T08:37:15.558 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:15.588 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:15.818 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T08:37:15.845 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T08:37:15.884 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T08:37:15.926 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T08:37:15.954 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:16.001 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:16.162 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T08:37:16.190 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T08:37:16.306 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T08:37:16.566 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T08:37:16.593 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T08:37:16.632 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T08:37:16.974 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T08:37:16.979 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T08:37:17.002 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:17.007 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T08:37:17.045 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T08:37:17.127 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T08:37:17.132 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:17.155 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T08:37:17.193 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T08:37:17.514 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T08:37:17.541 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T08:37:17.580 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T08:37:17.599 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T08:37:17.627 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T08:37:17.665 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T08:37:17.900 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T08:37:17.928 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T08:37:17.975 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T08:37:18.002 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T08:37:18.030 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T08:37:18.068 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T08:37:18.168 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T08:37:18.196 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T08:37:18.226 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T08:37:18.237 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T08:37:18.265 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T08:37:18.303 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T08:37:18.380 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T08:37:18.408 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T08:37:18.446 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T08:37:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T08:37:18.565 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T08:37:18.604 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T08:37:18.632 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T08:37:18.660 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T08:37:18.698 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T08:37:18.759 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T08:37:18.787 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T08:37:18.825 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T08:37:18.941 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T08:37:18.969 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T08:37:19.007 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T08:37:19.010 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T08:37:19.038 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T08:37:19.076 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T08:37:19.154 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T08:37:19.181 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T08:37:19.220 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T08:37:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T08:37:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T08:37:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T08:37:19.388 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T08:37:19.415 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T08:37:19.454 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T08:37:19.540 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T08:37:19.568 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T08:37:19.607 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T08:37:19.689 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T08:37:19.717 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T08:37:19.756 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T08:37:19.927 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T08:37:19.954 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T08:37:19.993 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T08:37:20.084 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T08:37:20.093 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T08:37:20.112 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T08:37:20.122 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T08:37:20.151 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:20.446 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T08:37:20.471 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T08:37:20.473 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T08:37:20.498 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T08:37:20.512 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T08:37:20.537 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T08:37:20.657 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T08:37:20.673 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:20.715 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:20.840 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T08:37:20.849 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T08:37:20.868 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T08:37:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T08:37:20.906 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T08:37:20.915 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T08:37:21.027 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T08:37:21.054 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T08:37:21.093 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T08:37:21.145 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package jq. 2024-09-14T08:37:21.161 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T08:37:21.195 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T08:37:21.421 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T08:37:21.439 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package socat. 2024-09-14T08:37:21.449 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T08:37:21.455 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T08:37:21.487 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T08:37:21.497 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T08:37:21.620 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T08:37:21.637 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:21.679 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:21.740 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package jq. 2024-09-14T08:37:21.757 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T08:37:21.799 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T08:37:21.801 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T08:37:21.829 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T08:37:21.867 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T08:37:21.973 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T08:37:22.001 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T08:37:22.035 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package socat. 2024-09-14T08:37:22.039 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T08:37:22.051 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T08:37:22.084 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T08:37:22.213 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-test. 2024-09-14T08:37:22.229 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:22.305 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-test (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:22.351 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T08:37:22.379 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T08:37:22.379 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T08:37:22.396 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T08:37:22.409 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T08:37:22.429 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T08:37:22.687 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package jq. 2024-09-14T08:37:22.703 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T08:37:22.745 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T08:37:22.792 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-test. 2024-09-14T08:37:22.808 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:22.850 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-test (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:22.981 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package socat. 2024-09-14T08:37:22.998 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T08:37:23.039 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T08:37:23.343 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T08:37:23.359 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T08:37:23.401 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T08:37:23.755 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-test. 2024-09-14T08:37:23.771 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:23.813 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-test (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:24.809 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T08:37:24.837 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:24.875 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-volume (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:25.146 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T08:37:25.162 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:25.196 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs-dev (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:25.338 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T08:37:25.365 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:25.404 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-volume (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:25.490 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T08:37:25.518 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T08:37:25.557 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T08:37:25.716 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T08:37:25.733 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:25.775 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libcephfs-dev (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:25.878 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T08:37:25.906 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T08:37:25.936 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T08:37:26.103 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T08:37:26.130 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T08:37:26.169 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T08:37:26.293 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T08:37:26.321 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T08:37:26.324 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T08:37:26.352 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T08:37:26.360 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-volume (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:26.457 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T08:37:26.485 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T08:37:26.515 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T08:37:26.607 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T08:37:26.672 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T08:37:26.700 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:26.738 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs-dev (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:26.894 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T08:37:26.922 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T08:37:26.961 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T08:37:26.996 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package pkg-config. 2024-09-14T08:37:27.024 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T08:37:27.058 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T08:37:27.062 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T08:37:27.086 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T08:37:27.124 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T08:37:27.323 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T08:37:27.339 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T08:37:27.360 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package pkg-config. 2024-09-14T08:37:27.384 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T08:37:27.388 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T08:37:27.426 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T08:37:27.479 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T08:37:27.507 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T08:37:27.545 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T08:37:27.654 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T08:37:27.670 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T08:37:27.712 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T08:37:27.810 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T08:37:27.838 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T08:37:27.876 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T08:37:27.916 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T08:37:27.944 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T08:37:27.982 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T08:37:28.146 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T08:37:28.148 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T08:37:28.173 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T08:37:28.176 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T08:37:28.203 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T08:37:28.214 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T08:37:28.422 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pkg-config. 2024-09-14T08:37:28.449 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T08:37:28.488 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T08:37:28.507 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T08:37:28.526 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T08:37:28.535 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T08:37:28.554 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T08:37:28.573 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T08:37:28.592 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T08:37:28.749 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T08:37:28.777 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T08:37:28.815 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T08:37:28.885 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T08:37:28.896 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T08:37:28.913 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T08:37:28.924 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T08:37:28.951 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T08:37:28.954 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T08:37:29.227 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T08:37:29.248 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T08:37:29.255 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T08:37:29.276 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T08:37:29.279 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-py. 2024-09-14T08:37:29.293 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T08:37:29.307 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T08:37:29.314 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T08:37:29.345 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T08:37:29.580 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T08:37:29.608 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T08:37:29.646 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T08:37:29.666 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T08:37:29.668 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-py. 2024-09-14T08:37:29.694 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T08:37:29.696 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T08:37:29.732 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T08:37:29.734 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T08:37:29.925 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T08:37:29.953 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T08:37:29.983 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T08:37:30.054 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T08:37:30.083 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T08:37:30.121 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T08:37:30.212 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T08:37:30.240 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T08:37:30.278 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T08:37:30.302 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T08:37:30.329 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T08:37:30.377 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T08:37:30.550 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T08:37:30.578 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T08:37:30.581 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-toml. 2024-09-14T08:37:30.609 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T08:37:30.616 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T08:37:30.647 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T08:37:30.714 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-py. 2024-09-14T08:37:30.741 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T08:37:30.780 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T08:37:30.919 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-toml. 2024-09-14T08:37:30.947 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T08:37:30.950 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T08:37:30.966 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T08:37:30.985 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T08:37:31.008 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T08:37:31.092 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T08:37:31.120 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T08:37:31.158 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T08:37:31.288 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T08:37:31.316 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T08:37:31.329 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T08:37:31.354 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T08:37:31.357 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T08:37:31.395 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T08:37:31.613 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T08:37:31.639 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T08:37:31.640 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T08:37:31.667 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T08:37:31.687 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T08:37:31.706 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T08:37:31.708 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T08:37:31.736 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T08:37:31.774 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T08:37:31.982 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-toml. 2024-09-14T08:37:32.010 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T08:37:32.044 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T08:37:32.048 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T08:37:32.072 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T08:37:32.110 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T08:37:32.351 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T08:37:32.380 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T08:37:32.418 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T08:37:32.452 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package radosgw. 2024-09-14T08:37:32.480 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../117-radosgw_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:32.518 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking radosgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:32.763 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T08:37:32.791 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T08:37:32.829 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T08:37:33.072 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package radosgw. 2024-09-14T08:37:33.101 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../117-radosgw_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:33.107 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T08:37:33.136 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T08:37:33.138 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking radosgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:33.174 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T08:37:33.421 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T08:37:33.437 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:33.479 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking rbd-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:33.699 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package rbd-nbd. 2024-09-14T08:37:33.727 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../119-rbd-nbd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:33.757 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking rbd-nbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:33.920 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package radosgw. 2024-09-14T08:37:33.948 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../117-radosgw_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:33.986 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking radosgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:33.991 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T08:37:34.008 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:34.041 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking rbd-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:34.078 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T08:37:34.294 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package rbd-nbd. 2024-09-14T08:37:34.322 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../119-rbd-nbd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:34.337 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T08:37:34.360 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking rbd-nbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:34.438 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T08:37:34.665 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T08:37:34.718 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T08:37:34.890 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T08:37:34.906 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:34.915 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T08:37:34.947 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking rbd-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:35.025 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T08:37:35.050 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T08:37:35.217 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package rbd-nbd. 2024-09-14T08:37:35.245 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../119-rbd-nbd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T08:37:35.267 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T08:37:35.283 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking rbd-nbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:35.485 INFO:teuthology.orchestra.run.smithi089.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T08:37:35.557 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:35.589 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T08:37:35.610 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T08:37:35.839 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T08:37:35.965 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T08:37:35.999 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user cephadm....done 2024-09-14T08:37:36.055 INFO:teuthology.orchestra.run.smithi188.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T08:37:36.118 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:36.129 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T08:37:36.229 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T08:37:36.406 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T08:37:36.543 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T08:37:36.626 INFO:teuthology.orchestra.run.smithi188.stdout:Adding system user cephadm....done 2024-09-14T08:37:36.648 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T08:37:36.758 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T08:37:36.799 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T08:37:36.958 INFO:teuthology.orchestra.run.smithi112.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T08:37:37.009 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T08:37:37.033 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:37.067 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T08:37:37.260 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T08:37:37.309 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T08:37:37.387 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T08:37:37.435 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T08:37:37.558 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user cephadm....done 2024-09-14T08:37:37.680 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T08:37:37.695 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T08:37:37.698 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T08:37:37.974 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T08:37:37.996 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T08:37:38.032 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T08:37:38.130 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T08:37:38.225 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T08:37:38.275 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T08:37:38.351 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T08:37:38.465 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T08:37:38.543 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T08:37:38.594 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T08:37:38.778 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T08:37:38.826 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T08:37:38.853 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T08:37:38.971 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T08:37:39.012 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T08:37:39.068 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T08:37:39.272 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T08:37:39.281 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T08:37:39.336 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T08:37:39.514 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-argparse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:39.579 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T08:37:39.659 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T08:37:39.766 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T08:37:39.831 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T08:37:39.866 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T08:37:39.918 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T08:37:40.090 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T08:37:40.126 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T08:37:40.252 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T08:37:40.336 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T08:37:40.341 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-ceph-argparse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:40.378 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T08:37:40.600 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T08:37:40.629 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T08:37:40.646 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T08:37:40.709 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T08:37:40.860 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T08:37:40.897 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T08:37:40.986 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T08:37:41.012 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T08:37:41.052 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T08:37:41.112 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T08:37:41.115 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T08:37:41.156 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T08:37:41.241 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T08:37:41.363 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T08:37:41.458 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-argparse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:41.618 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:41.717 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T08:37:41.744 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T08:37:41.792 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T08:37:41.827 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T08:37:41.843 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T08:37:41.891 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T08:37:41.969 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T08:37:42.017 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T08:37:42.095 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T08:37:42.221 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T08:37:42.257 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T08:37:42.368 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:42.472 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T08:37:42.494 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T08:37:42.571 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T08:37:42.856 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T08:37:42.954 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T08:37:42.956 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T08:37:42.988 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T08:37:43.037 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T08:37:43.101 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T08:37:43.210 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T08:37:43.221 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T08:37:43.523 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T08:37:43.553 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:43.633 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T08:37:43.648 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T08:37:43.679 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T08:37:43.893 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T08:37:43.955 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T08:37:44.027 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T08:37:44.153 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T08:37:44.215 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T08:37:44.300 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T08:37:44.463 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T08:37:44.533 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T08:37:44.534 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T08:37:44.659 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T08:37:44.660 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T08:37:44.786 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T08:37:44.839 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T08:37:45.065 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T08:37:45.104 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T08:37:45.335 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T08:37:45.425 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T08:37:45.480 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T08:37:45.587 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T08:37:45.709 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T08:37:45.713 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T08:37:45.739 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T08:37:45.839 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T08:37:46.053 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T08:37:46.116 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T08:37:46.165 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T08:37:46.304 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T08:37:46.392 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T08:37:46.413 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:46.558 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T08:37:46.706 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T08:37:46.718 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T08:37:46.836 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T08:37:46.961 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T08:37:47.007 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T08:37:47.070 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:47.211 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T08:37:47.372 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T08:37:47.495 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T08:37:47.706 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T08:37:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T08:37:48.107 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T08:37:48.180 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T08:37:48.233 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:48.390 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:37:48.499 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T08:37:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T08:37:48.767 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T08:37:48.885 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T08:37:48.893 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T08:37:48.953 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T08:37:49.044 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T08:37:49.213 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:37:49.320 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T08:37:49.348 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T08:37:49.572 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T08:37:49.607 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T08:37:49.708 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T08:37:49.797 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:37:49.809 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T08:37:49.924 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T08:37:50.066 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T08:37:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T08:37:50.217 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T08:37:50.318 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:37:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T08:37:50.452 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T08:37:50.476 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T08:37:50.587 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:37:50.703 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T08:37:50.713 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T08:37:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T08:37:50.829 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T08:37:50.931 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T08:37:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T08:37:51.015 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T08:37:51.215 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T08:37:51.221 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T08:37:51.266 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T08:37:51.466 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T08:37:51.472 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T08:37:51.516 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T08:37:51.598 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T08:37:51.717 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:37:51.751 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T08:37:51.843 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T08:37:51.874 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T08:37:51.994 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T08:37:52.000 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T08:37:52.145 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T08:37:52.253 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T08:37:52.285 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T08:37:52.379 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T08:37:52.396 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T08:37:52.586 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T08:37:52.663 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T08:37:52.672 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T08:37:52.793 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T08:37:52.829 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T08:37:52.940 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T08:37:52.946 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T08:37:53.082 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T08:37:53.106 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:53.196 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T08:37:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T08:37:53.367 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T08:37:53.433 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T08:37:53.459 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T08:37:53.559 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T08:37:53.585 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T08:37:53.601 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T08:37:53.727 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T08:37:53.853 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:53.869 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T08:37:53.942 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T08:37:53.943 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T08:37:53.995 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T08:37:54.188 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T08:37:54.211 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T08:37:54.297 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T08:37:54.314 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T08:37:54.337 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T08:37:54.590 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T08:37:54.596 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:37:54.698 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T08:37:54.722 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T08:37:54.841 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T08:37:54.941 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T08:37:54.967 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T08:37:55.042 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T08:37:55.049 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T08:37:55.093 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T08:37:55.206 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T08:37:55.284 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:37:55.358 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T08:37:55.402 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T08:37:55.444 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T08:37:55.570 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T08:37:55.642 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T08:37:55.712 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T08:37:55.752 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T08:37:55.964 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T08:37:56.020 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T08:37:56.021 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T08:37:56.215 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T08:37:56.289 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T08:37:56.340 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T08:37:56.341 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T08:37:56.406 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T08:37:56.592 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T08:37:56.599 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T08:37:56.666 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T08:37:56.726 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T08:37:56.976 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T08:37:57.027 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T08:37:57.052 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T08:37:57.244 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T08:37:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T08:37:57.362 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T08:37:57.555 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T08:37:57.647 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T08:37:57.697 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T08:37:57.773 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T08:37:57.889 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librados2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T08:37:58.016 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:58.040 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T08:37:58.142 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T08:37:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T08:37:58.394 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T08:37:58.452 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librados2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:58.461 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:58.577 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:58.587 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libradosstriper1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:58.662 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T08:37:58.722 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T08:37:58.728 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T08:37:58.998 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librbd1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.039 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T08:37:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libcephfs2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.124 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-modules-core (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.166 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libradosstriper1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.251 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.267 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T08:37:59.323 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T08:37:59.460 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T08:37:59.460 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T08:37:59.543 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librbd1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-modules-core (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.659 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T08:37:59.778 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.785 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librados2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.911 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.943 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs-dev (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:37:59.993 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T08:37:59.993 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T08:38:00.037 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T08:38:00.053 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rados (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:00.179 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librgw2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:00.305 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T08:38:00.384 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:00.505 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libcephfs-dev (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:00.518 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libradosstriper1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:00.631 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rados (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:00.644 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T08:38:00.740 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librgw2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:00.849 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T08:38:00.913 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librbd1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:01.030 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-modules-core (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:01.156 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:01.368 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T08:38:01.369 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T08:38:01.450 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:01.560 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up rbd-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:01.694 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up rbd-nbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:01.812 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:01.833 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs-dev (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:01.938 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cephfs (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:01.959 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rados (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:01.977 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:02.064 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:02.085 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librgw2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:02.103 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up rbd-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:02.211 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T08:38:02.238 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up rbd-nbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:02.364 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:02.490 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cephfs (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:02.573 INFO:teuthology.orchestra.run.smithi089.stdout:Adding group ceph....done 2024-09-14T08:38:02.607 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:02.908 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user ceph....done 2024-09-14T08:38:03.067 INFO:teuthology.orchestra.run.smithi188.stdout:Adding group ceph....done 2024-09-14T08:38:03.069 INFO:teuthology.orchestra.run.smithi089.stdout:Setting system user ceph properties....done 2024-09-14T08:38:03.084 INFO:teuthology.orchestra.run.smithi089.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T08:38:03.220 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T08:38:03.410 INFO:teuthology.orchestra.run.smithi188.stdout:Adding system user ceph....done 2024-09-14T08:38:03.456 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:03.536 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T08:38:03.582 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up rbd-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:03.586 INFO:teuthology.orchestra.run.smithi188.stdout:Setting system user ceph properties....done 2024-09-14T08:38:03.601 INFO:teuthology.orchestra.run.smithi188.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T08:38:03.709 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up rbd-nbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:03.740 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T08:38:03.835 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:03.961 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cephfs (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:03.998 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-test (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:04.087 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:04.088 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T08:38:04.124 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up radosgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:04.572 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-test (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:04.585 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T08:38:04.585 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T08:38:04.629 INFO:teuthology.orchestra.run.smithi112.stdout:Adding group ceph....done 2024-09-14T08:38:04.676 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up radosgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:05.006 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user ceph....done 2024-09-14T08:38:05.085 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-base (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:05.132 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T08:38:05.132 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T08:38:05.148 INFO:teuthology.orchestra.run.smithi112.stdout:Setting system user ceph properties....done 2024-09-14T08:38:05.177 INFO:teuthology.orchestra.run.smithi112.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T08:38:05.315 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T08:38:05.417 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T08:38:05.603 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T08:38:05.636 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-base (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:05.911 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mds (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:06.027 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T08:38:06.055 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-test (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:06.136 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T08:38:06.136 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T08:38:06.172 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up radosgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:06.572 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mds (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:06.613 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:06.629 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T08:38:06.629 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T08:38:06.804 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T08:38:06.804 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T08:38:06.829 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T08:38:06.829 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T08:38:07.075 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-base (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:07.290 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:07.306 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-osd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:07.404 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T08:38:07.494 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T08:38:07.494 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T08:38:07.575 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T08:38:07.575 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T08:38:07.860 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mds (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:07.983 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-osd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:08.072 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T08:38:08.073 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T08:38:08.091 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:08.209 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:08.256 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T08:38:08.256 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T08:38:08.377 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mon (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:08.536 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:08.581 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T08:38:08.581 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T08:38:08.693 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:08.751 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T08:38:08.752 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T08:38:08.819 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:08.970 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mon (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:09.079 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:09.192 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T08:38:09.193 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T08:38:09.196 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-osd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:09.229 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:09.356 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-dashboard (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:09.467 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T08:38:09.467 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T08:38:09.507 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-volume (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:09.700 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:09.843 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:09.868 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T08:38:09.923 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:09.969 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-dashboard (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:09.985 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T08:38:10.058 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:10.120 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-volume (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:10.129 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T08:38:10.208 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mon (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:10.422 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T08:38:10.422 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T08:38:10.490 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T08:38:10.607 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T08:38:10.776 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T08:38:11.093 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:11.222 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T08:38:11.245 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:11.371 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-dashboard (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:11.513 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-volume (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T08:38:11.851 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T08:38:11.863 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T08:38:11.870 DEBUG:teuthology.parallel:result is None 2024-09-14T08:38:11.935 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T08:38:11.959 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T08:38:12.120 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T08:38:12.614 INFO:teuthology.orchestra.run.smithi188.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T08:38:12.618 DEBUG:teuthology.parallel:result is None 2024-09-14T08:38:13.196 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T08:38:13.885 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T08:38:13.890 DEBUG:teuthology.parallel:result is None 2024-09-14T08:38:13.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T08:38:14.030 DEBUG:teuthology.orchestra.run.smithi089:> dpkg-query -W -f '${Version}' ceph 2024-09-14T08:38:14.049 INFO:teuthology.orchestra.run.smithi089.stdout:19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:38:14.050 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:38:14.050 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775-g7f24e589-1jammy is installed. 2024-09-14T08:38:14.052 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T08:38:14.195 DEBUG:teuthology.orchestra.run.smithi112:> dpkg-query -W -f '${Version}' ceph 2024-09-14T08:38:14.214 INFO:teuthology.orchestra.run.smithi112.stdout:19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:38:14.215 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:38:14.215 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775-g7f24e589-1jammy is installed. 2024-09-14T08:38:14.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T08:38:14.354 DEBUG:teuthology.orchestra.run.smithi188:> dpkg-query -W -f '${Version}' ceph 2024-09-14T08:38:14.373 INFO:teuthology.orchestra.run.smithi188.stdout:19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:38:14.373 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775-g7f24e589-1jammy 2024-09-14T08:38:14.373 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775-g7f24e589-1jammy is installed. 2024-09-14T08:38:14.375 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T08:38:14.375 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:14.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T08:38:14.390 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:14.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T08:38:14.405 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-14T08:38:14.405 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T08:38:14.434 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T08:38:14.434 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:14.434 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T08:38:14.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T08:38:14.502 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:14.502 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T08:38:14.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T08:38:14.569 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-14T08:38:14.569 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T08:38:14.582 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T08:38:14.635 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T08:38:14.636 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:14.636 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T08:38:14.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T08:38:14.706 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:14.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T08:38:14.718 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T08:38:14.771 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-14T08:38:14.772 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T08:38:14.785 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T08:38:14.843 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T08:38:14.844 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:14.844 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T08:38:14.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T08:38:14.910 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:14.910 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T08:38:14.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T08:38:14.976 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-14T08:38:14.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T08:38:14.989 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T08:38:15.044 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T08:38:15.121 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T08:38:15.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2024-09-14T08:38:15.123 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-09-14T08:38:15.126 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2024-09-14T08:38:15.139 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T08:38:15.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T08:38:15.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T08:38:15.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T08:38:15.194 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T08:38:15.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T08:38:15.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T08:38:15.233 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T08:38:15.256 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T08:38:15.256 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T08:38:15.256 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500', 'branch': 'main', 'description': 'rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900500', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5'], ['client.0']], 'seed': 5839, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'sleep_before_teardown': 0, 'subset': '99/128', 'suite': 'rbd', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'targets': {'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwc19mbHzq60PogVajK1w8PXvNGXuJgzxCEVZnED2GkveV7GX4R9EwwFmPxcGIeIc9kNyMsfXCCMYTqY8viW0c=', 'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzI5J0xztUrmtyyZ/IU2+5MZ3QtSYqK+ojUk+Dl3ooQSggLB1RHyKZW7qrNJEYSi7Sd/6MNbjGVeJlVY5/5UZc=', 'smithi188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ8HVYQC/YbMRsQSfgwRk3AgwG3yUhh1Rb/Ez4QIBrcbK+mI6dx/WaOHQR1Bje7dqa88VzAFJTJZwfq4db3yQ4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'holebdy': 512, 'nbd': True, 'ops': 6000, 'punch_holes': True, 'readbdy': 512, 'truncbdy': 512, 'writebdy': 512}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_20:16:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T08:38:15.257 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T08:38:15.284 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T08:38:15.286 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T08:38:15.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T08:38:15.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T08:38:15.334 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T08:38:15.348 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:15.348 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T08:38:15.391 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T08:38:15.391 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-09-14T08:38:15.439 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T08:38:15.440 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T08:38:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-09-14T08:38:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T08:38:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-14 08:32:44.295756954 +0000 2024-09-14T08:38:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-14 08:32:44.291756990 +0000 2024-09-14T08:38:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-14 08:32:44.291756990 +0000 2024-09-14T08:38:15.440 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-09-14T08:38:15.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T08:38:15.493 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-14T08:38:15.493 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-14T08:38:15.493 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000439489 s, 1.2 MB/s 2024-09-14T08:38:15.494 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T08:38:15.544 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-09-14T08:38:15.591 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T08:38:15.591 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T08:38:15.591 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-09-14T08:38:15.591 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T08:38:15.591 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-14 08:32:45.007750595 +0000 2024-09-14T08:38:15.591 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-14 08:32:44.763752774 +0000 2024-09-14T08:38:15.591 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-14 08:32:44.763752774 +0000 2024-09-14T08:38:15.592 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-09-14T08:38:15.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T08:38:15.649 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-14T08:38:15.649 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-14T08:38:15.649 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000327484 s, 1.6 MB/s 2024-09-14T08:38:15.650 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T08:38:15.700 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-09-14T08:38:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T08:38:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T08:38:15.747 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-09-14T08:38:15.747 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T08:38:15.747 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-14 08:32:45.471746450 +0000 2024-09-14T08:38:15.747 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-14 08:32:45.235748558 +0000 2024-09-14T08:38:15.748 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-14 08:32:45.235748558 +0000 2024-09-14T08:38:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-09-14T08:38:15.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T08:38:15.801 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-14T08:38:15.801 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-14T08:38:15.801 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000317775 s, 1.6 MB/s 2024-09-14T08:38:15.802 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T08:38:15.848 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-09-14T08:38:15.895 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T08:38:15.895 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T08:38:15.895 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-09-14T08:38:15.896 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T08:38:15.896 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-14 08:32:45.963742056 +0000 2024-09-14T08:38:15.896 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-14 08:32:45.711744307 +0000 2024-09-14T08:38:15.896 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-14 08:32:45.711744307 +0000 2024-09-14T08:38:15.896 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-09-14T08:38:15.896 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T08:38:15.952 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-14T08:38:15.952 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-14T08:38:15.952 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000295349 s, 1.7 MB/s 2024-09-14T08:38:15.953 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T08:38:16.003 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T08:38:16.004 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:16.004 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T08:38:16.010 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T08:38:16.010 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-14T08:38:16.057 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T08:38:16.057 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T08:38:16.057 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-14T08:38:16.058 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T08:38:16.058 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-14 08:32:41.872232328 +0000 2024-09-14T08:38:16.058 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-14 08:32:41.620234568 +0000 2024-09-14T08:38:16.058 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-14 08:32:41.620234568 +0000 2024-09-14T08:38:16.058 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-14T08:38:16.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T08:38:16.111 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-14T08:38:16.112 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-14T08:38:16.112 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000455407 s, 1.1 MB/s 2024-09-14T08:38:16.113 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T08:38:16.162 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-14T08:38:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T08:38:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T08:38:16.209 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-14T08:38:16.209 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T08:38:16.209 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-14 08:32:42.348228097 +0000 2024-09-14T08:38:16.209 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-14 08:32:42.104230266 +0000 2024-09-14T08:38:16.209 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-14 08:32:42.104230266 +0000 2024-09-14T08:38:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-14T08:38:16.210 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T08:38:16.263 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-14T08:38:16.263 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-14T08:38:16.263 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000427684 s, 1.2 MB/s 2024-09-14T08:38:16.264 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T08:38:16.314 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-14T08:38:16.361 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T08:38:16.361 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T08:38:16.361 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-14T08:38:16.361 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T08:38:16.361 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-14 08:32:42.828223830 +0000 2024-09-14T08:38:16.361 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-14 08:32:42.572226106 +0000 2024-09-14T08:38:16.361 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-14 08:32:42.572226106 +0000 2024-09-14T08:38:16.361 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-14T08:38:16.361 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T08:38:16.416 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-14T08:38:16.416 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-14T08:38:16.416 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000445258 s, 1.1 MB/s 2024-09-14T08:38:16.417 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T08:38:16.466 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-14T08:38:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T08:38:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T08:38:16.513 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-09-14T08:38:16.513 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T08:38:16.513 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-14 08:32:43.320219457 +0000 2024-09-14T08:38:16.513 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-14 08:32:43.064221732 +0000 2024-09-14T08:38:16.514 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-14 08:32:43.064221732 +0000 2024-09-14T08:38:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-14T08:38:16.514 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T08:38:16.568 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-14T08:38:16.568 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-14T08:38:16.568 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000277341 s, 1.8 MB/s 2024-09-14T08:38:16.569 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T08:38:16.618 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T08:38:16.618 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-14T08:38:16.618 INFO:tasks.ceph:Generating config... 2024-09-14T08:38:16.619 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T08:38:16.619 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-14T08:38:16.619 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T08:38:16.620 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T08:38:16.620 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T08:38:16.620 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T08:38:16.620 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T08:38:16.620 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T08:38:16.620 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T08:38:16.620 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T08:38:16.620 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-09-14T08:38:16.620 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-14T08:38:16.621 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T08:38:16.622 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T08:38:16.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T08:38:16.656 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T08:38:16.665 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T08:38:16.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T08:38:16.794 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.89'), ('mon.c', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]'), ('mon.b', '172.21.15.112')] 2024-09-14T08:38:16.795 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],172.21.15.112', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T08:38:16.795 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:16.795 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T08:38:16.843 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.89 --addv c '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --add b 172.21.15.112 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:16.929 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:16.929 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: generated fsid 57b092b7-5550-41a0-8f78-531de0e7c469 2024-09-14T08:38:16.929 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = quincy 2024-09-14T08:38:16.930 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 0 2024-09-14T08:38:16.930 INFO:teuthology.orchestra.run.smithi089.stdout:fsid 57b092b7-5550-41a0-8f78-531de0e7c469 2024-09-14T08:38:16.930 INFO:teuthology.orchestra.run.smithi089.stdout:last_changed 2024-09-14T08:38:16.936962+0000 2024-09-14T08:38:16.930 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-14T08:38:16.936962+0000 2024-09-14T08:38:16.930 INFO:teuthology.orchestra.run.smithi089.stdout:min_mon_release 17 (quincy) 2024-09-14T08:38:16.930 INFO:teuthology.orchestra.run.smithi089.stdout:election_strategy: 1 2024-09-14T08:38:16.930 INFO:teuthology.orchestra.run.smithi089.stdout:0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-14T08:38:16.930 INFO:teuthology.orchestra.run.smithi089.stdout:1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-14T08:38:16.930 INFO:teuthology.orchestra.run.smithi089.stdout:2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-14T08:38:16.930 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T08:38:16.931 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T08:38:16.980 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 57b092b7-5550-41a0-8f78-531de0e7c469... 2024-09-14T08:38:16.980 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T08:38:17.024 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T08:38:17.027 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T08:38:17.053 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-09-14T08:38:17.054 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2024-09-14T08:38:17.054 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T08:38:17.054 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2024-09-14T08:38:17.054 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.054 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2024-09-14T08:38:17.054 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.054 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2024-09-14T08:38:17.054 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.054 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2024-09-14T08:38:17.054 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2024-09-14T08:38:17.055 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2024-09-14T08:38:17.056 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],172.21.15.112" 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: mon client directed command retry = 5 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on pool no app = False 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: ms inject socket failures = 5000 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 57b092b7-5550-41a0-8f78-531de0e7c469 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2024-09-14T08:38:17.057 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug trim objects = true 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.058 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2024-09-14T08:38:17.059 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = stupid 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: osd blocked scrub grace period = 3600 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2024-09-14T08:38:17.060 INFO:teuthology.orchestra.run.smithi089.stdout: osd max markdown count = 1000 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-14T08:38:17.061 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T08:38:17.062 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T08:38:17.063 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T08:38:17.064 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2024-09-14T08:38:17.064 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2024-09-14T08:38:17.064 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2024-09-14T08:38:17.064 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2024-09-14T08:38:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2024-09-14T08:38:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2024-09-14T08:38:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],172.21.15.112" 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: mon client directed command retry = 5 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on pool no app = False 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: ms inject socket failures = 5000 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = 57b092b7-5550-41a0-8f78-531de0e7c469 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2024-09-14T08:38:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2024-09-14T08:38:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = stupid 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 1/20 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 1/20 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 4/10 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: osd blocked scrub grace period = 3600 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2024-09-14T08:38:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: osd max markdown count = 1000 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-09-14T08:38:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T08:38:17.074 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2024-09-14T08:38:17.075 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2024-09-14T08:38:17.075 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-14T08:38:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-14T08:38:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-14T08:38:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],172.21.15.112" 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: mon client directed command retry = 5 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on pool no app = False 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: ms inject socket failures = 5000 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 57b092b7-5550-41a0-8f78-531de0e7c469 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-14T08:38:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-14T08:38:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-14T08:38:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: bdev async discard = True 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: bdev enable discard = True 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore allocator = stupid 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 1/20 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 1/20 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 4/10 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: osd blocked scrub grace period = 3600 2024-09-14T08:38:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: osd max markdown count = 1000 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.083 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T08:38:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-14T08:38:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-14T08:38:17.086 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-14T08:38:17.086 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-14T08:38:17.086 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T08:38:17.086 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T08:38:17.086 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-14T08:38:17.086 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-14T08:38:17.086 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-14T08:38:17.087 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T08:38:17.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T08:38:17.167 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T08:38:17.169 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:17.169 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T08:38:17.176 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:17.177 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T08:38:17.222 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:38:17.223 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:17.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T08:38:17.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T08:38:17.285 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:17.285 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:17.331 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-09-14T08:38:17.331 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:17.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T08:38:17.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T08:38:17.355 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:17.355 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:17.401 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2024-09-14T08:38:17.401 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-14T08:38:17.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T08:38:17.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T08:38:17.424 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-14T08:38:17.424 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:17.473 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T08:38:17.473 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T08:38:17.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T08:38:17.518 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T08:38:17.529 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T08:38:17.529 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T08:38:17.529 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T08:38:17.566 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T08:38:17.596 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T08:38:17.596 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-14T08:38:17.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T08:38:17.611 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T08:38:17.611 INFO:tasks.ceph:role: osd.0 2024-09-14T08:38:17.611 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:38:17.611 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T08:38:17.676 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T08:38:17.676 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T08:38:17.676 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T08:38:17.676 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T08:38:17.676 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T08:38:17.676 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-09-14T08:38:17.676 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T08:38:17.677 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T08:38:17.677 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T08:38:17.677 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T08:38:18.137 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-09-14T08:38:18.139 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-09-14T08:38:18.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T08:38:18.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T08:38:18.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:38:18.250 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T08:38:18.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T08:38:18.310 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T08:38:18.310 INFO:tasks.ceph:role: osd.1 2024-09-14T08:38:18.310 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:38:18.310 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T08:38:18.373 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T08:38:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T08:38:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T08:38:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T08:38:18.373 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T08:38:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-09-14T08:38:18.373 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T08:38:18.373 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T08:38:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T08:38:18.373 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T08:38:18.856 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-09-14T08:38:18.859 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-09-14T08:38:18.859 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T08:38:19.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T08:38:19.034 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T08:38:19.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:38:19.036 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T08:38:19.092 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T08:38:19.092 INFO:tasks.ceph:role: osd.2 2024-09-14T08:38:19.092 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:38:19.092 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T08:38:19.154 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T08:38:19.154 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T08:38:19.154 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T08:38:19.154 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T08:38:19.154 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T08:38:19.154 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-09-14T08:38:19.154 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T08:38:19.154 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T08:38:19.154 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T08:38:19.155 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T08:38:19.636 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-09-14T08:38:19.638 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-09-14T08:38:19.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T08:38:19.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T08:38:19.805 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T08:38:19.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:38:19.806 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:19.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:19.929+0000 7f79da8c27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T08:38:19.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:19.929+0000 7f79da8c27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T08:38:19.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:19.929+0000 7f79da8c27c0 -1 bdev(0x55b6e8c77800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T08:38:19.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:19.929+0000 7f79da8c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T08:38:23.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T08:38:23.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:23.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:23.129+0000 7f6d29f2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T08:38:23.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:23.129+0000 7f6d29f2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T08:38:23.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:23.129+0000 7f6d29f2b7c0 -1 bdev(0x56028f8f1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T08:38:23.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:23.129+0000 7f6d29f2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T08:38:26.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T08:38:26.320 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:26.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:26.405+0000 7f2d27eac7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T08:38:26.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:26.405+0000 7f2d27eac7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T08:38:26.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:26.405+0000 7f2d27eac7c0 -1 bdev(0x55c8066a3800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T08:38:26.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:38:26.405+0000 7f2d27eac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T08:38:29.541 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T08:38:29.595 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T08:38:29.609 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T08:38:29.610 INFO:tasks.ceph:role: osd.3 2024-09-14T08:38:29.610 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-14T08:38:29.610 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T08:38:29.671 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T08:38:29.671 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T08:38:29.671 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T08:38:29.671 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T08:38:29.671 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T08:38:29.671 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-14T08:38:29.671 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T08:38:29.672 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T08:38:29.672 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T08:38:29.672 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T08:38:30.125 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-14T08:38:30.127 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-14T08:38:30.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-14T08:38:30.219 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T08:38:30.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:38:30.270 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T08:38:30.271 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T08:38:30.323 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T08:38:30.323 INFO:tasks.ceph:role: osd.4 2024-09-14T08:38:30.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-14T08:38:30.324 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T08:38:30.389 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T08:38:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T08:38:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T08:38:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T08:38:30.389 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T08:38:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-14T08:38:30.389 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T08:38:30.389 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T08:38:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T08:38:30.389 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T08:38:30.912 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-14T08:38:30.915 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-14T08:38:30.915 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-14T08:38:31.065 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T08:38:31.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:38:31.076 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T08:38:31.076 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T08:38:31.132 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T08:38:31.132 INFO:tasks.ceph:role: osd.5 2024-09-14T08:38:31.132 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-14T08:38:31.133 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T08:38:31.196 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T08:38:31.196 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T08:38:31.196 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T08:38:31.197 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T08:38:31.197 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T08:38:31.197 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-14T08:38:31.197 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T08:38:31.197 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T08:38:31.197 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T08:38:31.197 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T08:38:31.673 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-14T08:38:31.674 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-14T08:38:31.674 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-09-14T08:38:31.813 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T08:38:31.825 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T08:38:31.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:38:31.826 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:31.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:31.940+0000 7fe7db0537c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T08:38:31.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:31.944+0000 7fe7db0537c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T08:38:31.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:31.944+0000 7fe7db0537c0 -1 bdev(0x5590f5065800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T08:38:31.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:31.944+0000 7fe7db0537c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T08:38:35.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T08:38:35.087 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:35.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:35.176+0000 7fc523db07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T08:38:35.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:35.176+0000 7fc523db07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T08:38:35.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:35.176+0000 7fc523db07c0 -1 bdev(0x5639f6d2b800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T08:38:35.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:35.176+0000 7fc523db07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T08:38:38.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T08:38:38.377 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:38.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:38.464+0000 7f4c7c2c97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T08:38:38.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:38.464+0000 7f4c7c2c97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T08:38:38.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:38.464+0000 7f4c7c2c97c0 -1 bdev(0x564eb0e8f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T08:38:38.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-14T08:38:38.464+0000 7f4c7c2c97c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T08:38:41.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T08:38:41.672 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T08:38:41.673 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:41.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T08:38:41.687 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:41.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T08:38:41.742 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:41.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T08:38:41.801 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:41.801 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T08:38:41.815 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:41.815 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T08:38:41.867 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:41.867 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T08:38:41.923 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:41.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T08:38:41.980 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-14T08:38:41.980 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T08:38:41.986 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T08:38:42.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T08:38:42.062 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T08:38:42.072 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2024-09-14T08:38:42.072 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQB7S+VmgWmENxAAEro7Gz3R7bGDDwunXrTAkw== 2024-09-14T08:38:42.072 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2024-09-14T08:38:42.072 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQB/S+Vm3F3gBxAA/k+e7WdV23dEIzNBMm0U+w== 2024-09-14T08:38:42.072 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCCS+Vm+tpbGBAAHC1hsi6kgSMrtlEtZVSyCQ== 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQB5S+VmvBRYHxAAjQDrh1utsED01Y4wZBK52g== 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCHS+Vm9E5JOBAA7up5PVHJDCgmwigzu1vsvg== 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCLS+VmSk2vChAA0G1hR21332zBMNnvkps+zA== 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCOS+VmKYfVGxAA4V5Im62RM+NOAulNcHmoUA== 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-09-14T08:38:42.073 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQB5S+VmucbkIRAAJ8xAHf4Q6sRPDD4Gt90tTQ== 2024-09-14T08:38:42.074 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB7S+VmgWmENxAAEro7Gz3R7bGDDwunXrTAkw== 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB/S+Vm3F3gBxAA/k+e7WdV23dEIzNBMm0U+w== 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCCS+Vm+tpbGBAAHC1hsi6kgSMrtlEtZVSyCQ== 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB5S+VmvBRYHxAAjQDrh1utsED01Y4wZBK52g== 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCHS+Vm9E5JOBAA7up5PVHJDCgmwigzu1vsvg== 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2024-09-14T08:38:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCLS+VmSk2vChAA0G1hR21332zBMNnvkps+zA== 2024-09-14T08:38:42.076 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2024-09-14T08:38:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCOS+VmKYfVGxAA4V5Im62RM+NOAulNcHmoUA== 2024-09-14T08:38:42.076 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-14T08:38:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB5S+VmucbkIRAAJ8xAHf4Q6sRPDD4Gt90tTQ== 2024-09-14T08:38:42.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.120 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.167 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.253 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T08:38:42.335 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T08:38:42.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.424 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.503 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.586 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T08:38:42.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T08:38:42.679 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T08:38:42.753 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T08:38:42.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T08:38:42.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T08:38:42.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T08:38:42.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T08:38:42.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T08:38:43.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T08:38:43.059 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T08:38:43.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T08:38:43.170 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T08:38:43.181 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:43.184 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T08:38:43.228 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T08:38:43.228 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T08:38:43.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T08:38:43.232 INFO:tasks.ceph.mon.a:Started 2024-09-14T08:38:43.232 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T08:38:43.232 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T08:38:43.234 INFO:tasks.ceph.mon.c:Started 2024-09-14T08:38:43.234 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T08:38:43.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T08:38:43.273 INFO:tasks.ceph.mon.b:Started 2024-09-14T08:38:43.273 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T08:38:43.274 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T08:38:43.274 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T08:38:43.276 INFO:tasks.ceph.mgr.x:Started 2024-09-14T08:38:43.276 DEBUG:tasks.ceph:set 0 configs 2024-09-14T08:38:43.276 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T08:38:43.276 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T08:38:49.487 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2024-09-14T08:38:49.506 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T08:38:49.506 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T08:38:49.507 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:49.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T08:38:49.518 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:49.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T08:38:49.573 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-14T08:38:49.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T08:38:49.624 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:49.624 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T08:38:49.637 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:49.637 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T08:38:49.691 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-14T08:38:49.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T08:38:49.747 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d 0 2024-09-14T08:38:49.996 INFO:teuthology.orchestra.run.smithi112.stdout:0 2024-09-14T08:38:50.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 09ba1390-a0d1-48a3-9342-5f5aa64e2217 1 2024-09-14T08:38:50.219 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-14T08:38:50.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new a7cd8610-d8e1-44e7-a423-4419cad90d8e 2 2024-09-14T08:38:50.432 INFO:teuthology.orchestra.run.smithi112.stdout:2 2024-09-14T08:38:50.449 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 1339fb05-5d1c-4c0a-8388-314119543bb6 3 2024-09-14T08:38:50.649 INFO:teuthology.orchestra.run.smithi112.stdout:3 2024-09-14T08:38:50.665 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 0cebba54-9019-47bd-870f-306664e390e1 4 2024-09-14T08:38:50.882 INFO:teuthology.orchestra.run.smithi112.stdout:4 2024-09-14T08:38:50.905 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new e571e73b-0e9d-417d-b01c-59b651016763 5 2024-09-14T08:38:51.100 INFO:teuthology.orchestra.run.smithi112.stdout:5 2024-09-14T08:38:51.116 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T08:38:51.116 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T08:38:51.118 INFO:tasks.ceph.osd.0:Started 2024-09-14T08:38:51.118 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T08:38:51.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T08:38:51.121 INFO:tasks.ceph.osd.1:Started 2024-09-14T08:38:51.121 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T08:38:51.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T08:38:51.123 INFO:tasks.ceph.osd.2:Started 2024-09-14T08:38:51.124 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T08:38:51.124 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T08:38:51.126 INFO:tasks.ceph.osd.3:Started 2024-09-14T08:38:51.126 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T08:38:51.126 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T08:38:51.128 INFO:tasks.ceph.osd.4:Started 2024-09-14T08:38:51.128 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T08:38:51.128 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T08:38:51.130 INFO:tasks.ceph.osd.5:Started 2024-09-14T08:38:51.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T08:38:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:38:51.322 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"fsid":"57b092b7-5550-41a0-8f78-531de0e7c469","created":"2024-09-14T08:38:48.610112+0000","modified":"2024-09-14T08:38:51.099971+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T08:38:51.099971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09ba1390-a0d1-48a3-9342-5f5aa64e2217","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a7cd8610-d8e1-44e7-a423-4419cad90d8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1339fb05-5d1c-4c0a-8388-314119543bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0cebba54-9019-47bd-870f-306664e390e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e571e73b-0e9d-417d-b01c-59b651016763","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T08:38:51.339 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T08:38:51.340 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T08:38:51.945 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T08:38:52.140 INFO:teuthology.misc.health.smithi089.stdout: 2024-09-14T08:38:52.140 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":8,"fsid":"57b092b7-5550-41a0-8f78-531de0e7c469","created":"2024-09-14T08:38:48.610112+0000","modified":"2024-09-14T08:38:51.099971+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T08:38:51.099971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09ba1390-a0d1-48a3-9342-5f5aa64e2217","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a7cd8610-d8e1-44e7-a423-4419cad90d8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1339fb05-5d1c-4c0a-8388-314119543bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0cebba54-9019-47bd-870f-306664e390e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e571e73b-0e9d-417d-b01c-59b651016763","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T08:38:52.155 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-14T08:38:52.268 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:38:52.272+0000 7f2d05d087c0 -1 Falling back to public interface 2024-09-14T08:38:52.271 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:38:52.276+0000 7fd02df947c0 -1 Falling back to public interface 2024-09-14T08:38:52.296 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:38:52.300+0000 7f7a4cd907c0 -1 Falling back to public interface 2024-09-14T08:38:52.329 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:38:52.336+0000 7f14f7cc17c0 -1 Falling back to public interface 2024-09-14T08:38:52.355 INFO:tasks.ceph.mgr.x.smithi112.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T08:38:52.355 INFO:tasks.ceph.mgr.x.smithi112.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T08:38:52.355 INFO:tasks.ceph.mgr.x.smithi112.stderr: from numpy import show_config as show_numpy_config 2024-09-14T08:38:52.777 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:38:52.784+0000 7f783ebc07c0 -1 Falling back to public interface 2024-09-14T08:38:52.788 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:38:52.796+0000 7f254eb747c0 -1 Falling back to public interface 2024-09-14T08:38:55.268 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-14T08:38:55.276+0000 7fed676d0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T08:38:55.268 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-14T08:38:55.276+0000 7fed676d0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T08:38:56.181 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:38:56.184+0000 7f2d05d087c0 -1 osd.0 0 log_to_monitors true 2024-09-14T08:38:56.274 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:38:56.280+0000 7f14f7cc17c0 -1 osd.5 0 log_to_monitors true 2024-09-14T08:38:56.485 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:38:56.488+0000 7fd02df947c0 -1 osd.1 0 log_to_monitors true 2024-09-14T08:38:56.593 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:38:56.596+0000 7f7a4cd907c0 -1 osd.2 0 log_to_monitors true 2024-09-14T08:38:56.788 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:38:56.796+0000 7f254eb747c0 -1 osd.4 0 log_to_monitors true 2024-09-14T08:38:56.840 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:38:56.848+0000 7f783ebc07c0 -1 osd.3 0 log_to_monitors true 2024-09-14T08:38:58.319 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:38:58.328+0000 7f14f447c640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T08:38:58.375 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:38:58.380+0000 7f14eba9c640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T08:38:58.394 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:38:58.400+0000 7f2d01cb1640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T08:38:58.454 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:38:58.460+0000 7f2cf9ae3640 -1 osd.0 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T08:38:58.761 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T08:38:59.102 INFO:teuthology.misc.health.smithi089.stdout: 2024-09-14T08:38:59.102 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":11,"fsid":"57b092b7-5550-41a0-8f78-531de0e7c469","created":"2024-09-14T08:38:48.610112+0000","modified":"2024-09-14T08:38:58.321437+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T08:38:51.099971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09ba1390-a0d1-48a3-9342-5f5aa64e2217","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a7cd8610-d8e1-44e7-a423-4419cad90d8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1339fb05-5d1c-4c0a-8388-314119543bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0cebba54-9019-47bd-870f-306664e390e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e571e73b-0e9d-417d-b01c-59b651016763","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T08:38:59.120 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-14T08:38:59.849 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:38:59.856+0000 7f783b37b640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T08:38:59.881 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:38:59.884+0000 7fd029f3d640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T08:38:59.882 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:38:59.888+0000 7f254b32f640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T08:38:59.888 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:38:59.896+0000 7f783299b640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T08:38:59.889 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:38:59.892+0000 7f7a4954b640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T08:38:59.904 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:38:59.912+0000 7f254294f640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T08:38:59.906 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:38:59.912+0000 7fd021d6f640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T08:38:59.919 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:38:59.924+0000 7f7a40b6b640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T08:39:05.726 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T08:39:06.036 INFO:teuthology.misc.health.smithi089.stdout: 2024-09-14T08:39:06.036 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":15,"fsid":"57b092b7-5550-41a0-8f78-531de0e7c469","created":"2024-09-14T08:38:48.610112+0000","modified":"2024-09-14T08:39:02.913901+0000","last_up_change":"2024-09-14T08:39:00.908063+0000","last_in_change":"2024-09-14T08:38:51.099971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T08:39:00.306403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6801","nonce":2282442554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6803","nonce":2282442554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6807","nonce":2282442554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6805","nonce":2282442554}]},"public_addr":"172.21.15.89:6801/2282442554","cluster_addr":"172.21.15.89:6803/2282442554","heartbeat_back_addr":"172.21.15.89:6807/2282442554","heartbeat_front_addr":"172.21.15.89:6805/2282442554","state":["exists","up"]},{"osd":1,"uuid":"09ba1390-a0d1-48a3-9342-5f5aa64e2217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6809","nonce":2739597491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6811","nonce":2739597491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6815","nonce":2739597491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6813","nonce":2739597491}]},"public_addr":"172.21.15.89:6809/2739597491","cluster_addr":"172.21.15.89:6811/2739597491","heartbeat_back_addr":"172.21.15.89:6815/2739597491","heartbeat_front_addr":"172.21.15.89:6813/2739597491","state":["exists","up"]},{"osd":2,"uuid":"a7cd8610-d8e1-44e7-a423-4419cad90d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6817","nonce":1157205327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6819","nonce":1157205327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6823","nonce":1157205327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6821","nonce":1157205327}]},"public_addr":"172.21.15.89:6817/1157205327","cluster_addr":"172.21.15.89:6819/1157205327","heartbeat_back_addr":"172.21.15.89:6823/1157205327","heartbeat_front_addr":"172.21.15.89:6821/1157205327","state":["exists","up"]},{"osd":3,"uuid":"1339fb05-5d1c-4c0a-8388-314119543bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6809","nonce":1656791341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6811","nonce":1656791341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6815","nonce":1656791341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6813","nonce":1656791341}]},"public_addr":"172.21.15.112:6809/1656791341","cluster_addr":"172.21.15.112:6811/1656791341","heartbeat_back_addr":"172.21.15.112:6815/1656791341","heartbeat_front_addr":"172.21.15.112:6813/1656791341","state":["exists","up"]},{"osd":4,"uuid":"0cebba54-9019-47bd-870f-306664e390e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6817","nonce":1186206237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6819","nonce":1186206237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6823","nonce":1186206237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6821","nonce":1186206237}]},"public_addr":"172.21.15.112:6817/1186206237","cluster_addr":"172.21.15.112:6819/1186206237","heartbeat_back_addr":"172.21.15.112:6823/1186206237","heartbeat_front_addr":"172.21.15.112:6821/1186206237","state":["exists","up"]},{"osd":5,"uuid":"e571e73b-0e9d-417d-b01c-59b651016763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6801","nonce":796623465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6803","nonce":796623465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6807","nonce":796623465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6805","nonce":796623465}]},"public_addr":"172.21.15.112:6801/796623465","cluster_addr":"172.21.15.112:6803/796623465","heartbeat_back_addr":"172.21.15.112:6807/796623465","heartbeat_front_addr":"172.21.15.112:6805/796623465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.174731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.475467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.606174+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.835957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.753547+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.284212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T08:39:06.053 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-09-14T08:39:06.053 INFO:tasks.ceph:Creating RBD pool 2024-09-14T08:39:06.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T08:39:07.101 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'rbd' created 2024-09-14T08:39:07.128 DEBUG:teuthology.orchestra.run.smithi089:> rbd --cluster ceph pool init rbd 2024-09-14T08:39:10.141 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T08:39:10.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T08:39:10.143 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T08:39:10.462 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:10.480 INFO:teuthology.orchestra.run.smithi089.stdout:[{"version":7,"timestamp":"2024-09-14T08:38:59.904675+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"4508.776740"}]}] 2024-09-14T08:39:10.481 INFO:tasks.ceph_manager:config epoch is 7 2024-09-14T08:39:10.481 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T08:39:10.481 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T08:39:10.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T08:39:10.823 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:10.838 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":948558113},{"type":"v1","addr":"172.21.15.112:6825","nonce":948558113}]},"active_addr":"172.21.15.112:6825/948558113","active_change":"2024-09-14T08:38:54.250717+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1352751595}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":667407553}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3093121030}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1618156584}]}]} 2024-09-14T08:39:10.840 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T08:39:10.840 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T08:39:10.841 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T08:39:11.133 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:11.134 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"57b092b7-5550-41a0-8f78-531de0e7c469","created":"2024-09-14T08:38:48.610112+0000","modified":"2024-09-14T08:39:10.124209+0000","last_up_change":"2024-09-14T08:39:00.908063+0000","last_in_change":"2024-09-14T08:38:51.099971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T08:39:00.306403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T08:39:06.370159+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6801","nonce":2282442554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6803","nonce":2282442554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6807","nonce":2282442554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6805","nonce":2282442554}]},"public_addr":"172.21.15.89:6801/2282442554","cluster_addr":"172.21.15.89:6803/2282442554","heartbeat_back_addr":"172.21.15.89:6807/2282442554","heartbeat_front_addr":"172.21.15.89:6805/2282442554","state":["exists","up"]},{"osd":1,"uuid":"09ba1390-a0d1-48a3-9342-5f5aa64e2217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6809","nonce":2739597491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6811","nonce":2739597491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6815","nonce":2739597491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6813","nonce":2739597491}]},"public_addr":"172.21.15.89:6809/2739597491","cluster_addr":"172.21.15.89:6811/2739597491","heartbeat_back_addr":"172.21.15.89:6815/2739597491","heartbeat_front_addr":"172.21.15.89:6813/2739597491","state":["exists","up"]},{"osd":2,"uuid":"a7cd8610-d8e1-44e7-a423-4419cad90d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6817","nonce":1157205327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6819","nonce":1157205327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6823","nonce":1157205327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6821","nonce":1157205327}]},"public_addr":"172.21.15.89:6817/1157205327","cluster_addr":"172.21.15.89:6819/1157205327","heartbeat_back_addr":"172.21.15.89:6823/1157205327","heartbeat_front_addr":"172.21.15.89:6821/1157205327","state":["exists","up"]},{"osd":3,"uuid":"1339fb05-5d1c-4c0a-8388-314119543bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6809","nonce":1656791341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6811","nonce":1656791341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6815","nonce":1656791341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6813","nonce":1656791341}]},"public_addr":"172.21.15.112:6809/1656791341","cluster_addr":"172.21.15.112:6811/1656791341","heartbeat_back_addr":"172.21.15.112:6815/1656791341","heartbeat_front_addr":"172.21.15.112:6813/1656791341","state":["exists","up"]},{"osd":4,"uuid":"0cebba54-9019-47bd-870f-306664e390e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6817","nonce":1186206237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6819","nonce":1186206237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6823","nonce":1186206237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6821","nonce":1186206237}]},"public_addr":"172.21.15.112:6817/1186206237","cluster_addr":"172.21.15.112:6819/1186206237","heartbeat_back_addr":"172.21.15.112:6823/1186206237","heartbeat_front_addr":"172.21.15.112:6821/1186206237","state":["exists","up"]},{"osd":5,"uuid":"e571e73b-0e9d-417d-b01c-59b651016763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6801","nonce":796623465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6803","nonce":796623465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6807","nonce":796623465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6805","nonce":796623465}]},"public_addr":"172.21.15.112:6801/796623465","cluster_addr":"172.21.15.112:6803/796623465","heartbeat_back_addr":"172.21.15.112:6807/796623465","heartbeat_front_addr":"172.21.15.112:6805/796623465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.174731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.475467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.606174+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.835957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.753547+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.284212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T08:39:11.150 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T08:39:11.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T08:39:11.434 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:11.434 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"57b092b7-5550-41a0-8f78-531de0e7c469","created":"2024-09-14T08:38:48.610112+0000","modified":"2024-09-14T08:39:10.124209+0000","last_up_change":"2024-09-14T08:39:00.908063+0000","last_in_change":"2024-09-14T08:38:51.099971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T08:39:00.306403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T08:39:06.370159+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6801","nonce":2282442554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6803","nonce":2282442554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6807","nonce":2282442554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2282442554},{"type":"v1","addr":"172.21.15.89:6805","nonce":2282442554}]},"public_addr":"172.21.15.89:6801/2282442554","cluster_addr":"172.21.15.89:6803/2282442554","heartbeat_back_addr":"172.21.15.89:6807/2282442554","heartbeat_front_addr":"172.21.15.89:6805/2282442554","state":["exists","up"]},{"osd":1,"uuid":"09ba1390-a0d1-48a3-9342-5f5aa64e2217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6809","nonce":2739597491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6811","nonce":2739597491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6815","nonce":2739597491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2739597491},{"type":"v1","addr":"172.21.15.89:6813","nonce":2739597491}]},"public_addr":"172.21.15.89:6809/2739597491","cluster_addr":"172.21.15.89:6811/2739597491","heartbeat_back_addr":"172.21.15.89:6815/2739597491","heartbeat_front_addr":"172.21.15.89:6813/2739597491","state":["exists","up"]},{"osd":2,"uuid":"a7cd8610-d8e1-44e7-a423-4419cad90d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6817","nonce":1157205327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6819","nonce":1157205327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6823","nonce":1157205327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6821","nonce":1157205327}]},"public_addr":"172.21.15.89:6817/1157205327","cluster_addr":"172.21.15.89:6819/1157205327","heartbeat_back_addr":"172.21.15.89:6823/1157205327","heartbeat_front_addr":"172.21.15.89:6821/1157205327","state":["exists","up"]},{"osd":3,"uuid":"1339fb05-5d1c-4c0a-8388-314119543bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6809","nonce":1656791341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6811","nonce":1656791341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6815","nonce":1656791341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6813","nonce":1656791341}]},"public_addr":"172.21.15.112:6809/1656791341","cluster_addr":"172.21.15.112:6811/1656791341","heartbeat_back_addr":"172.21.15.112:6815/1656791341","heartbeat_front_addr":"172.21.15.112:6813/1656791341","state":["exists","up"]},{"osd":4,"uuid":"0cebba54-9019-47bd-870f-306664e390e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6817","nonce":1186206237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6819","nonce":1186206237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6823","nonce":1186206237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6821","nonce":1186206237}]},"public_addr":"172.21.15.112:6817/1186206237","cluster_addr":"172.21.15.112:6819/1186206237","heartbeat_back_addr":"172.21.15.112:6823/1186206237","heartbeat_front_addr":"172.21.15.112:6821/1186206237","state":["exists","up"]},{"osd":5,"uuid":"e571e73b-0e9d-417d-b01c-59b651016763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6801","nonce":796623465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6803","nonce":796623465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6807","nonce":796623465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6805","nonce":796623465}]},"public_addr":"172.21.15.112:6801/796623465","cluster_addr":"172.21.15.112:6803/796623465","heartbeat_back_addr":"172.21.15.112:6807/796623465","heartbeat_front_addr":"172.21.15.112:6805/796623465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.174731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.475467+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.606174+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.835957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.753547+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.284212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T08:39:11.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T08:39:11.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T08:39:11.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T08:39:11.453 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T08:39:11.453 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T08:39:11.453 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T08:39:11.607 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2024-09-14T08:39:11.607 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T08:39:11.627 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2024-09-14T08:39:11.627 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T08:39:11.692 INFO:teuthology.orchestra.run.smithi089.stdout:55834574853 2024-09-14T08:39:11.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T08:39:11.693 INFO:teuthology.orchestra.run.smithi089.stdout:51539607559 2024-09-14T08:39:11.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T08:39:11.697 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2024-09-14T08:39:11.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T08:39:11.698 INFO:teuthology.orchestra.run.smithi089.stdout:51539607558 2024-09-14T08:39:11.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T08:39:11.998 INFO:teuthology.orchestra.run.smithi089.stdout:55834574853 2024-09-14T08:39:12.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2024-09-14T08:39:12.059 INFO:teuthology.orchestra.run.smithi089.stdout:55834574851 2024-09-14T08:39:12.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.1 2024-09-14T08:39:12.127 INFO:teuthology.orchestra.run.smithi089.stdout:55834574853 2024-09-14T08:39:12.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.4 2024-09-14T08:39:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:51539607557 2024-09-14T08:39:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:51539607556 2024-09-14T08:39:12.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607559 got 51539607557 for osd.0 2024-09-14T08:39:12.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607558 got 51539607556 for osd.5 2024-09-14T08:39:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:55834574852 2024-09-14T08:39:12.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.3 2024-09-14T08:39:13.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T08:39:13.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T08:39:13.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T08:39:13.189 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T08:39:13.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T08:39:13.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T08:39:13.397 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2024-09-14T08:39:13.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-09-14T08:39:13.426 DEBUG:teuthology.parallel:result is None 2024-09-14T08:39:13.477 INFO:teuthology.orchestra.run.smithi089.stdout:55834574853 2024-09-14T08:39:13.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-09-14T08:39:13.504 DEBUG:teuthology.parallel:result is None 2024-09-14T08:39:13.506 INFO:teuthology.orchestra.run.smithi089.stdout:51539607559 2024-09-14T08:39:13.517 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2024-09-14T08:39:13.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607559 got 51539607559 for osd.0 2024-09-14T08:39:13.525 DEBUG:teuthology.parallel:result is None 2024-09-14T08:39:13.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-09-14T08:39:13.537 DEBUG:teuthology.parallel:result is None 2024-09-14T08:39:13.581 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2024-09-14T08:39:13.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-09-14T08:39:13.598 DEBUG:teuthology.parallel:result is None 2024-09-14T08:39:13.630 INFO:teuthology.orchestra.run.smithi089.stdout:51539607558 2024-09-14T08:39:13.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607558 got 51539607558 for osd.5 2024-09-14T08:39:13.647 DEBUG:teuthology.parallel:result is None 2024-09-14T08:39:13.647 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T08:39:13.648 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:39:13.975 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:13.975 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:39:13.992 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-14T08:39:13.333755+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168568,"kb_used_data":2212,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":566062472,"statfs":{"total":579820584960,"available":579647971328,"internally_reserved":0,"allocated":2265088,"data_stored":1526038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":170187424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.215533"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.710340+0000","last_change":"2024-09-14T08:39:10.710340+0000","last_active":"2024-09-14T08:39:10.710340+0000","last_peered":"2024-09-14T08:39:10.710340+0000","last_clean":"2024-09-14T08:39:10.710340+0000","last_became_active":"2024-09-14T08:39:08.202439+0000","last_became_peered":"2024-09-14T08:39:08.202439+0000","last_unstale":"2024-09-14T08:39:10.710340+0000","last_undegraded":"2024-09-14T08:39:10.710340+0000","last_fullsized":"2024-09-14T08:39:10.710340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:23.410553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001636462,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.138177+0000","last_change":"2024-09-14T08:39:10.138177+0000","last_active":"2024-09-14T08:39:10.138177+0000","last_peered":"2024-09-14T08:39:10.138177+0000","last_clean":"2024-09-14T08:39:10.138177+0000","last_became_active":"2024-09-14T08:39:08.132530+0000","last_became_peered":"2024-09-14T08:39:08.132530+0000","last_unstale":"2024-09-14T08:39:10.138177+0000","last_undegraded":"2024-09-14T08:39:10.138177+0000","last_fullsized":"2024-09-14T08:39:10.138177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:17.902057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.709775+0000","last_change":"2024-09-14T08:39:10.709775+0000","last_active":"2024-09-14T08:39:10.709775+0000","last_peered":"2024-09-14T08:39:10.709775+0000","last_clean":"2024-09-14T08:39:10.709775+0000","last_became_active":"2024-09-14T08:39:08.126303+0000","last_became_peered":"2024-09-14T08:39:08.126303+0000","last_unstale":"2024-09-14T08:39:10.709775+0000","last_undegraded":"2024-09-14T08:39:10.709775+0000","last_fullsized":"2024-09-14T08:39:10.709775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:58.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.138175+0000","last_change":"2024-09-14T08:39:10.138175+0000","last_active":"2024-09-14T08:39:10.138175+0000","last_peered":"2024-09-14T08:39:10.138175+0000","last_clean":"2024-09-14T08:39:10.138175+0000","last_became_active":"2024-09-14T08:39:08.128925+0000","last_became_peered":"2024-09-14T08:39:08.128925+0000","last_unstale":"2024-09-14T08:39:10.138175+0000","last_undegraded":"2024-09-14T08:39:10.138175+0000","last_fullsized":"2024-09-14T08:39:10.138175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:02.017543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.140761+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:10.140761+0000","last_peered":"2024-09-14T08:39:10.140761+0000","last_clean":"2024-09-14T08:39:10.140761+0000","last_became_active":"2024-09-14T08:39:08.130091+0000","last_became_peered":"2024-09-14T08:39:08.130091+0000","last_unstale":"2024-09-14T08:39:10.140761+0000","last_undegraded":"2024-09-14T08:39:10.140761+0000","last_fullsized":"2024-09-14T08:39:10.140761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:12.463612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.688857+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:39:10.688857+0000","last_peered":"2024-09-14T08:39:10.688857+0000","last_clean":"2024-09-14T08:39:10.688857+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:39:10.688857+0000","last_undegraded":"2024-09-14T08:39:10.688857+0000","last_fullsized":"2024-09-14T08:39:10.688857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.709726+0000","last_change":"2024-09-14T08:39:10.709726+0000","last_active":"2024-09-14T08:39:10.709726+0000","last_peered":"2024-09-14T08:39:10.709726+0000","last_clean":"2024-09-14T08:39:10.709726+0000","last_became_active":"2024-09-14T08:39:08.129482+0000","last_became_peered":"2024-09-14T08:39:08.129482+0000","last_unstale":"2024-09-14T08:39:10.709726+0000","last_undegraded":"2024-09-14T08:39:10.709726+0000","last_fullsized":"2024-09-14T08:39:10.709726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.464996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010748229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.137121+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:10.137121+0000","last_peered":"2024-09-14T08:39:10.137121+0000","last_clean":"2024-09-14T08:39:10.137121+0000","last_became_active":"2024-09-14T08:39:08.129594+0000","last_became_peered":"2024-09-14T08:39:08.129594+0000","last_unstale":"2024-09-14T08:39:10.137121+0000","last_undegraded":"2024-09-14T08:39:10.137121+0000","last_fullsized":"2024-09-14T08:39:10.137121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:50.092003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001084296,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.708440+0000","last_change":"2024-09-14T08:39:01.959798+0000","last_active":"2024-09-14T08:39:10.708440+0000","last_peered":"2024-09-14T08:39:10.708440+0000","last_clean":"2024-09-14T08:39:10.708440+0000","last_became_active":"2024-09-14T08:39:01.957890+0000","last_became_peered":"2024-09-14T08:39:01.957890+0000","last_unstale":"2024-09-14T08:39:10.708440+0000","last_undegraded":"2024-09-14T08:39:10.708440+0000","last_fullsized":"2024-09-14T08:39:10.708440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:18.555164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":180224,"data_stored":58372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":774144,"data_stored":648740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":53404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":58391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607559,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:39:13.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:39:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:14.274 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:39:14.288 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T08:39:14.266917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168568,"kb_used_data":2212,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":566062472,"statfs":{"total":579820584960,"available":579647971328,"internally_reserved":0,"allocated":2265088,"data_stored":1526038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":170187424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001619"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.710340+0000","last_change":"2024-09-14T08:39:10.710340+0000","last_active":"2024-09-14T08:39:10.710340+0000","last_peered":"2024-09-14T08:39:10.710340+0000","last_clean":"2024-09-14T08:39:10.710340+0000","last_became_active":"2024-09-14T08:39:08.202439+0000","last_became_peered":"2024-09-14T08:39:08.202439+0000","last_unstale":"2024-09-14T08:39:10.710340+0000","last_undegraded":"2024-09-14T08:39:10.710340+0000","last_fullsized":"2024-09-14T08:39:10.710340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:23.410553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001636462,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.138177+0000","last_change":"2024-09-14T08:39:10.138177+0000","last_active":"2024-09-14T08:39:10.138177+0000","last_peered":"2024-09-14T08:39:10.138177+0000","last_clean":"2024-09-14T08:39:10.138177+0000","last_became_active":"2024-09-14T08:39:08.132530+0000","last_became_peered":"2024-09-14T08:39:08.132530+0000","last_unstale":"2024-09-14T08:39:10.138177+0000","last_undegraded":"2024-09-14T08:39:10.138177+0000","last_fullsized":"2024-09-14T08:39:10.138177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:17.902057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.709775+0000","last_change":"2024-09-14T08:39:10.709775+0000","last_active":"2024-09-14T08:39:10.709775+0000","last_peered":"2024-09-14T08:39:10.709775+0000","last_clean":"2024-09-14T08:39:10.709775+0000","last_became_active":"2024-09-14T08:39:08.126303+0000","last_became_peered":"2024-09-14T08:39:08.126303+0000","last_unstale":"2024-09-14T08:39:10.709775+0000","last_undegraded":"2024-09-14T08:39:10.709775+0000","last_fullsized":"2024-09-14T08:39:10.709775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:58.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.138175+0000","last_change":"2024-09-14T08:39:10.138175+0000","last_active":"2024-09-14T08:39:10.138175+0000","last_peered":"2024-09-14T08:39:10.138175+0000","last_clean":"2024-09-14T08:39:10.138175+0000","last_became_active":"2024-09-14T08:39:08.128925+0000","last_became_peered":"2024-09-14T08:39:08.128925+0000","last_unstale":"2024-09-14T08:39:10.138175+0000","last_undegraded":"2024-09-14T08:39:10.138175+0000","last_fullsized":"2024-09-14T08:39:10.138175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:02.017543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.140761+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:10.140761+0000","last_peered":"2024-09-14T08:39:10.140761+0000","last_clean":"2024-09-14T08:39:10.140761+0000","last_became_active":"2024-09-14T08:39:08.130091+0000","last_became_peered":"2024-09-14T08:39:08.130091+0000","last_unstale":"2024-09-14T08:39:10.140761+0000","last_undegraded":"2024-09-14T08:39:10.140761+0000","last_fullsized":"2024-09-14T08:39:10.140761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:12.463612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.688857+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:39:10.688857+0000","last_peered":"2024-09-14T08:39:10.688857+0000","last_clean":"2024-09-14T08:39:10.688857+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:39:10.688857+0000","last_undegraded":"2024-09-14T08:39:10.688857+0000","last_fullsized":"2024-09-14T08:39:10.688857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.709726+0000","last_change":"2024-09-14T08:39:10.709726+0000","last_active":"2024-09-14T08:39:10.709726+0000","last_peered":"2024-09-14T08:39:10.709726+0000","last_clean":"2024-09-14T08:39:10.709726+0000","last_became_active":"2024-09-14T08:39:08.129482+0000","last_became_peered":"2024-09-14T08:39:08.129482+0000","last_unstale":"2024-09-14T08:39:10.709726+0000","last_undegraded":"2024-09-14T08:39:10.709726+0000","last_fullsized":"2024-09-14T08:39:10.709726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.464996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010748229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.137121+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:10.137121+0000","last_peered":"2024-09-14T08:39:10.137121+0000","last_clean":"2024-09-14T08:39:10.137121+0000","last_became_active":"2024-09-14T08:39:08.129594+0000","last_became_peered":"2024-09-14T08:39:08.129594+0000","last_unstale":"2024-09-14T08:39:10.137121+0000","last_undegraded":"2024-09-14T08:39:10.137121+0000","last_fullsized":"2024-09-14T08:39:10.137121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:50.092003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001084296,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.708440+0000","last_change":"2024-09-14T08:39:01.959798+0000","last_active":"2024-09-14T08:39:10.708440+0000","last_peered":"2024-09-14T08:39:10.708440+0000","last_clean":"2024-09-14T08:39:10.708440+0000","last_became_active":"2024-09-14T08:39:01.957890+0000","last_became_peered":"2024-09-14T08:39:01.957890+0000","last_unstale":"2024-09-14T08:39:10.708440+0000","last_undegraded":"2024-09-14T08:39:10.708440+0000","last_fullsized":"2024-09-14T08:39:10.708440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:18.555164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":180224,"data_stored":58372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":774144,"data_stored":648740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":53404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":58391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607559,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:39:14.289 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T08:39:14.289 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T08:39:14.290 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T08:39:14.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T08:39:14.598 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:14.599 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T08:39:14.615 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T08:39:14.616 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-14T08:39:14.626 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-14T08:39:14.626 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}} 2024-09-14T08:39:14.627 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-14T08:39:14.627 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-14T08:39:14.938 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-14T08:39:14.938 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T08:39:14.939 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:39:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:15.212 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:39:15.228 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T08:39:14.266917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168568,"kb_used_data":2212,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":566062472,"statfs":{"total":579820584960,"available":579647971328,"internally_reserved":0,"allocated":2265088,"data_stored":1526038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":170187424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001619"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.710340+0000","last_change":"2024-09-14T08:39:10.710340+0000","last_active":"2024-09-14T08:39:10.710340+0000","last_peered":"2024-09-14T08:39:10.710340+0000","last_clean":"2024-09-14T08:39:10.710340+0000","last_became_active":"2024-09-14T08:39:08.202439+0000","last_became_peered":"2024-09-14T08:39:08.202439+0000","last_unstale":"2024-09-14T08:39:10.710340+0000","last_undegraded":"2024-09-14T08:39:10.710340+0000","last_fullsized":"2024-09-14T08:39:10.710340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:23.410553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001636462,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.138177+0000","last_change":"2024-09-14T08:39:10.138177+0000","last_active":"2024-09-14T08:39:10.138177+0000","last_peered":"2024-09-14T08:39:10.138177+0000","last_clean":"2024-09-14T08:39:10.138177+0000","last_became_active":"2024-09-14T08:39:08.132530+0000","last_became_peered":"2024-09-14T08:39:08.132530+0000","last_unstale":"2024-09-14T08:39:10.138177+0000","last_undegraded":"2024-09-14T08:39:10.138177+0000","last_fullsized":"2024-09-14T08:39:10.138177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:17.902057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.709775+0000","last_change":"2024-09-14T08:39:10.709775+0000","last_active":"2024-09-14T08:39:10.709775+0000","last_peered":"2024-09-14T08:39:10.709775+0000","last_clean":"2024-09-14T08:39:10.709775+0000","last_became_active":"2024-09-14T08:39:08.126303+0000","last_became_peered":"2024-09-14T08:39:08.126303+0000","last_unstale":"2024-09-14T08:39:10.709775+0000","last_undegraded":"2024-09-14T08:39:10.709775+0000","last_fullsized":"2024-09-14T08:39:10.709775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:58.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.138175+0000","last_change":"2024-09-14T08:39:10.138175+0000","last_active":"2024-09-14T08:39:10.138175+0000","last_peered":"2024-09-14T08:39:10.138175+0000","last_clean":"2024-09-14T08:39:10.138175+0000","last_became_active":"2024-09-14T08:39:08.128925+0000","last_became_peered":"2024-09-14T08:39:08.128925+0000","last_unstale":"2024-09-14T08:39:10.138175+0000","last_undegraded":"2024-09-14T08:39:10.138175+0000","last_fullsized":"2024-09-14T08:39:10.138175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:02.017543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.140761+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:10.140761+0000","last_peered":"2024-09-14T08:39:10.140761+0000","last_clean":"2024-09-14T08:39:10.140761+0000","last_became_active":"2024-09-14T08:39:08.130091+0000","last_became_peered":"2024-09-14T08:39:08.130091+0000","last_unstale":"2024-09-14T08:39:10.140761+0000","last_undegraded":"2024-09-14T08:39:10.140761+0000","last_fullsized":"2024-09-14T08:39:10.140761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:12.463612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.688857+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:39:10.688857+0000","last_peered":"2024-09-14T08:39:10.688857+0000","last_clean":"2024-09-14T08:39:10.688857+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:39:10.688857+0000","last_undegraded":"2024-09-14T08:39:10.688857+0000","last_fullsized":"2024-09-14T08:39:10.688857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.709726+0000","last_change":"2024-09-14T08:39:10.709726+0000","last_active":"2024-09-14T08:39:10.709726+0000","last_peered":"2024-09-14T08:39:10.709726+0000","last_clean":"2024-09-14T08:39:10.709726+0000","last_became_active":"2024-09-14T08:39:08.129482+0000","last_became_peered":"2024-09-14T08:39:08.129482+0000","last_unstale":"2024-09-14T08:39:10.709726+0000","last_undegraded":"2024-09-14T08:39:10.709726+0000","last_fullsized":"2024-09-14T08:39:10.709726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.464996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010748229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.137121+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:10.137121+0000","last_peered":"2024-09-14T08:39:10.137121+0000","last_clean":"2024-09-14T08:39:10.137121+0000","last_became_active":"2024-09-14T08:39:08.129594+0000","last_became_peered":"2024-09-14T08:39:08.129594+0000","last_unstale":"2024-09-14T08:39:10.137121+0000","last_undegraded":"2024-09-14T08:39:10.137121+0000","last_fullsized":"2024-09-14T08:39:10.137121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:50.092003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001084296,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.708440+0000","last_change":"2024-09-14T08:39:01.959798+0000","last_active":"2024-09-14T08:39:10.708440+0000","last_peered":"2024-09-14T08:39:10.708440+0000","last_clean":"2024-09-14T08:39:10.708440+0000","last_became_active":"2024-09-14T08:39:01.957890+0000","last_became_peered":"2024-09-14T08:39:01.957890+0000","last_unstale":"2024-09-14T08:39:10.708440+0000","last_undegraded":"2024-09-14T08:39:10.708440+0000","last_fullsized":"2024-09-14T08:39:10.708440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:18.555164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":180224,"data_stored":58372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":774144,"data_stored":648740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":53404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":58391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607559,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:39:15.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:39:15.514 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:15.514 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:39:15.531 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T08:39:14.266917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168568,"kb_used_data":2212,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":566062472,"statfs":{"total":579820584960,"available":579647971328,"internally_reserved":0,"allocated":2265088,"data_stored":1526038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":170187424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001619"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.710340+0000","last_change":"2024-09-14T08:39:10.710340+0000","last_active":"2024-09-14T08:39:10.710340+0000","last_peered":"2024-09-14T08:39:10.710340+0000","last_clean":"2024-09-14T08:39:10.710340+0000","last_became_active":"2024-09-14T08:39:08.202439+0000","last_became_peered":"2024-09-14T08:39:08.202439+0000","last_unstale":"2024-09-14T08:39:10.710340+0000","last_undegraded":"2024-09-14T08:39:10.710340+0000","last_fullsized":"2024-09-14T08:39:10.710340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:23.410553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001636462,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.138177+0000","last_change":"2024-09-14T08:39:10.138177+0000","last_active":"2024-09-14T08:39:10.138177+0000","last_peered":"2024-09-14T08:39:10.138177+0000","last_clean":"2024-09-14T08:39:10.138177+0000","last_became_active":"2024-09-14T08:39:08.132530+0000","last_became_peered":"2024-09-14T08:39:08.132530+0000","last_unstale":"2024-09-14T08:39:10.138177+0000","last_undegraded":"2024-09-14T08:39:10.138177+0000","last_fullsized":"2024-09-14T08:39:10.138177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:17.902057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.709775+0000","last_change":"2024-09-14T08:39:10.709775+0000","last_active":"2024-09-14T08:39:10.709775+0000","last_peered":"2024-09-14T08:39:10.709775+0000","last_clean":"2024-09-14T08:39:10.709775+0000","last_became_active":"2024-09-14T08:39:08.126303+0000","last_became_peered":"2024-09-14T08:39:08.126303+0000","last_unstale":"2024-09-14T08:39:10.709775+0000","last_undegraded":"2024-09-14T08:39:10.709775+0000","last_fullsized":"2024-09-14T08:39:10.709775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:58.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.138175+0000","last_change":"2024-09-14T08:39:10.138175+0000","last_active":"2024-09-14T08:39:10.138175+0000","last_peered":"2024-09-14T08:39:10.138175+0000","last_clean":"2024-09-14T08:39:10.138175+0000","last_became_active":"2024-09-14T08:39:08.128925+0000","last_became_peered":"2024-09-14T08:39:08.128925+0000","last_unstale":"2024-09-14T08:39:10.138175+0000","last_undegraded":"2024-09-14T08:39:10.138175+0000","last_fullsized":"2024-09-14T08:39:10.138175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:02.017543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.140761+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:10.140761+0000","last_peered":"2024-09-14T08:39:10.140761+0000","last_clean":"2024-09-14T08:39:10.140761+0000","last_became_active":"2024-09-14T08:39:08.130091+0000","last_became_peered":"2024-09-14T08:39:08.130091+0000","last_unstale":"2024-09-14T08:39:10.140761+0000","last_undegraded":"2024-09-14T08:39:10.140761+0000","last_fullsized":"2024-09-14T08:39:10.140761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:12.463612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.688857+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:39:10.688857+0000","last_peered":"2024-09-14T08:39:10.688857+0000","last_clean":"2024-09-14T08:39:10.688857+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:39:10.688857+0000","last_undegraded":"2024-09-14T08:39:10.688857+0000","last_fullsized":"2024-09-14T08:39:10.688857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.709726+0000","last_change":"2024-09-14T08:39:10.709726+0000","last_active":"2024-09-14T08:39:10.709726+0000","last_peered":"2024-09-14T08:39:10.709726+0000","last_clean":"2024-09-14T08:39:10.709726+0000","last_became_active":"2024-09-14T08:39:08.129482+0000","last_became_peered":"2024-09-14T08:39:08.129482+0000","last_unstale":"2024-09-14T08:39:10.709726+0000","last_undegraded":"2024-09-14T08:39:10.709726+0000","last_fullsized":"2024-09-14T08:39:10.709726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.464996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010748229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.137121+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:10.137121+0000","last_peered":"2024-09-14T08:39:10.137121+0000","last_clean":"2024-09-14T08:39:10.137121+0000","last_became_active":"2024-09-14T08:39:08.129594+0000","last_became_peered":"2024-09-14T08:39:08.129594+0000","last_unstale":"2024-09-14T08:39:10.137121+0000","last_undegraded":"2024-09-14T08:39:10.137121+0000","last_fullsized":"2024-09-14T08:39:10.137121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:50.092003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001084296,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.708440+0000","last_change":"2024-09-14T08:39:01.959798+0000","last_active":"2024-09-14T08:39:10.708440+0000","last_peered":"2024-09-14T08:39:10.708440+0000","last_clean":"2024-09-14T08:39:10.708440+0000","last_became_active":"2024-09-14T08:39:01.957890+0000","last_became_peered":"2024-09-14T08:39:01.957890+0000","last_unstale":"2024-09-14T08:39:10.708440+0000","last_undegraded":"2024-09-14T08:39:10.708440+0000","last_fullsized":"2024-09-14T08:39:10.708440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:18.555164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":180224,"data_stored":58372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":774144,"data_stored":648740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":53404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":58391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607559,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:39:15.532 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T08:39:15.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-14T08:39:15.830 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 20 2024-09-14T08:39:15.830 INFO:teuthology.orchestra.run.smithi089.stdout:fsid 57b092b7-5550-41a0-8f78-531de0e7c469 2024-09-14T08:39:15.830 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-14T08:38:48.610112+0000 2024-09-14T08:39:15.830 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-14T08:39:13.320204+0000 2024-09-14T08:39:15.830 INFO:teuthology.orchestra.run.smithi089.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:crush_version 5 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:full_ratio 0.95 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:backfillfull_ratio 0.9 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:nearfull_ratio 0.85 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:require_min_compat_client luminous 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:min_compat_client jewel 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:require_osd_release squid 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:stretch_mode_enabled false 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 6.06 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 19 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 2.25 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:max_osd 6 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6800/2282442554,v1:172.21.15.89:6801/2282442554] [v2:172.21.15.89:6802/2282442554,v1:172.21.15.89:6803/2282442554] exists,up 2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d 2024-09-14T08:39:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6808/2739597491,v1:172.21.15.89:6809/2739597491] [v2:172.21.15.89:6810/2739597491,v1:172.21.15.89:6811/2739597491] exists,up 09ba1390-a0d1-48a3-9342-5f5aa64e2217 2024-09-14T08:39:15.832 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6816/1157205327,v1:172.21.15.89:6817/1157205327] [v2:172.21.15.89:6818/1157205327,v1:172.21.15.89:6819/1157205327] exists,up a7cd8610-d8e1-44e7-a423-4419cad90d8e 2024-09-14T08:39:15.832 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6808/1656791341,v1:172.21.15.112:6809/1656791341] [v2:172.21.15.112:6810/1656791341,v1:172.21.15.112:6811/1656791341] exists,up 1339fb05-5d1c-4c0a-8388-314119543bb6 2024-09-14T08:39:15.832 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6816/1186206237,v1:172.21.15.112:6817/1186206237] [v2:172.21.15.112:6818/1186206237,v1:172.21.15.112:6819/1186206237] exists,up 0cebba54-9019-47bd-870f-306664e390e1 2024-09-14T08:39:15.832 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 up in weight 1 up_from 12 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/796623465,v1:172.21.15.112:6801/796623465] [v2:172.21.15.112:6802/796623465,v1:172.21.15.112:6803/796623465] exists,up e571e73b-0e9d-417d-b01c-59b651016763 2024-09-14T08:39:15.849 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6800/2282442554,v1:172.21.15.89:6801/2282442554] [v2:172.21.15.89:6802/2282442554,v1:172.21.15.89:6803/2282442554] exists,up 2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d', 'osd.1 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6808/2739597491,v1:172.21.15.89:6809/2739597491] [v2:172.21.15.89:6810/2739597491,v1:172.21.15.89:6811/2739597491] exists,up 09ba1390-a0d1-48a3-9342-5f5aa64e2217', 'osd.2 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6816/1157205327,v1:172.21.15.89:6817/1157205327] [v2:172.21.15.89:6818/1157205327,v1:172.21.15.89:6819/1157205327] exists,up a7cd8610-d8e1-44e7-a423-4419cad90d8e', 'osd.3 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6808/1656791341,v1:172.21.15.112:6809/1656791341] [v2:172.21.15.112:6810/1656791341,v1:172.21.15.112:6811/1656791341] exists,up 1339fb05-5d1c-4c0a-8388-314119543bb6', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6816/1186206237,v1:172.21.15.112:6817/1186206237] [v2:172.21.15.112:6818/1186206237,v1:172.21.15.112:6819/1186206237] exists,up 0cebba54-9019-47bd-870f-306664e390e1', 'osd.5 up in weight 1 up_from 12 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/796623465,v1:172.21.15.112:6801/796623465] [v2:172.21.15.112:6802/796623465,v1:172.21.15.112:6803/796623465] exists,up e571e73b-0e9d-417d-b01c-59b651016763'] 2024-09-14T08:39:15.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-14T08:39:15.953 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:15.953 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "mon.a", 2024-09-14T08:39:15.953 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster": "ceph", 2024-09-14T08:39:15.953 INFO:teuthology.orchestra.run.smithi089.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-14T08:39:15.953 INFO:teuthology.orchestra.run.smithi089.stdout: "admin_socket_mode": "", 2024-09-14T08:39:15.953 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-14T08:39:15.953 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_client_required": "cephx, none", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_cluster_required": "cephx", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_debug": "true", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_service_required": "cephx", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_supported": "cephx", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_aio": "true", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_aio_poll_ms": "250", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_aio_reap_max": "16", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_async_discard_threads": "0", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_block_size": "4096", 2024-09-14T08:39:15.954 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_debug_aio": "false", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_debug_inflight_ios": "false", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_enable_discard": "false", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_flock_retry": "3", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_inject_crash": "0", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_ioring": "false", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_ioring_hipri": "false", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-14T08:39:15.955 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_type": "", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_alloc_size": "1048576", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_allocator": "hybrid", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_buffered_io": "true", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_check_for_zeros": "false", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_compact_log_sync": "false", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-14T08:39:15.956 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_max_log_runway": "4194304", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_max_prefetch": "1048576", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_min_flush_size": "524288", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_min_log_runway": "1048576", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_replay_recovery": "false", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_sync_write": "false", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-14T08:39:15.957 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_allocation_from_file": "true", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_allocator": "hybrid", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_async_db_compaction": "true", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bdev_label_multi": "true", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_create": "true", 2024-09-14T08:39:15.958 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_db_create": "false", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_db_path": "", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_db_size": "0", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_path": "", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_preallocate_file": "false", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_size": "107374182400", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_wal_create": "false", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_wal_path": "", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_wal_size": "100663296", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bluefs": "true", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-14T08:39:15.959 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_autotune": "true", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_size": "0", 2024-09-14T08:39:15.960 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-14T08:39:15.961 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-14T08:39:15.961 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-14T08:39:15.961 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-14T08:39:15.961 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_type": "2q", 2024-09-14T08:39:15.961 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-14T08:39:15.961 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_clone_cow": "true", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_mode": "none", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_csum_type": "crc32c", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-14T08:39:15.962 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_freelist": "false", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-14T08:39:15.963 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_small_allocations": "0", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_default_buffered_read": "true", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_default_buffered_write": "false", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-14T08:39:15.964 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fail_eio": "false", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_mount": "false", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_umount": "false", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-14T08:39:15.965 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_ignore_data_csum": "false", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_log_op_age": "5.000000", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_alloc_size": "0", 2024-09-14T08:39:15.966 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_blob_size": "0", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_deferred_txc": "32", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_min_alloc_size": "0", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_nid_prealloc": "1024", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-14T08:39:15.967 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_retry_disk_reads": "3", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_rocksdb_cf": "true", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_spdk_mem": "512", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-14T08:39:15.968 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_tracing": "false", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-14T08:39:15.969 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_write_v2": "false", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_write_v2_random": "false", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_zero_block_detection": "false", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-14T08:39:15.970 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_cluster_require_signatures": "false", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_cluster_require_version": "2", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_require_signatures": "false", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_require_version": "2", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_service_require_signatures": "false", 2024-09-14T08:39:15.971 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_service_require_version": "2", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_sign_messages": "true", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "chdir": "", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_acl_type": "", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_asio_thread_count": "2", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_cache_mid": "0.750000", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_cache_size": "16384", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_caps_release_delay": "5", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_check_pool_perm": "true", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_debug_force_sync_read": "false", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_debug_getattr_caps": "false", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_debug_inject_features": "", 2024-09-14T08:39:15.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_debug_inject_tick_delay": "0", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_die_on_failed_remount": "false", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_dirsize_rbytes": "true", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_force_lazyio": "false", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_fs": "", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_inject_release_failure": "false", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_max_inline_size": "4096", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_mds_namespace": "", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_metadata": "", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_mount_gid": "-1", 2024-09-14T08:39:15.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_mount_timeout": "300", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_mount_uid": "-1", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_mountpoint": "/", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_notify_timeout": "10", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc": "true", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc_max_dirty": "104857600", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc_max_objects": "1000", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc_size": "209715200", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc_target_dirty": "8388608", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_permissions": "true", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_quota": "true", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_quota_df": "true", 2024-09-14T08:39:15.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_readahead_max_bytes": "0", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_readahead_max_periods": "4", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_readahead_min": "131072", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_reconnect_stale": "false", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_shutdown_timeout": "30", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_snapdir": ".snap", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_tick_interval": "1", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_trace": "", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_try_dentry_invalidate": "false", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_use_faked_inos": "false", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_use_random_mds": "false", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_graylog": "false", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-14T08:39:15.975 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_graylog_port": "12201", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_monitors": "default=true", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_syslog": "false", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_syslog_level": "info", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "-", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_network": "", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_network_interface": "", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "compressor_zlib_isal": "false", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "compressor_zlib_level": "5", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "compressor_zlib_winsize": "-15", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "compressor_zstd_level": "1", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-14T08:39:15.976 INFO:teuthology.orchestra.run.smithi089.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_alien_op_num_threads": "6", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_osd_stat_interval": "0", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_seastar_cpu_cores": "", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_seastar_num_threads": "0", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_location": "", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_location_hook": "", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_location_hook_timeout": "10", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "daemonize": "false", 2024-09-14T08:39:15.977 INFO:teuthology.orchestra.run.smithi089.stdout: "daos_pool": "tank", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_alienstore": "0/5", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_allow_any_pool_priority": "false", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_asok": "1/5", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_asok_assert_abort": "false", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_asserts_on_shutdown": "true", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_auth": "20/20", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_bdev": "1/3", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_bluefs": "1/5", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_bluestore": "1/5", 2024-09-14T08:39:15.978 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_buffer": "0/1", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_ceph_dedup": "0/5", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_ceph_exporter": "1/5", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_cephfs_mirror": "0/5", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_cephsqlite": "0/5", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_client": "0/5", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_compressor": "1/5", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_context": "0/1", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_crimson_interrupt": "0/5", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_crush": "1/1", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_crypto": "1/5", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_cyanstore": "0/5", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_deliberately_leak_memory": "false", 2024-09-14T08:39:15.979 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_disable_randomized_ping": "false", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_dpdk": "1/5", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_eventtrace": "1/5", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_filer": "0/1", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_filestore": "1/3", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_finisher": "1/1", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_fuse": "1/5", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_heartbeat_testing_span": "0", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_heartbeatmap": "1/5", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_javaclient": "1/5", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_journal": "1/3", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_journaler": "0/5", 2024-09-14T08:39:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_kstore": "1/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_lockdep": "0/1", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mclock": "1/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds": "1/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_balancer": "1/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_locker": "1/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_log": "1/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_log_expire": "1/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_migrator": "1/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_quiesce": "3/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_memstore": "1/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mgr": "2/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mgrc": "1/5", 2024-09-14T08:39:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mon": "20/20", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_monc": "0/10", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_ms": "1/1", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_none": "0/5", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_objclass": "0/5", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_objectcacher": "0/5", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_objecter": "0/1", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_optracker": "0/5", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_osd": "1/5", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_paxos": "20/20", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_perfcounter": "1/5", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_prioritycache": "1/5", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rados": "0/5", 2024-09-14T08:39:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rbd": "0/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rbd_mirror": "0/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rbd_pwl": "0/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rbd_replay": "0/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_refs": "0/0", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_reserver": "1/1", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw": "1/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_access": "1/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_datacache": "1/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_dbstore": "1/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_flight": "1/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_notification": "1/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_sync": "1/5", 2024-09-14T08:39:15.983 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rocksdb": "4/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_backref": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_cache": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_cleaner": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_device": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_epm": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_journal": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_lba": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_odata": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_omap": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_onode": "0/5", 2024-09-14T08:39:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_t": "0/5", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_tm": "0/5", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_striper": "0/1", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_test": "0/5", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_throttle": "1/1", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_timer": "0/1", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_tp": "0/5", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_trace": "1/5", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "device_failure_prediction_mode": "none", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-14T08:39:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: "err_to_graylog": "false", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "err_to_journald": "false", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "err_to_stderr": "true", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "err_to_syslog": "false", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event_tracing": "false", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_addr": "0.0.0.0", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_cert_file": "", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_http_port": "9926", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_key_file": "", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_prio_limit": "5", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_sort_metrics": "true", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_stats_period": "5", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "fake_statfs_for_testing": "0", 2024-09-14T08:39:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: "fatal_signal_handlers": "true", 2024-09-14T08:39:15.987 INFO:teuthology.orchestra.run.smithi089.stdout: "filer_max_purge_ops": "10", 2024-09-14T08:39:15.987 INFO:teuthology.orchestra.run.smithi089.stdout: "filer_max_truncate_ops": "128", 2024-09-14T08:39:15.987 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_apply_finisher_threads": "1", 2024-09-14T08:39:15.987 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_blackhole": "false", 2024-09-14T08:39:15.987 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_btrfs_clone_range": "true", 2024-09-14T08:39:15.987 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_btrfs_snap": "true", 2024-09-14T08:39:15.987 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_caller_concurrency": "10", 2024-09-14T08:39:15.987 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_collect_device_partition_information": "true", 2024-09-14T08:39:15.987 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_commit_timeout": "600.000000", 2024-09-14T08:39:15.987 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_debug_inject_read_err": "false", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_debug_omap_check": "false", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_debug_verify_split": "false", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_dump_file": "", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fadvise": "true", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fail_eio": "true", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fd_cache_shards": "16", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fd_cache_size": "128", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fiemap": "false", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fiemap_threshold": "4096", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-14T08:39:15.988 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_inject_stall": "0", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_journal_parallel": "false", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_journal_trailing": "false", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_journal_writeahead": "false", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_kill_at": "0", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattrs": "0", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-14T08:39:15.989 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_xattr_value_size": "0", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_merge_threshold": "-10", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_odsync_write": "false", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_omap_backend": "rocksdb", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_omap_backend_path": "", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-14T08:39:15.990 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_op_thread_timeout": "60", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_op_threads": "2", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_punch_hole": "false", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_max_ops": "50", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-14T08:39:15.991 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_seek_data_hole": "false", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_sloppy_crc": "false", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_splice": "false", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_split_multiple": "2", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_split_rand_factor": "20", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_update_to": "1000", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_enable": "true", 2024-09-14T08:39:15.992 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_xfs_extsize": "false", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_zfs_snap": "false", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "fio_dir": "/tmp/fio", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "57b092b7-5550-41a0-8f78-531de0e7c469", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_allow_other": "true", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_atomic_o_trunc": "true", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_big_writes": "true", 2024-09-14T08:39:15.993 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_debug": "false", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_default_permissions": "false", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_disable_pagecache": "false", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_max_write": "0", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_multithreaded": "true", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_require_active_mds": "true", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_set_user_groups": "true", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_splice_move": "true", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_splice_read": "true", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_splice_write": "true", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_use_invalidate_cb": "true", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "gss_target_name": "ceph", 2024-09-14T08:39:15.994 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_file": "", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_inject_failure": "0", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_interval": "5", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "host": "smithi089", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-14T08:39:15.995 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "inject_early_sigterm": "false", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "jaeger_agent_port": "6799", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "jaeger_tracing_enable": "false", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_aio": "true", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_align_min_size": "65536", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_block_align": "true", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_block_size": "4096", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_dio": "true", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_discard": "false", 2024-09-14T08:39:15.996 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_force_aio": "false", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_ignore_corruption": "false", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_max_write_bytes": "10485760", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_max_write_entries": "100", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_replay_from": "0", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_write_header_frequency": "0", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_zero_on_create": "false", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journaler_prefetch_periods": "10", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journaler_prezero_periods": "5", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "journaler_write_head_interval": "15", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "", 2024-09-14T08:39:15.997 INFO:teuthology.orchestra.run.smithi089.stdout: "keyfile": "", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_backend": "rocksdb", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_default_stripe_size": "65536", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_fsck_on_mount": "false", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_max_bytes": "67108864", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_max_ops": "512", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_nid_prealloc": "1024", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_onode_map_size": "1024", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_sync_submit_transaction": "false", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_sync_transaction": "false", 2024-09-14T08:39:15.998 INFO:teuthology.orchestra.run.smithi089.stdout: "librados_thread_count": "2", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "lockdep": "false", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "lockdep_force_backtrace": "false", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_coarse_timestamps": "true", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_flush_on_exit": "false", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_graylog_host": "127.0.0.1", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_graylog_port": "12201", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_max_new": "1000", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_max_recent": "10000", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_stderr_prefix": "", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_stop_at_utilization": "0.970000", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_to_file": "true", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_to_graylog": "false", 2024-09-14T08:39:15.999 INFO:teuthology.orchestra.run.smithi089.stdout: "log_to_journald": "false", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "log_to_stderr": "false", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "log_to_syslog": "false", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "max_rotating_auth_attempts": "10", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_action_on_write_error": "1", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_alternate_name_max": "8192", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_asio_thread_count": "2", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_export_pin": "true", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_fragment_dirs": "true", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_fragment_interval": "5", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-14T08:39:16.000 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_interval": "10", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_max": "-1", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_max_until": "-1", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_merge_size": "50", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_midchunk": "0.300000", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_min_start": "0.200000", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_minchunk": "0.001000", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_mode": "0", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_need_max": "1.200000", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_need_min": "0.800000", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_overload_epochs": "2", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-14T08:39:16.001 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_split_bits": "3", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_split_size": "10000", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_target_decay": "10.000000", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_beacon_grace": "15.000000", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_beacon_interval": "4.000000", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_mid": "0.700000", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-14T08:39:16.002 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_quiesce_delay": "0", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_release_free_interval": "10", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_reservation": "0.050000", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_trim_interval": "1", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_trim_threshold": "262144", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_client_prealloc_inos": "1000", 2024-09-14T08:39:16.003 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_connect_bootstrapping": "false", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_damage_table_max_entries": "10000", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_debug_auth_pins": "false", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_debug_frag": "false", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_debug_scatterstat": "false", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_debug_subtrees": "false", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_decay_halflife": "5.000000", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_default_dir_hash": "2", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_defer_session_stale": "true", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_deny_all_reconnect": "false", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dir_keys_per_op": "16384", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dir_max_commit_size": "10", 2024-09-14T08:39:16.004 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dir_max_entries": "0", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dir_prefetch": "true", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dump_cache_on_map": "false", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_early_reply": "true", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_enable_op_tracker": "true", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_enforce_unique_name": "true", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_export_ephemeral_random": "true", 2024-09-14T08:39:16.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_health_summarize_threshold": "10", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_health_dummy": "false", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-14T08:39:16.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_migrator_session_race": "false", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_join_fs": "", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_journal_format": "1", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_create_at": "0", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_dirfrag_at": "0", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_export_at": "0", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_import_at": "0", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_journal_at": "0", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_journal_expire_at": "0", 2024-09-14T08:39:16.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_journal_replay_at": "0", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_link_at": "0", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_mdstable_at": "0", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_openc_at": "0", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_rename_at": "0", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_shutdown_at": "0", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_event_large_threshold": "524288", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_events_per_segment": "1024", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_max_events": "-1", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_max_segments": "128", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_pause": "false", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_segment_size": "0", 2024-09-14T08:39:16.008 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_trim_threshold": "128", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_warn_factor": "2.000000", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_caps_per_client": "1048576", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_completed_flushes": "100000", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_completed_requests": "100000", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_export_size": "20971520", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_file_recover": "32", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_purge_files": "64", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_purge_ops": "8192", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-14T08:39:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_snaps_per_dir": "100", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_metrics_update_interval": "2", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_min_caps_per_client": "100", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_min_caps_working_set": "10000", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_numa_node": "-1", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_complaint_time": "30.000000", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_history_duration": "600", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_history_size": "20", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_history_slow_op_size": "20", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_log_threshold": "5", 2024-09-14T08:39:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_ping_grace": "15", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_ping_interval": "5", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_max_caps": "30000", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_warning_threshold": "262144", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_replay_interval": "1.000000", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-14T08:39:16.011 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_root_ino_gid": "0", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_root_ino_uid": "0", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_scrub_stats_review_period": "1", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-14T08:39:16.012 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_shutdown_check": "0", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_skip_ino": "0", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_snap_max_uid": "4294967294", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_snap_min_uid": "0", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_snap_rstat": "false", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_standby_replay_damaged": "false", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_symlink_recovery": "true", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_thrash_exports": "0", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_thrash_fragments": "0", 2024-09-14T08:39:16.013 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_tick_interval": "5.000000", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_valgrind_exit": "false", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_verify_backtrace": "1", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_verify_scatter": "false", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_wipe_sessions": "false", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "mempool_debug": "false", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "memstore_device_bytes": "1073741824", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "memstore_page_set": "false", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "memstore_page_size": "65536", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_client_bytes": "134217728", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_client_messages": "512", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-14T08:39:16.014 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_disabled_modules": "", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_enable_op_tracker": "true", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_max_pg_creating": "1024", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_max_pg_num_change": "128", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_mds_bytes": "134217728", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_mds_messages": "128", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_mon_bytes": "134217728", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_mon_messages": "128", 2024-09-14T08:39:16.015 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_op_history_duration": "600", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_op_history_size": "20", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_op_log_threshold": "5", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_osd_bytes": "536870912", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_osd_messages": "8192", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_pool": "true", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_standby_modules": "true", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_stats_period": "5", 2024-09-14T08:39:16.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_stats_threshold": "5", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_tick_period": "2", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_allow_pool_delete": "true", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_allow_pool_size_one": "true", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_auth_validate_all_caps": "true", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_bytes": "104857600", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_directed_command_retry": "5", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-14T08:39:16.017 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_hunt_parallel": "3", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_log_interval": "1.000000", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_ping_interval": "10.000000", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_target_rank": "-1", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_level": "debug", 2024-09-14T08:39:16.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_file": "true", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_journald": "false", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_compact_on_bootstrap": "false", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_compact_on_start": "false", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_compact_on_trim": "true", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-14T08:39:16.019 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cpu_threads": "4", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_crush_min_required_version": "hammer", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_daemon_bytes": "419430400", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_data_avail_crit": "5", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_data_avail_warn": "5", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_data_size_warn": "16106127360", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_dump_json": "false", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_dump_transactions": "false", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_extra_checks": "false", 2024-09-14T08:39:16.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_no_require_reef": "false", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_no_require_squid": "false", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_down_mkfs_grace": "120", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_down_uptime_grace": "60", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_election_default_strategy": "1", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_election_timeout": "5.000000", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_elector_ping_divisor": "2", 2024-09-14T08:39:16.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_enable_op_tracker": "true", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_fake_pool_delete": "false", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_force_quorum_join": "false", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_globalid_prealloc": "10000", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_detail_to_clog": "false", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_log_update_period": "5", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_max_detail": "50", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_to_clog": "true", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_to_clog_interval": "600", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-14T08:39:16.022 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_host": "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],172.21.15.112", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_host_override": "", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_initial_members": "", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_lease": "5.000000", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_log_full_interval": "50", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_log_max": "10000", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_log_max_summary": "50", 2024-09-14T08:39:16.023 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_log_epochs": "500", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_osd": "10000", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_pg_per_osd": "10000", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_pool_pg_num": "65536", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mds_force_trim_to": "0", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mds_skip_sanity": "false", 2024-09-14T08:39:16.024 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_memory_autotune": "true", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_memory_target": "2147483648", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_beacon_grace": "30", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_digest_period": "5", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_inactive_grace": "60", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_min_osdmap_epochs": "500", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_complaint_time": "30", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_history_duration": "600", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_history_size": "20", 2024-09-14T08:39:16.025 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_history_slow_op_size": "20", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_log_threshold": "5", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_auto_mark_in": "false", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_cache_size": "500", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-14T08:39:16.026 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_down_out_interval": "600", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_force_trim_to": "0", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_min_down_reporters": "2", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-14T08:39:16.027 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_report_timeout": "900", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-14T08:39:16.028 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_stuck_threshold": "60", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_probe_timeout": "2.000000", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_reweight_max_change": "0.050000", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_reweight_max_osds": "4", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-14T08:39:16.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_scrub_interval": "86400", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_scrub_max_keys": "100", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_scrub_timeout": "300", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_session_timeout": "300", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_smart_report_timeout": "5", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_stat_smooth_intervals": "6", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_stretch_pool_min_size": "2", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_stretch_pool_size": "4", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-14T08:39:16.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_debug": "false", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_provider_kill_at": "0", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_requester_kill_at": "0", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_timeout": "60.000000", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_target_pg_per_osd": "100", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_tick_interval": "5", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_timecheck_interval": "300.000000", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_use_min_delay_socket": "false", 2024-09-14T08:39:16.031 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_older_version_delay": "604800", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_misplaced": "false", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_older_version": "true", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-14T08:39:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-14T08:39:16.033 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-14T08:39:16.033 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-14T08:39:16.033 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-14T08:39:16.033 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-14T08:39:16.033 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-14T08:39:16.033 INFO:teuthology.orchestra.run.smithi089.stdout: "monmap": "", 2024-09-14T08:39:16.033 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-14T08:39:16.033 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-14T08:39:16.033 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_tracing_enabled": "false", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_op_threads": "3", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_cm": "false", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_device_name": "", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_dscp": "96", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_local_gid": "", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-14T08:39:16.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_port_num": "1", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_sl": "3", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_support_srq": "true", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_type": "ib", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_reap_threshold": "5", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_before_connect": "false", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_ipv4": "true", 2024-09-14T08:39:16.035 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_ipv6": "false", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_msgr1": "true", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_msgr2": "true", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_port_max": "7568", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_port_min": "6800", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_retry_count": "3", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_retry_delay": "5", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_blackhole_client": "false", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_blackhole_mds": "false", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_blackhole_mgr": "false", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_blackhole_mon": "false", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_blackhole_osd": "false", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_client_mode": "crc secure", 2024-09-14T08:39:16.036 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_cluster_mode": "crc secure", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_cluster_type": "", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_compress_secure": "false", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_connection_idle_timeout": "900", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_connection_ready_timeout": "10", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_crc_data": "true", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_crc_header": "true", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_die_on_bad_msg": "false", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_die_on_bug": "true", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_die_on_old_message": "true", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_die_on_skipped_message": "false", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-14T08:39:16.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_coremask": "0xF", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_enable_tso": "true", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_hugepages": "", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_lro": "true", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_memory_channel": "4", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-14T08:39:16.038 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_pmd": "", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_port_id": "0", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dump_on_send": "false", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_initial_backoff": "0.200000", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_delay_max": "1.000000", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_delay_type": "", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_network_congestion": "0", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_socket_failures": "5000", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_learn_addr_from_peer": "true", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_max_accept_failures": "4", 2024-09-14T08:39:16.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_max_backoff": "15.000000", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_mon_client_mode": "secure crc", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_mon_service_mode": "secure crc", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_osd_compress_min_size": "1024", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_osd_compress_mode": "none", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_pq_min_cost": "65536", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_public_type": "", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_service_mode": "crc secure", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_tcp_listen_backlog": "512", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_tcp_nodelay": "true", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-14T08:39:16.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_tcp_rcvbuf": "0", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_type": "async+posix", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "no_config_file": "false", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_completion_locks_per_session": "32", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_inflight_ops": "1024", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_tick_interval": "5.000000", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_timeout": "10.000000", 2024-09-14T08:39:16.041 INFO:teuthology.orchestra.run.smithi089.stdout: "objectstore_blackhole": "false", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "openssl_engine_opts": "", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_delay_time": "5.000000", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_hist_halflife": "1000", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_max_low_ops": "2", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_max_ops": "4", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_slop": "0.020000", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_asio_thread_count": "2", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_async_recovery_min_cost": "100", 2024-09-14T08:39:16.042 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backfill_scan_max": "512", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backfill_scan_min": "64", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backoff_on_degraded": "false", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backoff_on_peering": "false", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backoff_on_unfound": "true", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_beacon_report_interval": "300", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bench_duration": "30", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bench_max_block_size": "67108864", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_blkin_trace_all": "false", 2024-09-14T08:39:16.043 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_check_for_log_corruption": "false", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_class_update_on_start": "true", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_client_message_cap": "256", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_client_message_size_cap": "524288000", 2024-09-14T08:39:16.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_client_op_priority": "63", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_client_watch_timeout": "30", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_command_max_records": "256", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_compact_on_start": "false", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_crush_update_on_start": "true", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_crush_update_weight_set": "true", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-14T08:39:16.045 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_feed_pullee": "-1", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_misdirected_ops": "false", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_no_acting_change": "false", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_no_purge_strays": "false", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_op_order": "false", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-14T08:39:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_shutdown": "false", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_trim_objects": "false", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_verify_snaps": "false", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_keys": "1024", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_stride": "524288", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-14T08:39:16.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_default_notify_timeout": "30", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_delete_sleep": "0.000000", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_discard_disconnected_ops": "true", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_ec_partial_reads": "true", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_enable_op_tracker": "true", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_fast_info": "true", 2024-09-14T08:39:16.048 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_fast_shutdown": "true", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_function_tracing": "false", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_grace": "20", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_interval": "6", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_min_peers": "10", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_min_size": "2000", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_stale": "600", 2024-09-14T08:39:16.049 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_hit_set_max_size": "100000", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_hit_set_min_size": "1000", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_journal_size": "5120", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_kill_backfill_at": "0", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_map_cache_size": "50", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_map_dedup": "true", 2024-09-14T08:39:16.050 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_map_message_max": "40", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_map_share_max_epochs": "40", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_attr_name_len": "100", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_attr_size": "0", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_backfills": "1", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_markdown_count": "5", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_markdown_period": "600", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_object_name_len": "2048", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_object_namespace_len": "256", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_object_size": "134217728", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-14T08:39:16.051 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_pg_blocked_by": "16", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_pg_log_entries": "10000", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_pgls": "1024", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_push_cost": "8388608", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_push_objects": "10", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_scrubs": "3", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_trimming_pgs": "2", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_write_op_reply_len": "64", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_write_size": "90", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-14T08:39:16.052 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_profile": "balanced", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-14T08:39:16.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_base": "805306368", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_cache_min": "134217728", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_target": "4294967296", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_target_autotune": "false", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_min_pg_log_entries": "250", 2024-09-14T08:39:16.054 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_min_recovery_priority": "0", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mon_report_interval": "5", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_num_cache_shards": "32", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_num_op_tracker_shard": "32", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_numa_auto_affinity": "true", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_numa_node": "-1", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_numa_prefer_iface": "true", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_objecter_finishers": "1", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_objectstore": "bluestore", 2024-09-14T08:39:16.055 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_objectstore_fuse": "false", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_objectstore_tracing": "false", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_complaint_time": "30.000000", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_history_duration": "600", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_history_size": "20", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_history_slow_op_size": "20", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_log_threshold": "5", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_shards": "0", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_shards_hdd": "5", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_shards_ssd": "8", 2024-09-14T08:39:16.056 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-14T08:39:16.057 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-14T08:39:16.057 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-14T08:39:16.057 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-14T08:39:16.057 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_pq_min_cost": "65536", 2024-09-14T08:39:16.057 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-14T08:39:16.057 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_queue_cut_off": "high", 2024-09-14T08:39:16.057 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-14T08:39:16.057 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_thread_timeout": "15", 2024-09-14T08:39:16.057 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_open_classes_on_start": "true", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_os_flags": "0", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_peering_op_priority": "255", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_delete_cost": "1048576", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_delete_priority": "5", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_log_trim_max": "10000", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_log_trim_min": "100", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-14T08:39:16.058 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_crimson": "false", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-14T08:39:16.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flags": "0", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_min_size": "0", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_pg_num": "32", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_pgp_num": "0", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_read_ratio": "70", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_size": "2", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_type": "replicated", 2024-09-14T08:39:16.060 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-14T08:39:16.061 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-14T08:39:16.061 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_push_per_object_cost": "1000", 2024-09-14T08:39:16.061 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-14T08:39:16.061 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recover_clone_overlap": "true", 2024-09-14T08:39:16.061 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-14T08:39:16.061 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_cost": "20971520", 2024-09-14T08:39:16.061 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-14T08:39:16.062 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_active": "0", 2024-09-14T08:39:16.062 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-14T08:39:16.062 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-14T08:39:16.062 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-14T08:39:16.062 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-14T08:39:16.062 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_single_start": "1", 2024-09-14T08:39:16.062 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_op_priority": "3", 2024-09-14T08:39:16.062 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-14T08:39:16.062 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_priority": "5", 2024-09-14T08:39:16.062 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_sleep": "0.000000", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_repair_during_recovery": "false", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_requested_scrub_priority": "120", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_auto_repair": "false", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_begin_hour": "0", 2024-09-14T08:39:16.063 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_begin_week_day": "0", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_chunk_max": "25", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_chunk_min": "5", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_cost": "52428800", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_during_recovery": "false", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_end_hour": "0", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_end_week_day": "0", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_event_cost": "4096", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_invalid_stats": "true", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-14T08:39:16.064 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_max_preemptions": "5", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_priority": "5", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_sleep": "0.000000", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_skip_data_digest": "false", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_smart_report_timeout": "5", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_cost": "1048576", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_priority": "5", 2024-09-14T08:39:16.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_target_transaction_size": "30", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-14T08:39:16.066 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tracing": "false", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_use_stale_snap": "false", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "osdc_blkin_trace_all": "false", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_kill_at": "0", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_max_join_drift": "10", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_min": "500", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_min_wait": "0.050000", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_propose_interval": "1.000000", 2024-09-14T08:39:16.067 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_service_trim_max": "500", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_service_trim_min": "250", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_stash_full_interval": "25", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_trim_max": "500", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_trim_min": "250", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "perf": "true", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "-", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrv": "", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "public_bind_addr": "-", 2024-09-14T08:39:16.068 INFO:teuthology.orchestra.run.smithi089.stdout: "public_network": "", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "public_network_interface": "", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "qat_compressor_busy_polling": "false", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "qat_compressor_enabled": "false", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "qat_compressor_session_max_number": "256", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rados_mon_op_timeout": "0", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rados_osd_op_timeout": "0", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rados_tracing": "false", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_atime_update_interval": "60", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_balance_parent_reads": "false", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_balance_snap_reads": "false", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_blkin_trace_all": "false", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-14T08:39:16.069 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache": "true", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_policy": "writearound", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_size": "33554432", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_clone_copy_on_read": "false", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_compression_hint": "none", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_concurrent_management_ops": "10", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-14T08:39:16.070 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_clone_format": "auto", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_data_pool": "", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_features": "61", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_format": "2", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_map_options": "", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_order": "22", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_pool": "rbd", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_stripe_count": "0", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_stripe_unit": "0", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-14T08:39:16.071 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_enable_alloc_hint": "true", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_io_scheduler": "simple", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-14T08:39:16.072 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_order": "24", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_pool": "", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_splay_width": "4", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_localize_parent_reads": "false", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_localize_snap_reads": "false", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-14T08:39:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-14T08:39:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mtime_update_interval": "60", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_non_blocking_aio": "true", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_op_thread_timeout": "60", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_op_threads": "1", 2024-09-14T08:39:16.075 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_parent_cache_enabled": "false", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_plugins": "", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_bps_burst": "0", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_bps_limit": "0", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_exclude_ops": "0", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_iops_burst": "0", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_iops_limit": "0", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-14T08:39:16.076 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_read_from_replica_policy": "default", 2024-09-14T08:39:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_skip_partial_discard": "true", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_tracing": "false", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_validate_names": "true", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_validate_pool": "true", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "restapi_base_url": "", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "restapi_log_level": "", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-14T08:39:16.078 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_acl_grants_max_num": "100", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_admin_entry": "admin", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_asio_assert_yielding": "false", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_backend_store": "rados", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_barbican_url": "", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_beast_enable_async": "true", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_counters_cache": "false", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-14T08:39:16.079 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_cache_enabled": "true", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_cache_expiry_interval": "900", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_cache_lru_size": "25000", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_config_store": "rados", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_content_length_compat": "false", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_copy_obj_progress": "true", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_cors_rules_max_num": "100", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_cross_domain_policy": "", 2024-09-14T08:39:16.080 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_addr": "", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_password": "", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_username": "", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_require_ssl": "true", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-14T08:39:16.081 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_addr": "", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_auth": "token", 2024-09-14T08:39:16.082 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_namespace": "", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_prefix": "", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_token_file": "", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_curl_buffersize": "524288", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_curl_low_speed_time": "300", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-14T08:39:16.083 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-14T08:39:16.084 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_log_changes_size": "1000", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_log_num_shards": "128", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_log_window": "30", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-14T08:39:16.085 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_disable_s3select": "false", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-14T08:39:16.086 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dns_name": "", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dns_s3website_name": "", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dynamic_resharding": "true", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-14T08:39:16.087 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_gc_threads": "true", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_lc_threads": "true", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_mdsearch": "true", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_ops_log": "false", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_quota_threads": "true", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_static_website": "false", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_usage_log": "false", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enforce_swift_acls": "true", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_exit_timeout_secs": "120", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_expose_bucket": "false", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_extended_http_attrs": "", 2024-09-14T08:39:16.088 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_filter": "none", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_frontends": "beast port=7480", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_deferred": "50", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_objs": "32", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_processor_period": "3600", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-14T08:39:16.089 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_init_timeout": "300", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_kafka_connection_idle": "300", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_domain": "", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_password": "", 2024-09-14T08:39:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_password_path": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_project": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_tenant": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_token": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_token_path": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_user": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_barbican_domain": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_barbican_password": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_barbican_project": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_barbican_user": "", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-14T08:39:16.091 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_url": "", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_debug_interval": "-1", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_lock_max_time": "90", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_max_objs": "32", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_max_rules": "1000", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_max_worker": "3", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_thread_delay": "0", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_dnattr": "uid", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-14T08:39:16.092 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_searchfilter": "", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_uri": "", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_log_http_headers": "", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_log_object_name_utc": "false", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-14T08:39:16.093 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_attr_name_len": "0", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_attr_size": "0", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_chunk_size": "4194304", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_listing_results": "1000", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_notify_retries": "10", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_put_param_size": "1048576", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_put_size": "5368709120", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_slo_entries": "1000", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_md_log_max_shards": "64", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-14T08:39:16.094 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_mp_lock_max_time": "600", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_max_gc": "300", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-14T08:39:16.095 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_num_async_rados_threads": "32", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_num_control_oids": "8", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_numa_node": "-1", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_objexp_chunk_size": "100", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_objexp_gc_interval": "600", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-14T08:39:16.096 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_op_thread_timeout": "600", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_op_tracing": "false", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_opa_token": "", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_opa_url": "", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_opa_verify_ssl": "true", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ops_log_rados": "false", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ops_log_socket_path": "", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_period_push_interval": "2.000000", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-14T08:39:16.097 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_cache_lanes": "3", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_cache_partitions": "3", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_print_continue": "true", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-14T08:39:16.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_rados_tracing": "false", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_realm": "", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_realm_id": "", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_region": "", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_request_uri": "", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_batch_size": "64", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_max_aio": "128", 2024-09-14T08:39:16.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_num_logs": "16", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_thread_interval": "600", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_resolve_cname": "false", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_run_sync_thread": "true", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-14T08:39:16.100 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_scheduler_type": "throttler", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_script_uri": "", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_service_provider_name": "", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_client_id": "", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_client_secret": "", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_entry": "sts", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_key": "sts", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_min_session_duration": "900", 2024-09-14T08:39:16.101 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_token_introspection_url": "", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_account_in_url": "false", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_auth_entry": "auth", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_auth_url": "", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_custom_header": "", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_need_stats": "true", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_tenant_name": "", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_token_expiration": "86400", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_url": "", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_url_prefix": "swift", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_lease_period": "120", 2024-09-14T08:39:16.102 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-14T08:39:16.103 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-14T08:39:16.103 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-14T08:39:16.103 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-14T08:39:16.103 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-14T08:39:16.103 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-14T08:39:16.103 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-14T08:39:16.103 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-14T08:39:16.103 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-14T08:39:16.103 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_thread_pool_size": "512", 2024-09-14T08:39:16.103 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_comment": "", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_createby": "", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_encoding": "", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_flag": "false", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_origin": "", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_tracker": "", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_trust_forwarded_https": "false", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-14T08:39:16.104 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_usage_max_shards": "32", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_usage_max_user_shards": "1", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_use_opa_authz": "false", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_counters_cache": "false", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_max_buckets": "1000", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_policies_max_num": "100", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-14T08:39:16.105 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_unique_email": "true", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_verify_ssl": "true", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zone": "", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zone_id": "", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zonegroup": "", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zonegroup_id": "", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgwlc_auto_session_clear": "true", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_block_size": "4096", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-14T08:39:16.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_size": "536870912", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_index_type": "binary_search", 2024-09-14T08:39:16.107 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_partition_filters": "false", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_perf": "false", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "run_dir": "/var/run/ceph", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_block_create": "true", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_cache_lru_size": "67108864", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-14T08:39:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_default_max_object_size": "16777216", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_device_size": "53687091200", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_full_integrity_check": "false", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_journal_batch_capacity": "16", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_main_device_type": "SSD", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-14T08:39:16.109 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_segment_size": "67108864", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "set_keepcaps": "false", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "setgroup": "", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "setuser": "", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "setuser_match_path": "", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "thp": "false", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "threadpool_default_timeout": "60", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "throttler_perf_counter": "true", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "tmp_dir": "/tmp", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-14T08:39:16.110 INFO:teuthology.orchestra.run.smithi089.stdout: "uadk_compressor_enabled": "false", 2024-09-14T08:39:16.111 INFO:teuthology.orchestra.run.smithi089.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-14T08:39:16.111 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:16.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-14T08:39:16.252 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a: {} 2024-09-14T08:39:16.252 INFO:teuthology.orchestra.run.smithi089.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T08:39:16.265 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b: {} 2024-09-14T08:39:16.265 INFO:teuthology.orchestra.run.smithi089.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T08:39:16.275 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c: {} 2024-09-14T08:39:16.275 INFO:teuthology.orchestra.run.smithi089.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T08:39:16.290 DEBUG:teuthology.orchestra.run.smithi089:> type ceph-objectstore-tool 2024-09-14T08:39:16.294 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T08:39:16.295 DEBUG:teuthology.orchestra.run.smithi112:> type ceph-objectstore-tool 2024-09-14T08:39:16.300 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T08:39:16.301 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-14T08:39:16.337 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-14T08:39:16.337 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-14T08:39:16.337 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T08:39:16.337 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:39:16.338 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T08:39:16.338 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T08:39:16.338 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-14T08:39:16.339 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-14T08:39:16.339 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:39:16.339 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-14T08:39:16.339 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:16.340 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-14T08:39:16.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:39:16.340 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 6000 -M pool_client.0 image_client.0 2024-09-14T08:39:16.344 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:16.351+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:16.407 INFO:teuthology.orchestra.run.smithi188.stdout:mapped writes DISABLED 2024-09-14T08:39:16.408 INFO:teuthology.orchestra.run.smithi188.stdout:mapped reads DISABLED 2024-09-14T08:39:16.408 INFO:teuthology.orchestra.run.smithi188.stdout:Seed set to 3122 2024-09-14T08:39:16.408 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-nbd mode enabled 2024-09-14T08:39:16.440 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:16.444+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:16.456 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:16.456 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:16.456 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:16.456 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:16.474 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:16.482 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:16.482 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:16.509 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:16.509 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:16.527 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:16.528 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:16.541 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:16.544+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:16.548 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:16.549 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:16.569 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:16.570 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:16.591 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:16.593 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:16.593 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:16.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:16.642 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:16.647+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:16.656 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:16.656 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:16.656 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 20, 2024-09-14T08:39:16.656 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "57b092b7-5550-41a0-8f78-531de0e7c469", 2024-09-14T08:39:16.656 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-09-14T08:38:48.610112+0000", 2024-09-14T08:39:16.656 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-09-14T08:39:13.320204+0000", 2024-09-14T08:39:16.656 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-09-14T08:39:00.908063+0000", 2024-09-14T08:39:16.656 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-09-14T08:38:51.099971+0000", 2024-09-14T08:39:16.656 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T08:39:16.656 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5799936, 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 5, 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 2, 2024-09-14T08:39:16.657 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 6, 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "jewel", 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:00.306403+0000", 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:39:16.658 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-09-14T08:39:16.659 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "15", 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:39:16.660 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:39:16.661 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:39:16.662 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.663 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:39:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-09-14T08:39:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:39:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:39:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 6.059999942779541, 2024-09-14T08:39:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 6.059999942779541, 2024-09-14T08:39:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T08:39:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-09-14T08:39:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 1, 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 1 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:06.370159+0000", 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:39:16.665 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-09-14T08:39:16.666 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:39:16.667 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 2, 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 19, 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:39:16.668 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:39:16.669 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:39:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.25, 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.25, 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 1, 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2.25, 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2.25, 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 1, 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 1 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:39:16.671 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d", 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 0, 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.672 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6800", 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6801", 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6802", 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6803", 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:16.674 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.675 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.675 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6806", 2024-09-14T08:39:16.675 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:16.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.675 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.675 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6807", 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6804", 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6805", 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6801/2282442554", 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6803/2282442554", 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6807/2282442554", 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6805/2282442554", 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:16.677 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "09ba1390-a0d1-48a3-9342-5f5aa64e2217", 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:39:16.678 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 16, 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6808", 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6809", 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:16.679 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6810", 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.680 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6811", 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6814", 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.681 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6815", 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6812", 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6813", 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6809/2739597491", 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6811/2739597491", 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6815/2739597491", 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6813/2739597491", 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:16.683 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "a7cd8610-d8e1-44e7-a423-4419cad90d8e", 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:39:16.684 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 16, 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6816", 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.685 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817", 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818", 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819", 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6822", 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:16.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6823", 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6820", 2024-09-14T08:39:16.688 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6821", 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6817/1157205327", 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6819/1157205327", 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6823/1157205327", 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6821/1157205327", 2024-09-14T08:39:16.689 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "1339fb05-5d1c-4c0a-8388-314119543bb6", 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:16.690 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 16, 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6808", 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:16.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6809", 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.692 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6810", 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6811", 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.693 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6814", 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6815", 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6812", 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6813", 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6809/1656791341", 2024-09-14T08:39:16.695 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6811/1656791341", 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6815/1656791341", 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6813/1656791341", 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "0cebba54-9019-47bd-870f-306664e390e1", 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:16.696 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 0, 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6816", 2024-09-14T08:39:16.697 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6817", 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6818", 2024-09-14T08:39:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6819", 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6822", 2024-09-14T08:39:16.699 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6823", 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6820", 2024-09-14T08:39:16.700 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6821", 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6817/1186206237", 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6819/1186206237", 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6823/1186206237", 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6821/1186206237", 2024-09-14T08:39:16.701 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "e571e73b-0e9d-417d-b01c-59b651016763", 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:16.702 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 16, 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6800", 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6801", 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:16.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6802", 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6803", 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6806", 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6807", 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6804", 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:16.706 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6805", 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6801/796623465", 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6803/796623465", 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6807/796623465", 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6805/796623465", 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.707 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.174731+0000", 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.475467+0000", 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.606174+0000", 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:16.710 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.835957+0000", 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.753547+0000", 2024-09-14T08:39:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.284212+0000", 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:16.712 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [], 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [], 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-09-14T08:39:16.713 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [ 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: "snaps": [ 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: "begin": 2, 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: "length": 1 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.714 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:16.715 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:16.717 INFO:tasks.thrashosds.thrasher:j is {'epoch': 20, 'fsid': '57b092b7-5550-41a0-8f78-531de0e7c469', 'created': '2024-09-14T08:38:48.610112+0000', 'modified': '2024-09-14T08:39:13.320204+0000', 'last_up_change': '2024-09-14T08:39:00.908063+0000', 'last_in_change': '2024-09-14T08:38:51.099971+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T08:39:00.306403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T08:39:06.370159+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 2282442554}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 2282442554}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 2282442554}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 2282442554}]}, 'public_addr': '172.21.15.89:6801/2282442554', 'cluster_addr': '172.21.15.89:6803/2282442554', 'heartbeat_back_addr': '172.21.15.89:6807/2282442554', 'heartbeat_front_addr': '172.21.15.89:6805/2282442554', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '09ba1390-a0d1-48a3-9342-5f5aa64e2217', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6808', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6809', 'nonce': 2739597491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6810', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6811', 'nonce': 2739597491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6814', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6815', 'nonce': 2739597491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6812', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6813', 'nonce': 2739597491}]}, 'public_addr': '172.21.15.89:6809/2739597491', 'cluster_addr': '172.21.15.89:6811/2739597491', 'heartbeat_back_addr': '172.21.15.89:6815/2739597491', 'heartbeat_front_addr': '172.21.15.89:6813/2739597491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a7cd8610-d8e1-44e7-a423-4419cad90d8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6816', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6817', 'nonce': 1157205327}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6818', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 1157205327}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6822', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6823', 'nonce': 1157205327}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6820', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6821', 'nonce': 1157205327}]}, 'public_addr': '172.21.15.89:6817/1157205327', 'cluster_addr': '172.21.15.89:6819/1157205327', 'heartbeat_back_addr': '172.21.15.89:6823/1157205327', 'heartbeat_front_addr': '172.21.15.89:6821/1157205327', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1339fb05-5d1c-4c0a-8388-314119543bb6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6808', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6809', 'nonce': 1656791341}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6810', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6811', 'nonce': 1656791341}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6814', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6815', 'nonce': 1656791341}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6812', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6813', 'nonce': 1656791341}]}, 'public_addr': '172.21.15.112:6809/1656791341', 'cluster_addr': '172.21.15.112:6811/1656791341', 'heartbeat_back_addr': '172.21.15.112:6815/1656791341', 'heartbeat_front_addr': '172.21.15.112:6813/1656791341', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0cebba54-9019-47bd-870f-306664e390e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6816', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6817', 'nonce': 1186206237}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6818', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6819', 'nonce': 1186206237}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6822', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6823', 'nonce': 1186206237}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6820', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6821', 'nonce': 1186206237}]}, 'public_addr': '172.21.15.112:6817/1186206237', 'cluster_addr': '172.21.15.112:6819/1186206237', 'heartbeat_back_addr': '172.21.15.112:6823/1186206237', 'heartbeat_front_addr': '172.21.15.112:6821/1186206237', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e571e73b-0e9d-417d-b01c-59b651016763', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 796623465}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 796623465}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 796623465}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 796623465}]}, 'public_addr': '172.21.15.112:6801/796623465', 'cluster_addr': '172.21.15.112:6803/796623465', 'heartbeat_back_addr': '172.21.15.112:6807/796623465', 'heartbeat_front_addr': '172.21.15.112:6805/796623465', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.174731+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.475467+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.606174+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.835957+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.753547+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.284212+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [{'pool': 2, 'snaps': [{'begin': 2, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T08:39:16.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:39:16.743 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:16.751+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:16.775 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:16.775 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:16.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:16.878 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:16.884+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:16.946 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:16.952+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:16.946 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:16.946 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:16.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:17.047 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:17.055+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:17.049 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:17.049 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:39:17.068 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T08:39:16.267424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168584,"kb_used_data":2236,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":566062456,"statfs":{"total":579820584960,"available":579647954944,"internally_reserved":0,"allocated":2289664,"data_stored":1535242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":170187424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.142031"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.710340+0000","last_change":"2024-09-14T08:39:10.710340+0000","last_active":"2024-09-14T08:39:10.710340+0000","last_peered":"2024-09-14T08:39:10.710340+0000","last_clean":"2024-09-14T08:39:10.710340+0000","last_became_active":"2024-09-14T08:39:08.202439+0000","last_became_peered":"2024-09-14T08:39:08.202439+0000","last_unstale":"2024-09-14T08:39:10.710340+0000","last_undegraded":"2024-09-14T08:39:10.710340+0000","last_fullsized":"2024-09-14T08:39:10.710340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:23.410553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001636462,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.138177+0000","last_change":"2024-09-14T08:39:10.138177+0000","last_active":"2024-09-14T08:39:10.138177+0000","last_peered":"2024-09-14T08:39:10.138177+0000","last_clean":"2024-09-14T08:39:10.138177+0000","last_became_active":"2024-09-14T08:39:08.132530+0000","last_became_peered":"2024-09-14T08:39:08.132530+0000","last_unstale":"2024-09-14T08:39:10.138177+0000","last_undegraded":"2024-09-14T08:39:10.138177+0000","last_fullsized":"2024-09-14T08:39:10.138177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:17.902057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.709775+0000","last_change":"2024-09-14T08:39:10.709775+0000","last_active":"2024-09-14T08:39:10.709775+0000","last_peered":"2024-09-14T08:39:10.709775+0000","last_clean":"2024-09-14T08:39:10.709775+0000","last_became_active":"2024-09-14T08:39:08.126303+0000","last_became_peered":"2024-09-14T08:39:08.126303+0000","last_unstale":"2024-09-14T08:39:10.709775+0000","last_undegraded":"2024-09-14T08:39:10.709775+0000","last_fullsized":"2024-09-14T08:39:10.709775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:58.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.138175+0000","last_change":"2024-09-14T08:39:10.138175+0000","last_active":"2024-09-14T08:39:10.138175+0000","last_peered":"2024-09-14T08:39:10.138175+0000","last_clean":"2024-09-14T08:39:10.138175+0000","last_became_active":"2024-09-14T08:39:08.128925+0000","last_became_peered":"2024-09-14T08:39:08.128925+0000","last_unstale":"2024-09-14T08:39:10.138175+0000","last_undegraded":"2024-09-14T08:39:10.138175+0000","last_fullsized":"2024-09-14T08:39:10.138175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:02.017543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T08:39:13.497827+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:13.497827+0000","last_peered":"2024-09-14T08:39:13.497827+0000","last_clean":"2024-09-14T08:39:13.497827+0000","last_became_active":"2024-09-14T08:39:08.130091+0000","last_became_peered":"2024-09-14T08:39:08.130091+0000","last_unstale":"2024-09-14T08:39:13.497827+0000","last_undegraded":"2024-09-14T08:39:13.497827+0000","last_fullsized":"2024-09-14T08:39:13.497827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:12.463612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.688857+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:39:10.688857+0000","last_peered":"2024-09-14T08:39:10.688857+0000","last_clean":"2024-09-14T08:39:10.688857+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:39:10.688857+0000","last_undegraded":"2024-09-14T08:39:10.688857+0000","last_fullsized":"2024-09-14T08:39:10.688857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.709726+0000","last_change":"2024-09-14T08:39:10.709726+0000","last_active":"2024-09-14T08:39:10.709726+0000","last_peered":"2024-09-14T08:39:10.709726+0000","last_clean":"2024-09-14T08:39:10.709726+0000","last_became_active":"2024-09-14T08:39:08.129482+0000","last_became_peered":"2024-09-14T08:39:08.129482+0000","last_unstale":"2024-09-14T08:39:10.709726+0000","last_undegraded":"2024-09-14T08:39:10.709726+0000","last_fullsized":"2024-09-14T08:39:10.709726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.464996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010748229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T08:39:13.497827+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:13.497827+0000","last_peered":"2024-09-14T08:39:13.497827+0000","last_clean":"2024-09-14T08:39:13.497827+0000","last_became_active":"2024-09-14T08:39:08.129594+0000","last_became_peered":"2024-09-14T08:39:08.129594+0000","last_unstale":"2024-09-14T08:39:13.497827+0000","last_undegraded":"2024-09-14T08:39:13.497827+0000","last_fullsized":"2024-09-14T08:39:13.497827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:50.092003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001084296,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T08:39:10.708440+0000","last_change":"2024-09-14T08:39:01.959798+0000","last_active":"2024-09-14T08:39:10.708440+0000","last_peered":"2024-09-14T08:39:10.708440+0000","last_clean":"2024-09-14T08:39:10.708440+0000","last_became_active":"2024-09-14T08:39:01.957890+0000","last_became_peered":"2024-09-14T08:39:01.957890+0000","last_unstale":"2024-09-14T08:39:10.708440+0000","last_undegraded":"2024-09-14T08:39:10.708440+0000","last_fullsized":"2024-09-14T08:39:10.708440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:18.555164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":180224,"data_stored":58372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":774144,"data_stored":648740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":53404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607559,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":62993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607560,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:39:17.069 INFO:tasks.thrashosds.thrasher:Setting 1.0 to [2, 4] 2024-09-14T08:39:17.069 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '1.0', '2', '4'] 2024-09-14T08:39:17.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 1.0 2 4 2024-09-14T08:39:17.111 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:17.111 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:17.124 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:17.166 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:17.172+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:17.249 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:17.255+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:17.276 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:17.276 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:17.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:17.350 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:17.356+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:17.352 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:39:17.405 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:17.405 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:17.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:17.452 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:17.459+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:17.553 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:17.559+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:17.563 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:17.563 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:17.576 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:17.654 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:17.660+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:17.697 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:17.697 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:17.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:17.755 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:17.763+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:17.844 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:17.844 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:17.856 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:17.863+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:17.858 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:17.957 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:17.960+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:18.026 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:18.026 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:18.040 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:18.087 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:18.095+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:18.158 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:18.164+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:18.163 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:18.163 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:18.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:18.267 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:18.275+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:18.345 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:18.345 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:18.356 INFO:teuthology.orchestra.run.smithi089.stderr:set 1.0 pg_upmap mapping to [2,4] 2024-09-14T08:39:18.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:18.361 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:18.364+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:18.461 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:18.464+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:18.519 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:18.520 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:18.533 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:18.579 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:18.587+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:18.617 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:39:18.650 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:18.650 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:18.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:18.664 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:18.671+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:18.764 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:18.768+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:18.765 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:18.781 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:18.781 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:18.799 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:18.799 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:18.819 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:18.819 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:18.829 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:18.829 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:18.839 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:18.839 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:18.843 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:18.858 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:18.859 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:18.865 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:18.868+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:18.963 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:18.963 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:18.963 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:18.963 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:18.963 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:18.966 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:18.971+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:18.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:19.067 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:19.075+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:19.144 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4212.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T08:39:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:08.124037+0000", 2024-09-14T08:39:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 11.027479186000001, 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092257620000000002, 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4212", 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.89:0/2943853097", 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124037+0000", 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124037+0000", 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124047+0000", 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9939999999999995e-06 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124058+0000", 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0329999999999999e-05 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124079+0000", 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1803000000000001e-05 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124100+0000", 2024-09-14T08:39:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0686000000000002e-05 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124285+0000", 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018461899999999999 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124305+0000", 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0216000000000001e-05 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.125957+0000", 2024-09-14T08:39:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016521660000000001 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.125980+0000", 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2860000000000001e-05 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.130171+0000", 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041906620000000004 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.130494+0000", 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000323741 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.130827+0000", 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033251199999999998 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133022+0000", 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021951309999999999 2024-09-14T08:39:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133117+0000", 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5116000000000002e-05 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133197+0000", 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9599999999999997e-05 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133263+0000", 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6326000000000002e-05 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4212.0:1 2.3 e17/16 ondisk, result = 0)", 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:08.132833+0000", 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 11.018683831000001, 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000201659, 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.132833+0000", 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.132833+0000", 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.132834+0000", 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7630000000000001e-06 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.132847+0000", 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2417e-05 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.132870+0000", 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3166000000000001e-05 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.132885+0000", 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4844000000000001e-05 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.132997+0000", 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011219500000000001 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133013+0000", 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6283999999999999e-05 2024-09-14T08:39:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133034+0000", 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0990000000000001e-05 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4212.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17)", 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:08.139833+0000", 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 11.011683271000001, 2024-09-14T08:39:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049818400000000004, 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4212", 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.89:0/2943853097", 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.139833+0000", 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.139833+0000", 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.139835+0000", 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1469999999999999e-06 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.139846+0000", 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1049999999999999e-05 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.139873+0000", 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6910000000000002e-05 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.139887+0000", 2024-09-14T08:39:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4039999999999999e-05 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.140034+0000", 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000147062 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.140331+0000", 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000296975 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4212.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17)", 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:08.140816+0000", 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 11.010700674000001, 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043988399999999998, 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4212", 2024-09-14T08:39:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.89:0/2943853097", 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.140816+0000", 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.140816+0000", 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.140818+0000", 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469999999999998e-06 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.140838+0000", 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9766e-05 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.140869+0000", 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1593000000000001e-05 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.140888+0000", 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8879999999999999e-05 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.141016+0000", 2024-09-14T08:39:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012826299999999999 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.141256+0000", 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023913499999999999 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4212.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:09.130559+0000", 2024-09-14T08:39:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.020957628, 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0075139839999999996, 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4212", 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.89:0/2943853097", 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130559+0000", 2024-09-14T08:39:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130559+0000", 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130562+0000", 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6339999999999999e-06 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130578+0000", 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5460000000000001e-05 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130613+0000", 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5123000000000002e-05 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130638+0000", 2024-09-14T08:39:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5256e-05 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130803+0000", 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000165019 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130814+0000", 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0793e-05 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.134350+0000", 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035354800000000001 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.134586+0000", 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236612 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.134796+0000", 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209395 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.136542+0000", 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017462879999999999 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137919+0000", 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013772579999999999 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137999+0000", 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9815999999999996e-05 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.138073+0000", 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3850000000000006e-05 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4212.0:5 2.2 e17/16 ondisk, result = 0)", 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:09.137683+0000", 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.013833002, 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040628399999999997, 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137683+0000", 2024-09-14T08:39:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137683+0000", 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137686+0000", 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1330000000000002e-06 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137696+0000", 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0407e-05 2024-09-14T08:39:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137725+0000", 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8653000000000002e-05 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137748+0000", 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3632999999999999e-05 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137896+0000", 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014747600000000001 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137910+0000", 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4547e-05 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.138090+0000", 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017943500000000001 2024-09-14T08:39:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4212.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:10.136675+0000", 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.0148409120000004, 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041510790000000002, 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4212", 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.89:0/2943853097", 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 7 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.136675+0000", 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.136675+0000", 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.136678+0000", 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.576e-06 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.136691+0000", 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2809999999999999e-05 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.136716+0000", 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5454000000000001e-05 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.136733+0000", 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6609999999999999e-05 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.137343+0000", 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061024600000000005 2024-09-14T08:39:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.137507+0000", 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016388500000000001 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.137787+0000", 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279692 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.139729+0000", 2024-09-14T08:39:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019420399999999999 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140670+0000", 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00094155400000000005 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140758+0000", 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7839999999999999e-05 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140827+0000", 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8372000000000002e-05 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4212.0:7 2.2 e19/16 ondisk, result = 0)", 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:10.140507+0000", 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.0110094069999995, 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032924400000000002, 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140507+0000", 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140507+0000", 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140509+0000", 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.686e-06 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140517+0000", 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4270000000000008e-06 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140540+0000", 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2719999999999999e-05 2024-09-14T08:39:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140554+0000", 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4133e-05 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140650+0000", 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5699000000000006e-05 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140662+0000", 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2384e-05 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:10.140836+0000", 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017419500000000001 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:19.187 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:19.189 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:19.195+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:19.189 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:19.289 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:19.292+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:19.322 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:19.322 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:19.322 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:19.323 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:19.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:19.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:39:19.426 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:19.432+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:19.491 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:19.496+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:19.502 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:19.502 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:19.502 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:19.503 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:19.503 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:19.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:19.593 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:19.599+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:19.678 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:22 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'12, mlcod=14'8)", 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:01.996324+0000", 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.688289709999999, 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046813540000000004, 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.996324+0000", 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.996324+0000", 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.996326+0000", 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5659999999999999e-06 2024-09-14T08:39:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.996444+0000", 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000118276 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.996475+0000", 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1123e-05 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.996493+0000", 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7727000000000002e-05 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.997043+0000", 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00055045199999999999 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.997083+0000", 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9589999999999999e-05 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.000925+0000", 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003842467 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.001006+0000", 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0153000000000003e-05 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:23 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'13, mlcod=14'8)", 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:01.997380+0000", 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.687234085, 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0042820840000000002, 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.997380+0000", 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.997380+0000", 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.997381+0000", 2024-09-14T08:39:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.466e-06 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.997534+0000", 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015304899999999999 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.997563+0000", 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8453999999999999e-05 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.997612+0000", 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8668999999999998e-05 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.998107+0000", 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00049540599999999999 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.998145+0000", 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7883000000000003e-05 2024-09-14T08:39:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.001577+0000", 2024-09-14T08:39:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034319810000000002 2024-09-14T08:39:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.001662+0000", 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5175999999999999e-05 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:24 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'14, mlcod=14'8)", 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:01.998376+0000", 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.686238156000002, 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057095729999999999, 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.998376+0000", 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.998376+0000", 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.998377+0000", 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.136e-06 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.998452+0000", 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4666999999999995e-05 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.998481+0000", 2024-09-14T08:39:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9756000000000001e-05 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.998493+0000", 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1667e-05 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.998766+0000", 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027334700000000001 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.998800+0000", 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3949999999999999e-05 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.003998+0000", 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051977509999999996 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.004085+0000", 2024-09-14T08:39:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7299000000000006e-05 2024-09-14T08:39:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:25 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'15, mlcod=14'8)", 2024-09-14T08:39:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:01.999144+0000", 2024-09-14T08:39:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.685469512000001, 2024-09-14T08:39:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0049870419999999997, 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.999144+0000", 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.999144+0000", 2024-09-14T08:39:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.999145+0000", 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.999154+0000", 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3429999999999996e-06 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.999170+0000", 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5835999999999999e-05 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.999179+0000", 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5670000000000001e-06 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.999426+0000", 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024665100000000002 2024-09-14T08:39:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:01.999460+0000", 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3782999999999998e-05 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.004091+0000", 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.004631062 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.004132+0000", 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0873e-05 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:64 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'42, mlcod=14'40)", 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.293732+0000", 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.390882039000001, 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0069222399999999996, 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.293732+0000", 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.293732+0000", 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.293733+0000", 2024-09-14T08:39:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3400000000000001e-06 2024-09-14T08:39:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.293743+0000", 2024-09-14T08:39:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6970000000000005e-06 2024-09-14T08:39:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.293767+0000", 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4145999999999999e-05 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.293783+0000", 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5630000000000001e-05 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.293852+0000", 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9016999999999993e-05 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.293876+0000", 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3989e-05 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.300529+0000", 2024-09-14T08:39:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066527590000000003 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.300654+0000", 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012566199999999999 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:65 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'43, mlcod=14'40)", 2024-09-14T08:39:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.294650+0000", 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.389963872999999, 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0067140760000000002, 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.294650+0000", 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.294650+0000", 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.294651+0000", 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2699999999999999e-06 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.294663+0000", 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1608e-05 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.294684+0000", 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.109e-05 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.294694+0000", 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0219e-05 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.294806+0000", 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111462 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.294830+0000", 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3893e-05 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301295+0000", 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0064657940000000004 2024-09-14T08:39:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301364+0000", 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8739999999999996e-05 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:66 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'44, mlcod=14'40)", 2024-09-14T08:39:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.295651+0000", 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.388962934999999, 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057702600000000001, 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.295651+0000", 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.295651+0000", 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.295652+0000", 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4499999999999995e-07 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.295709+0000", 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7156e-05 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.295724+0000", 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4829e-05 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.295733+0000", 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2739999999999996e-06 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.295807+0000", 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3901999999999998e-05 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.295836+0000", 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8436e-05 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301370+0000", 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0055343559999999998 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301421+0000", 2024-09-14T08:39:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1362000000000001e-05 2024-09-14T08:39:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:67 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'45, mlcod=14'40)", 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.297097+0000", 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.387517477999999, 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0043969459999999997, 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297097+0000", 2024-09-14T08:39:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297097+0000", 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297098+0000", 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.776e-06 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297112+0000", 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4204e-05 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297140+0000", 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7725999999999998e-05 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297162+0000", 2024-09-14T08:39:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.181e-05 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297776+0000", 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00061370499999999998 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297868+0000", 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1896000000000002e-05 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301426+0000", 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0035582830000000002 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301493+0000", 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7545999999999993e-05 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:68 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'46, mlcod=14'40)", 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.297730+0000", 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.386883699999998, 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038307879999999999, 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297730+0000", 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297730+0000", 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297732+0000", 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.513e-06 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297746+0000", 2024-09-14T08:39:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.45e-05 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297773+0000", 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6506999999999999e-05 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.297814+0000", 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1152999999999997e-05 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.298319+0000", 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00050553900000000005 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.298368+0000", 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8318000000000001e-05 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301501+0000", 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031330049999999999 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301561+0000", 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0253000000000001e-05 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:71 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'49, mlcod=14'40)", 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.300023+0000", 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.384590785, 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003573264, 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.300023+0000", 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.300023+0000", 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.300024+0000", 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9599999999999999e-07 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.300030+0000", 2024-09-14T08:39:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6250000000000004e-06 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.300039+0000", 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3270000000000007e-06 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.300044+0000", 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2129999999999999e-06 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.300716+0000", 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00067221100000000003 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.300751+0000", 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4860000000000002e-05 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.303528+0000", 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027773120000000001 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.303596+0000", 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8020000000000003e-05 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:73 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'51, mlcod=14'40)", 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.301601+0000", 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.383012862000001, 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047746830000000001, 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301601+0000", 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301601+0000", 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301602+0000", 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5499999999999998e-07 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301609+0000", 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2869999999999999e-06 2024-09-14T08:39:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301622+0000", 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2879e-05 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.301631+0000", 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9989999999999997e-06 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.302883+0000", 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0012524330000000001 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.302918+0000", 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4162999999999998e-05 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.306276+0000", 2024-09-14T08:39:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033579809999999999 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.306376+0000", 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010028599999999999 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:77 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'55, mlcod=14'53)", 2024-09-14T08:39:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.308046+0000", 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.376568356, 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051713499999999999, 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308046+0000", 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308046+0000", 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308047+0000", 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0640000000000001e-06 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308179+0000", 2024-09-14T08:39:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131975 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308199+0000", 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0387e-05 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308215+0000", 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6373000000000001e-05 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308304+0000", 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8252999999999997e-05 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308336+0000", 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2789000000000001e-05 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.313125+0000", 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.004788853 2024-09-14T08:39:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.313217+0000", 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1656000000000005e-05 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:78 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'56, mlcod=14'53)", 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.308798+0000", 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.375816107999999, 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044922410000000001, 2024-09-14T08:39:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308798+0000", 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308798+0000", 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308799+0000", 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4199999999999995e-07 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308878+0000", 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9549999999999996e-05 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308889+0000", 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.119e-05 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.308897+0000", 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.277e-06 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309043+0000", 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000146052 2024-09-14T08:39:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309077+0000", 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4727000000000001e-05 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.313227+0000", 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0041495270000000001 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.313290+0000", 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3275999999999995e-05 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:79 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'57, mlcod=14'53)", 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.309411+0000", 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.375203098, 2024-09-14T08:39:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046785890000000004, 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309411+0000", 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309411+0000", 2024-09-14T08:39:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309412+0000", 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6899999999999996e-07 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309490+0000", 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8462999999999997e-05 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309501+0000", 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309510+0000", 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9930000000000001e-06 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309794+0000", 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00028406500000000001 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309832+0000", 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7653e-05 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.313976+0000", 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0041445309999999999 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.314089+0000", 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113393 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:80 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'58, mlcod=14'53)", 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.309928+0000", 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.374686280999999, 2024-09-14T08:39:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0064280379999999996, 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309928+0000", 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309928+0000", 2024-09-14T08:39:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.309929+0000", 2024-09-14T08:39:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018e-06 2024-09-14T08:39:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.310015+0000", 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6031000000000004e-05 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.310026+0000", 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0883999999999999e-05 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.310032+0000", 2024-09-14T08:39:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5969999999999997e-06 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.313345+0000", 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033132270000000002 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.313386+0000", 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0203000000000001e-05 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.316265+0000", 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028797110000000001 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.316356+0000", 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0366999999999997e-05 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:91 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'65, mlcod=14'60)", 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.567071+0000", 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.117542807, 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0055549450000000004, 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567071+0000", 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567071+0000", 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567072+0000", 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9699999999999994e-07 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567078+0000", 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1360000000000002e-06 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567090+0000", 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1578e-05 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567096+0000", 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.319e-06 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567322+0000", 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022579300000000001 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567350+0000", 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7506000000000001e-05 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.572536+0000", 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051861529999999998 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.572626+0000", 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0463000000000004e-05 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:92 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'66, mlcod=14'61)", 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.567768+0000", 2024-09-14T08:39:19.759 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.116846227, 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0049608839999999996, 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567768+0000", 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567768+0000", 2024-09-14T08:39:19.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567769+0000", 2024-09-14T08:39:19.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.643e-06 2024-09-14T08:39:19.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567780+0000", 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0776e-05 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567808+0000", 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.739e-05 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567823+0000", 2024-09-14T08:39:19.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5339999999999999e-05 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567890+0000", 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6700999999999997e-05 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.567914+0000", 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4036000000000002e-05 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.572634+0000", 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047202490000000001 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.572729+0000", 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4748999999999997e-05 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:93 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'67, mlcod=14'62)", 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.568500+0000", 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.116114469999999, 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044044929999999998, 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.568500+0000", 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.568500+0000", 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.568501+0000", 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8729999999999999e-06 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.568556+0000", 2024-09-14T08:39:19.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4327999999999999e-05 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.568571+0000", 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5370999999999999e-05 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.568579+0000", 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4830000000000002e-06 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.568638+0000", 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9181999999999997e-05 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.568664+0000", 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6089999999999999e-05 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.572822+0000", 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0041580590000000004 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.572904+0000", 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2107000000000005e-05 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:94 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'68, mlcod=14'62)", 2024-09-14T08:39:19.769 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.569130+0000", 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.115484119000001, 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0090596380000000001, 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.569130+0000", 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.569130+0000", 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.569130+0000", 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8299999999999997e-07 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.569135+0000", 2024-09-14T08:39:19.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3939999999999998e-06 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.569144+0000", 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4460000000000007e-06 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.569151+0000", 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9580000000000001e-06 2024-09-14T08:39:19.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.572066+0000", 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029146039999999999 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.572104+0000", 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8328000000000003e-05 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.578093+0000", 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0059889319999999998 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.578190+0000", 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6392999999999997e-05 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.774 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4189.0:97 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'71, mlcod=14'69)", 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:02.584573+0000", 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.100041076, 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0041796150000000002, 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.584573+0000", 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.584573+0000", 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.584574+0000", 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2299999999999999e-07 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.584580+0000", 2024-09-14T08:39:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0809999999999999e-06 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.584595+0000", 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4977000000000001e-05 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.584605+0000", 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0563e-05 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.584654+0000", 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8973e-05 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.584674+0000", 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9224000000000001e-05 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.588706+0000", 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040319079999999998 2024-09-14T08:39:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:19.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:19.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:19.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:02.588753+0000", 2024-09-14T08:39:19.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6965999999999997e-05 2024-09-14T08:39:19.779 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.779 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.779 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.779 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:19.779 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:19.779 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:19.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:19.781 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:19.784+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:19.881 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:19.884+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:19.942 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:19.942 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:19.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:19.982 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:19.987+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:20.083 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:20.088+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:20.117 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:20.117 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:20.117 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:20.117 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:20.117 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:20.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:20.184 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:20.191+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:20.285 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:20.288+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4212.0:5 2.2 e18/16 2:5cea7035:::rbd_info:head v 18'1, mlcod=0'0)", 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:09.134457+0000", 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 11.169296708999999, 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022335129999999999, 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:20.296 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:09.134457+0000", 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:09.134457+0000", 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:09.134458+0000", 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2e-07 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:09.134466+0000", 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2330000000000006e-06 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:20.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:09.134497+0000", 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1037000000000001e-05 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:09.134516+0000", 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8363e-05 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:09.134637+0000", 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121426 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:09.134676+0000", 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8875999999999998e-05 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:09.136580+0000", 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001904509 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:09.136691+0000", 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000110549 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.300 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4212.0:7 2.2 e19/16 2:5cea7035:::rbd_info:head v 19'2, mlcod=0'0)", 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:10.137304+0000", 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.166450124000001, 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023205650000000001, 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:10.137304+0000", 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:10.137304+0000", 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:10.137305+0000", 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0300000000000001e-06 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:10.137317+0000", 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2252999999999999e-05 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:10.137349+0000", 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1575999999999997e-05 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:10.137372+0000", 2024-09-14T08:39:20.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2793999999999999e-05 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:10.137526+0000", 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000154585 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:10.137580+0000", 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3699999999999997e-05 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:10.139510+0000", 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019298640000000001 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:10.139625+0000", 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114763 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4337.0:7 3.1a e23/21 3:5cea7035:::rbd_info:head v 23'1, mlcod=0'0)", 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:19.385545+0000", 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91820903499999995, 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001084822, 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.385545+0000", 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.385545+0000", 2024-09-14T08:39:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.385545+0000", 2024-09-14T08:39:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8199999999999999e-07 2024-09-14T08:39:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.385550+0000", 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9570000000000001e-06 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.385565+0000", 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4235e-05 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.385573+0000", 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2770000000000005e-06 2024-09-14T08:39:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.385637+0000", 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4305000000000002e-05 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.385655+0000", 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8275e-05 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.386577+0000", 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00092128399999999997 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.386630+0000", 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3307000000000003e-05 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.311 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:20.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:20.372 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:39:20.387 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:20.391+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:20.486 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:20.487 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:20.487 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:20.495+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:20.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:20.587 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:20.595+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:20.619 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:20.620 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:20.620 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:20.620 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:20.620 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:20.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:20.688 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:20.695+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:20.756 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:20.756 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:20.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4212.0:1 2.3 e17/16 2:c4c92e5a:::rbd_trash:head v 17'1, mlcod=0'0)", 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:08.130396+0000", 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.633281137999999, 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001541915, 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130396+0000", 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130396+0000", 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130397+0000", 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1400000000000001e-06 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130420+0000", 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.304e-05 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130456+0000", 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.65e-05 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130479+0000", 2024-09-14T08:39:20.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2330000000000001e-05 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130574+0000", 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5744999999999999e-05 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130606+0000", 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1188e-05 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:20.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.131870+0000", 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001264133 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.131938+0000", 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7838999999999999e-05 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPush(1.0 23/22 [PushOp(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head, version: 14'71, data_included: [0~262688], data_size: 262688, omap_header_size: 0, omap_entries_size: 0, attrset_size: 9, recovery_info: ObjectRecoveryInfo(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head@14'71, size: 262688, copy_subset: [(0, 262688)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 262688, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:19.393744+0000", 2024-09-14T08:39:20.761 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.3699324339999999, 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015397939999999999, 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.393744+0000", 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.393744+0000", 2024-09-14T08:39:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.393746+0000", 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2190000000000001e-06 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.394024+0000", 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027859500000000003 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.394048+0000", 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3706999999999999e-05 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.394068+0000", 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9687e-05 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.394179+0000", 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111841 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.394196+0000", 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6843000000000001e-05 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.395284+0000", 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001087902 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPushReply(1.0 23/22 [PushReplyOp(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head)])", 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:19.402439+0000", 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.361237738, 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00056170099999999995, 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402439+0000", 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402439+0000", 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402440+0000", 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402454+0000", 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3943e-05 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402464+0000", 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0665999999999999e-05 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402473+0000", 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1620000000000008e-06 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402570+0000", 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7892000000000004e-05 2024-09-14T08:39:20.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.403001+0000", 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00043037099999999998 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPush(1.0 23/22 [PushOp(1:30306672:devicehealth::main.db.0000000000000000:head, version: 14'72, data_included: [0~327680], data_size: 327680, omap_header_size: 0, omap_entries_size: 0, attrset_size: 10, recovery_info: ObjectRecoveryInfo(1:30306672:devicehealth::main.db.0000000000000000:head@14'72, size: 327680, copy_subset: [(0, 327680)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 327680, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:19.404301+0000", 2024-09-14T08:39:20.769 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.359375464, 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001683092, 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404301+0000", 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404301+0000", 2024-09-14T08:39:20.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404302+0000", 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2200000000000003e-07 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404475+0000", 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000172955 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404493+0000", 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8410000000000002e-05 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404506+0000", 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2438e-05 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404634+0000", 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128477 2024-09-14T08:39:20.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404655+0000", 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0185000000000001e-05 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.405984+0000", 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013299049999999999 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPushReply(1.0 23/22 [PushReplyOp(1:30306672:devicehealth::main.db.0000000000000000:head)])", 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:19.412202+0000", 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.3514746049999999, 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00047121799999999997, 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412202+0000", 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412202+0000", 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412203+0000", 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8400000000000005e-07 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412208+0000", 2024-09-14T08:39:20.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0560000000000004e-06 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412219+0000", 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1003e-05 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412230+0000", 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1265e-05 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412313+0000", 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2915000000000002e-05 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412673+0000", 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00036049500000000001 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:13 3.8 3:15d3ad1c:::rbd_object_map.10f1cfbb7ac7:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-14T08:39:20.777 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:20.415646+0000", 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.34803046700000001, 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038986770000000001, 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 13 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:20.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415646+0000", 2024-09-14T08:39:20.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:20.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415646+0000", 2024-09-14T08:39:20.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415648+0000", 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.699e-06 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415655+0000", 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5100000000000004e-06 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415668+0000", 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3168e-05 2024-09-14T08:39:20.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415681+0000", 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2925000000000001e-05 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415738+0000", 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7550999999999998e-05 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:39:20.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415743+0000", 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4739999999999999e-06 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.417785+0000", 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020421609999999998 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.417896+0000", 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111158 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.418064+0000", 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000167873 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419398+0000", 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001334088 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419454+0000", 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5549e-05 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419506+0000", 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2635e-05 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419545+0000", 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8886e-05 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4337.0:13 3.8 e24/21 ondisk, result = 0)", 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:20.419357+0000", 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.34431980000000001, 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000194551, 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419357+0000", 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419357+0000", 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419358+0000", 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.065e-06 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:20.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419363+0000", 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.814e-06 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419373+0000", 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7969999999999995e-06 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419380+0000", 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3010000000000001e-06 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419440+0000", 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0197e-05 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419448+0000", 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7389999999999999e-06 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419552+0000", 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103638 2024-09-14T08:39:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.789 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.789 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.789 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:20.789 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:20.789 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:20.790 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:20.791 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:20.796+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:20.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:39:20.922 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:20.928+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:20.922 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:39:20.923 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:20.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:20.992 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:20.996+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:21.025 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:21.025 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:21.041 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:21.041 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:21.059 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:21.059 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:21.060 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:21.060 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:21.060 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:21.060 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:21.060 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:21.074 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:21.078 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:21.078 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:21.095 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:21.096 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:21.113 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:21.113 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:21.119 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:21.127+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:21.194 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:21.200+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:21.209 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:21.295 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:21.300+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:21.369 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:21.369 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:21.384 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:21.396 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:21.400+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:21.497 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:21.503+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:21.504 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:21.504 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:21.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:21.607 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:21.615+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:21.687 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:21.687 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:21.699 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:21.704+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:21.702 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:21.800 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:21.807+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:21.868 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:21.868 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:21.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:21.923 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:21.931+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:22.002 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:22.007+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:22.045 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:22.046 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:22.062 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:22.103 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:22.108+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:22.204 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:22.208+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:22.230 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:22.230 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:22.245 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:22.305 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:22.311+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:22.375 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:22.376 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:22.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:22.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:39:22.442 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:22.448+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:22.507 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:22.515+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:22.515 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:22.515 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:22.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:22.548 INFO:teuthology.orchestra.run.smithi188.stdout:skipping zero length punch hole 2024-09-14T08:39:22.574 INFO:teuthology.orchestra.run.smithi188.stdout:4 write 0xe72200 thru 0xe77a06 (0x5807 bytes) 2024-09-14T08:39:22.576 INFO:teuthology.orchestra.run.smithi188.stdout:5 punch from 0x700400 to 0x705600, (0x5200 bytes) 2024-09-14T08:39:22.577 INFO:teuthology.orchestra.run.smithi188.stdout:truncating to largest ever: 0xb88f800 2024-09-14T08:39:22.595 INFO:teuthology.orchestra.run.smithi188.stdout:6 trunc from 0xe77c00 to 0xb88f800 2024-09-14T08:39:22.607 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:22.612+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:22.620 INFO:teuthology.orchestra.run.smithi188.stdout:7 write 0x8c2a800 thru 0x8c385d4 (0xddd5 bytes) 2024-09-14T08:39:22.621 INFO:teuthology.orchestra.run.smithi188.stdout:8 punch from 0x1483000 to 0x1485600, (0x2600 bytes) 2024-09-14T08:39:22.621 INFO:teuthology.orchestra.run.smithi188.stdout:9 read 0x5d5c00 thru 0x5e35ae (0xd9af bytes) 2024-09-14T08:39:22.623 INFO:teuthology.orchestra.run.smithi188.stdout:10 read 0x2774a00 thru 0x2777ffd (0x35fe bytes) 2024-09-14T08:39:22.623 INFO:teuthology.orchestra.run.smithi188.stdout:truncating to largest ever: 0xe29ce00 2024-09-14T08:39:22.628 INFO:teuthology.orchestra.run.smithi188.stdout:11 trunc from 0xb88f800 to 0xe29ce00 2024-09-14T08:39:22.651 INFO:teuthology.orchestra.run.smithi188.stdout:12 read 0xda8a800 thru 0xda8c8b8 (0x20b9 bytes) 2024-09-14T08:39:22.666 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:22.667 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:22.675 INFO:teuthology.orchestra.run.smithi188.stdout:13 trunc from 0xe29ce00 to 0xc65a00 2024-09-14T08:39:22.681 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:22.709 INFO:teuthology.orchestra.run.smithi188.stdout:16 read 0x954e00 thru 0x95b923 (0x6b24 bytes) 2024-09-14T08:39:22.712 INFO:teuthology.orchestra.run.smithi188.stdout:20 read 0x906e00 thru 0x915765 (0xe966 bytes) 2024-09-14T08:39:22.712 INFO:teuthology.orchestra.run.smithi188.stdout:21 read 0x10a00 thru 0x1b1fb (0xa7fc bytes) 2024-09-14T08:39:22.727 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:22.732+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:22.737 INFO:teuthology.orchestra.run.smithi188.stdout:24 trunc from 0xc65a00 to 0xdfef600 2024-09-14T08:39:22.761 INFO:teuthology.orchestra.run.smithi188.stdout:26 read 0x686a000 thru 0x686e244 (0x4245 bytes) 2024-09-14T08:39:22.769 INFO:teuthology.orchestra.run.smithi188.stdout:28 trunc from 0xdfef600 to 0x9dafc00 2024-09-14T08:39:22.802 INFO:teuthology.orchestra.run.smithi188.stdout:31 trunc from 0x9dafc00 to 0xe251c00 2024-09-14T08:39:22.810 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:22.816+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:22.823 INFO:teuthology.orchestra.run.smithi188.stdout:32 read 0x37cc00 thru 0x37ee98 (0x2299 bytes) 2024-09-14T08:39:22.826 INFO:teuthology.orchestra.run.smithi188.stdout:37 read 0x5842000 thru 0x58500fc (0xe0fd bytes) 2024-09-14T08:39:22.826 INFO:teuthology.orchestra.run.smithi188.stdout:38 punch from 0x9370e00 to 0x937ee00, (0xe000 bytes) 2024-09-14T08:39:22.846 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:22.846 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:22.856 INFO:teuthology.orchestra.run.smithi188.stdout:40 trunc from 0xe251c00 to 0xd82000 2024-09-14T08:39:22.859 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:22.911 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:22.915+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:22.927 INFO:teuthology.orchestra.run.smithi188.stdout:42 write 0x665fa00 thru 0x6666d42 (0x7343 bytes) 2024-09-14T08:39:22.928 INFO:teuthology.orchestra.run.smithi188.stdout:43 read 0x4683600 thru 0x468a3b2 (0x6db3 bytes) 2024-09-14T08:39:22.960 INFO:teuthology.orchestra.run.smithi188.stdout:44 write 0x6e09400 thru 0x6e168a9 (0xd4aa bytes) 2024-09-14T08:39:22.962 INFO:teuthology.orchestra.run.smithi188.stdout:46 read 0x67fe800 thru 0x68012cd (0x2ace bytes) 2024-09-14T08:39:22.963 INFO:teuthology.orchestra.run.smithi188.stdout:47 read 0x42ca400 thru 0x42d16a4 (0x72a5 bytes) 2024-09-14T08:39:22.963 INFO:teuthology.orchestra.run.smithi188.stdout:49 read 0x2aa3e00 thru 0x2aab127 (0x7328 bytes) 2024-09-14T08:39:22.964 INFO:teuthology.orchestra.run.smithi188.stdout:53 write 0x3fe2a00 thru 0x3fed5cf (0xabd0 bytes) 2024-09-14T08:39:23.009 INFO:teuthology.orchestra.run.smithi188.stdout:60 write 0xaad9a00 thru 0xaadf4d7 (0x5ad8 bytes) 2024-09-14T08:39:23.011 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:23.016+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:23.013 INFO:teuthology.orchestra.run.smithi188.stdout:65 clone 1 order 23 su 131072 sc 4 2024-09-14T08:39:23.022 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:23.022 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:23.036 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:23.126 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:23.132+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:23.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:39:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:23.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:23.213 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:23.219+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:23.268 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:23.285 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:23.286 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:23.302 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:23.302 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:23.315 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:23.319+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:23.323 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:23.323 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:23.329 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:23.329 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:23.343 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:23.344 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:23.345 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:23.363 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:23.364 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:23.378 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:39:23.389 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T08:39:23.390 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:39:23.390 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-14T08:39:23.390 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T08:39:23.390 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T08:39:23.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-14T08:39:23.451 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:23.456+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:23.464 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:23.465 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:23.465 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:23.465 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:23.465 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:23.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:23.517 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:23.523+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:23.558 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:23.558 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T08:39:23.559 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:23.618 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:23.624+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:23.633 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:23.633 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:23.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:23.633 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:23.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.633 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4212.0:1 2.3 e17/16 2:c4c92e5a:::rbd_trash:head v 17'1, mlcod=0'0)", 2024-09-14T08:39:23.633 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:08.130396+0000", 2024-09-14T08:39:23.634 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 15.509879462000001, 2024-09-14T08:39:23.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001541915, 2024-09-14T08:39:23.634 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:23.634 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:23.634 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:23.634 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:23.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:23.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130396+0000", 2024-09-14T08:39:23.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:23.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130396+0000", 2024-09-14T08:39:23.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:23.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130397+0000", 2024-09-14T08:39:23.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1400000000000001e-06 2024-09-14T08:39:23.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:23.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130420+0000", 2024-09-14T08:39:23.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.304e-05 2024-09-14T08:39:23.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:23.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130456+0000", 2024-09-14T08:39:23.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.65e-05 2024-09-14T08:39:23.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:23.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130479+0000", 2024-09-14T08:39:23.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2330000000000001e-05 2024-09-14T08:39:23.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130574+0000", 2024-09-14T08:39:23.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5744999999999999e-05 2024-09-14T08:39:23.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:23.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.130606+0000", 2024-09-14T08:39:23.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1188e-05 2024-09-14T08:39:23.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:23.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.131870+0000", 2024-09-14T08:39:23.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001264133 2024-09-14T08:39:23.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:23.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:08.131938+0000", 2024-09-14T08:39:23.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7838999999999999e-05 2024-09-14T08:39:23.640 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.640 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.640 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.640 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPush(1.0 23/22 [PushOp(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head, version: 14'71, data_included: [0~262688], data_size: 262688, omap_header_size: 0, omap_entries_size: 0, attrset_size: 9, recovery_info: ObjectRecoveryInfo(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head@14'71, size: 262688, copy_subset: [(0, 262688)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 262688, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T08:39:23.640 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:19.393744+0000", 2024-09-14T08:39:23.641 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.2465307579999996, 2024-09-14T08:39:23.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015397939999999999, 2024-09-14T08:39:23.641 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:23.641 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:23.641 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:23.641 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:23.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:23.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.393744+0000", 2024-09-14T08:39:23.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:23.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.393744+0000", 2024-09-14T08:39:23.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:23.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.393746+0000", 2024-09-14T08:39:23.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2190000000000001e-06 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.394024+0000", 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027859500000000003 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.394048+0000", 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3706999999999999e-05 2024-09-14T08:39:23.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:23.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.394068+0000", 2024-09-14T08:39:23.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9687e-05 2024-09-14T08:39:23.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.394179+0000", 2024-09-14T08:39:23.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111841 2024-09-14T08:39:23.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:23.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.394196+0000", 2024-09-14T08:39:23.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6843000000000001e-05 2024-09-14T08:39:23.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:23.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.395284+0000", 2024-09-14T08:39:23.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001087902 2024-09-14T08:39:23.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.646 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.646 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPushReply(1.0 23/22 [PushReplyOp(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head)])", 2024-09-14T08:39:23.646 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:19.402439+0000", 2024-09-14T08:39:23.647 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.2378360620000004, 2024-09-14T08:39:23.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00056170099999999995, 2024-09-14T08:39:23.647 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:23.647 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:23.647 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:23.647 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:23.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:23.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402439+0000", 2024-09-14T08:39:23.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:23.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402439+0000", 2024-09-14T08:39:23.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:23.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402440+0000", 2024-09-14T08:39:23.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:39:23.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:23.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402454+0000", 2024-09-14T08:39:23.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3943e-05 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402464+0000", 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0665999999999999e-05 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402473+0000", 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1620000000000008e-06 2024-09-14T08:39:23.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.402570+0000", 2024-09-14T08:39:23.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7892000000000004e-05 2024-09-14T08:39:23.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:23.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.403001+0000", 2024-09-14T08:39:23.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00043037099999999998 2024-09-14T08:39:23.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.652 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.652 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPush(1.0 23/22 [PushOp(1:30306672:devicehealth::main.db.0000000000000000:head, version: 14'72, data_included: [0~327680], data_size: 327680, omap_header_size: 0, omap_entries_size: 0, attrset_size: 10, recovery_info: ObjectRecoveryInfo(1:30306672:devicehealth::main.db.0000000000000000:head@14'72, size: 327680, copy_subset: [(0, 327680)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 327680, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T08:39:23.653 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:19.404301+0000", 2024-09-14T08:39:23.653 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.2359737879999999, 2024-09-14T08:39:23.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001683092, 2024-09-14T08:39:23.653 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:23.653 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:23.653 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:23.654 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:23.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:23.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404301+0000", 2024-09-14T08:39:23.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:23.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404301+0000", 2024-09-14T08:39:23.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:23.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404302+0000", 2024-09-14T08:39:23.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2200000000000003e-07 2024-09-14T08:39:23.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:23.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404475+0000", 2024-09-14T08:39:23.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000172955 2024-09-14T08:39:23.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:23.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404493+0000", 2024-09-14T08:39:23.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8410000000000002e-05 2024-09-14T08:39:23.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:23.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404506+0000", 2024-09-14T08:39:23.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2438e-05 2024-09-14T08:39:23.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404634+0000", 2024-09-14T08:39:23.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128477 2024-09-14T08:39:23.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:23.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.404655+0000", 2024-09-14T08:39:23.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0185000000000001e-05 2024-09-14T08:39:23.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:23.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.405984+0000", 2024-09-14T08:39:23.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013299049999999999 2024-09-14T08:39:23.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.660 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.660 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPushReply(1.0 23/22 [PushReplyOp(1:30306672:devicehealth::main.db.0000000000000000:head)])", 2024-09-14T08:39:23.661 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:19.412202+0000", 2024-09-14T08:39:23.661 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.2280729289999996, 2024-09-14T08:39:23.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00047121799999999997, 2024-09-14T08:39:23.661 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:23.661 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:23.661 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:23.661 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:23.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:23.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412202+0000", 2024-09-14T08:39:23.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:23.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412202+0000", 2024-09-14T08:39:23.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:23.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412203+0000", 2024-09-14T08:39:23.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8400000000000005e-07 2024-09-14T08:39:23.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:23.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412208+0000", 2024-09-14T08:39:23.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0560000000000004e-06 2024-09-14T08:39:23.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:23.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412219+0000", 2024-09-14T08:39:23.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1003e-05 2024-09-14T08:39:23.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:23.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412230+0000", 2024-09-14T08:39:23.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1265e-05 2024-09-14T08:39:23.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412313+0000", 2024-09-14T08:39:23.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2915000000000002e-05 2024-09-14T08:39:23.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:23.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:19.412673+0000", 2024-09-14T08:39:23.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00036049500000000001 2024-09-14T08:39:23.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.666 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.666 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:13 3.8 3:15d3ad1c:::rbd_object_map.10f1cfbb7ac7:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-14T08:39:23.667 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:20.415646+0000", 2024-09-14T08:39:23.667 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.2246287909999998, 2024-09-14T08:39:23.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038986770000000001, 2024-09-14T08:39:23.667 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:23.667 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:23.667 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:23.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:23.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:39:23.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:39:23.667 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 13 2024-09-14T08:39:23.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.668 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:23.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:23.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415646+0000", 2024-09-14T08:39:23.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:23.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415646+0000", 2024-09-14T08:39:23.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:23.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415648+0000", 2024-09-14T08:39:23.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.699e-06 2024-09-14T08:39:23.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:23.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415655+0000", 2024-09-14T08:39:23.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5100000000000004e-06 2024-09-14T08:39:23.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:23.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415668+0000", 2024-09-14T08:39:23.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3168e-05 2024-09-14T08:39:23.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415681+0000", 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2925000000000001e-05 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415738+0000", 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7550999999999998e-05 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:39:23.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.415743+0000", 2024-09-14T08:39:23.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4739999999999999e-06 2024-09-14T08:39:23.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.417785+0000", 2024-09-14T08:39:23.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020421609999999998 2024-09-14T08:39:23.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:23.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.417896+0000", 2024-09-14T08:39:23.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111158 2024-09-14T08:39:23.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:23.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.418064+0000", 2024-09-14T08:39:23.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000167873 2024-09-14T08:39:23.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:39:23.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419398+0000", 2024-09-14T08:39:23.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001334088 2024-09-14T08:39:23.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:23.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419454+0000", 2024-09-14T08:39:23.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5549e-05 2024-09-14T08:39:23.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:23.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419506+0000", 2024-09-14T08:39:23.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2635e-05 2024-09-14T08:39:23.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:23.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419545+0000", 2024-09-14T08:39:23.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8886e-05 2024-09-14T08:39:23.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.676 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.676 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4337.0:13 3.8 e24/21 ondisk, result = 0)", 2024-09-14T08:39:23.676 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:20.419357+0000", 2024-09-14T08:39:23.676 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.2209181239999998, 2024-09-14T08:39:23.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000194551, 2024-09-14T08:39:23.677 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:23.677 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:23.677 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:23.677 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:23.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:23.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419357+0000", 2024-09-14T08:39:23.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:23.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419357+0000", 2024-09-14T08:39:23.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419358+0000", 2024-09-14T08:39:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.065e-06 2024-09-14T08:39:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419363+0000", 2024-09-14T08:39:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.814e-06 2024-09-14T08:39:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:23.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419373+0000", 2024-09-14T08:39:23.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7969999999999995e-06 2024-09-14T08:39:23.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:23.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419380+0000", 2024-09-14T08:39:23.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3010000000000001e-06 2024-09-14T08:39:23.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419440+0000", 2024-09-14T08:39:23.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0197e-05 2024-09-14T08:39:23.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:23.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419448+0000", 2024-09-14T08:39:23.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7389999999999999e-06 2024-09-14T08:39:23.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:23.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:20.419552+0000", 2024-09-14T08:39:23.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103638 2024-09-14T08:39:23.682 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.683 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.683 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.683 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4470.0:386 3.8 3:15d3ad1c:::rbd_object_map.10f1cfbb7ac7:head [read 0~45] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:23.683 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:23.399414+0000", 2024-09-14T08:39:23.684 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.240861145, 2024-09-14T08:39:23.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003141207, 2024-09-14T08:39:23.684 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:23.684 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:23.684 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:23.684 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:23.684 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4470", 2024-09-14T08:39:23.685 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1020595524", 2024-09-14T08:39:23.685 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 386 2024-09-14T08:39:23.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.685 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:23.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:23.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.399414+0000", 2024-09-14T08:39:23.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:23.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.399414+0000", 2024-09-14T08:39:23.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:23.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.399417+0000", 2024-09-14T08:39:23.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8820000000000001e-06 2024-09-14T08:39:23.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:23.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.399436+0000", 2024-09-14T08:39:23.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9057999999999999e-05 2024-09-14T08:39:23.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:23.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.399457+0000", 2024-09-14T08:39:23.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0990999999999999e-05 2024-09-14T08:39:23.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:23.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.399471+0000", 2024-09-14T08:39:23.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3805000000000001e-05 2024-09-14T08:39:23.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.399538+0000", 2024-09-14T08:39:23.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6876000000000001e-05 2024-09-14T08:39:23.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:39:23.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.399543+0000", 2024-09-14T08:39:23.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.215e-06 2024-09-14T08:39:23.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.402379+0000", 2024-09-14T08:39:23.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028357759999999999 2024-09-14T08:39:23.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:23.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.402465+0000", 2024-09-14T08:39:23.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6438000000000001e-05 2024-09-14T08:39:23.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:23.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.402555+0000", 2024-09-14T08:39:23.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0166000000000004e-05 2024-09-14T08:39:23.693 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.693 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.693 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.697 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4470.0:388 3.8 3:15d3ad1c:::rbd_object_map.10f1cfbb7ac7:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:23.697 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:23.406886+0000", 2024-09-14T08:39:23.697 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.233389398, 2024-09-14T08:39:23.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001719344, 2024-09-14T08:39:23.697 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:23.697 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:23.697 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:23.697 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:23.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4470", 2024-09-14T08:39:23.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1020595524", 2024-09-14T08:39:23.698 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 388 2024-09-14T08:39:23.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.698 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:23.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:23.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.406886+0000", 2024-09-14T08:39:23.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:23.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.406886+0000", 2024-09-14T08:39:23.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:23.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.406887+0000", 2024-09-14T08:39:23.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6220000000000001e-06 2024-09-14T08:39:23.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:23.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.406896+0000", 2024-09-14T08:39:23.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1640000000000001e-06 2024-09-14T08:39:23.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:23.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.406912+0000", 2024-09-14T08:39:23.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6925000000000001e-05 2024-09-14T08:39:23.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:23.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.406920+0000", 2024-09-14T08:39:23.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0380000000000002e-06 2024-09-14T08:39:23.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.406988+0000", 2024-09-14T08:39:23.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8382999999999999e-05 2024-09-14T08:39:23.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:23.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.407061+0000", 2024-09-14T08:39:23.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3335000000000002e-05 2024-09-14T08:39:23.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:23.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.407229+0000", 2024-09-14T08:39:23.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016770700000000001 2024-09-14T08:39:23.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:39:23.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408028+0000", 2024-09-14T08:39:23.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000798868 2024-09-14T08:39:23.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:23.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408509+0000", 2024-09-14T08:39:23.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00048123399999999998 2024-09-14T08:39:23.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:39:23.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408564+0000", 2024-09-14T08:39:23.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4738999999999999e-05 2024-09-14T08:39:23.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:23.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408605+0000", 2024-09-14T08:39:23.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1328999999999997e-05 2024-09-14T08:39:23.706 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.706 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.706 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.707 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4470.0:388 3.8 e24/21 ondisk, result = 0)", 2024-09-14T08:39:23.707 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:23.408427+0000", 2024-09-14T08:39:23.707 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.23184859599999999, 2024-09-14T08:39:23.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018658800000000001, 2024-09-14T08:39:23.707 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:23.707 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:23.707 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:23.707 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:23.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:23.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408427+0000", 2024-09-14T08:39:23.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:23.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408427+0000", 2024-09-14T08:39:23.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:23.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:23.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408427+0000", 2024-09-14T08:39:23.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.16e-07 2024-09-14T08:39:23.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:23.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408431+0000", 2024-09-14T08:39:23.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.721e-06 2024-09-14T08:39:23.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:23.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408441+0000", 2024-09-14T08:39:23.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5429999999999999e-06 2024-09-14T08:39:23.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:23.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408446+0000", 2024-09-14T08:39:23.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0470000000000001e-06 2024-09-14T08:39:23.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:23.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408496+0000", 2024-09-14T08:39:23.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0662999999999999e-05 2024-09-14T08:39:23.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:23.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408504+0000", 2024-09-14T08:39:23.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4479999999999997e-06 2024-09-14T08:39:23.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:23.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:23.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:23.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:23.408613+0000", 2024-09-14T08:39:23.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010935 2024-09-14T08:39:23.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.712 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:23.713 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:23.713 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:23.714 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:23.758 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:23.764+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:23.819 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:23.824+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:23.852 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:23.852 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:23.852 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:39:23.852 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:23.867 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:23.888 INFO:teuthology.orchestra.run.smithi188.stdout:66 read 0x75c1c00 thru 0x75c7db6 (0x61b7 bytes) 2024-09-14T08:39:23.919 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:23.927+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:23.930 INFO:teuthology.orchestra.run.smithi188.stdout:68 write 0xd519e00 thru 0xd5240a5 (0xa2a6 bytes) 2024-09-14T08:39:23.931 INFO:teuthology.orchestra.run.smithi188.stdout:71 write 0x4b8b400 thru 0x4b9a8ec (0xf4ed bytes) 2024-09-14T08:39:23.965 INFO:teuthology.orchestra.run.smithi188.stdout:74 trunc from 0xd524200 to 0x4e41e00 2024-09-14T08:39:23.999 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:24.000 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:24.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:24.026 INFO:teuthology.orchestra.run.smithi188.stdout:80 punch from 0x49d7a00 to 0x49d7e00, (0x400 bytes) 2024-09-14T08:39:24.029 INFO:teuthology.orchestra.run.smithi188.stdout:81 write 0x166b400 thru 0x166d031 (0x1c32 bytes) 2024-09-14T08:39:24.029 INFO:teuthology.orchestra.run.smithi188.stdout:83 read 0x4a56600 thru 0x4a5fe27 (0x9828 bytes) 2024-09-14T08:39:24.032 INFO:teuthology.orchestra.run.smithi188.stdout:84 write 0x1c93e00 thru 0x1c9e4fc (0xa6fd bytes) 2024-09-14T08:39:24.032 INFO:teuthology.orchestra.run.smithi188.stdout:86 punch from 0x2a5c200 to 0x2a62000, (0x5e00 bytes) 2024-09-14T08:39:24.035 INFO:teuthology.orchestra.run.smithi188.stdout:89 read 0x45aa800 thru 0x45b43b4 (0x9bb5 bytes) 2024-09-14T08:39:24.036 INFO:teuthology.orchestra.run.smithi188.stdout:90 write 0x348ce00 thru 0x349353f (0x6740 bytes) 2024-09-14T08:39:24.036 INFO:teuthology.orchestra.run.smithi188.stdout:91 punch from 0x1279600 to 0x1287200, (0xdc00 bytes) 2024-09-14T08:39:24.037 INFO:teuthology.orchestra.run.smithi188.stdout:92 read 0x43f8800 thru 0x4407997 (0xf198 bytes) 2024-09-14T08:39:24.043 INFO:teuthology.orchestra.run.smithi188.stdout:93 trunc from 0x4e41e00 to 0x836a400 2024-09-14T08:39:24.059 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:24.067+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:24.067 INFO:teuthology.orchestra.run.smithi188.stdout:94 read 0x2d05200 thru 0x2d0cafa (0x78fb bytes) 2024-09-14T08:39:24.070 INFO:teuthology.orchestra.run.smithi188.stdout:95 read 0x2b12a00 thru 0x2b13fd6 (0x15d7 bytes) 2024-09-14T08:39:24.071 INFO:teuthology.orchestra.run.smithi188.stdout:98 punch from 0x157f000 to 0x158cc00, (0xdc00 bytes) 2024-09-14T08:39:24.071 INFO:teuthology.orchestra.run.smithi188.stdout:99 write 0x21e5e00 thru 0x21f2b5e (0xcd5f bytes) 2024-09-14T08:39:24.072 INFO:teuthology.orchestra.run.smithi188.stdout:100 read 0x37abc00 thru 0x37b1926 (0x5d27 bytes) 2024-09-14T08:39:24.073 INFO:teuthology.orchestra.run.smithi188.stdout:105 read 0x2e000 thru 0x39ed9 (0xbeda bytes) 2024-09-14T08:39:24.073 INFO:teuthology.orchestra.run.smithi188.stdout:107 write 0x17d3400 thru 0x17d7230 (0x3e31 bytes) 2024-09-14T08:39:24.073 INFO:teuthology.orchestra.run.smithi188.stdout:108 flatten 2024-09-14T08:39:24.114 INFO:teuthology.orchestra.run.smithi188.stdout:109 write 0xa1aec00 thru 0xa1bb8e0 (0xcce1 bytes) 2024-09-14T08:39:24.118 INFO:teuthology.orchestra.run.smithi188.stdout:110 trunc from 0xa1bba00 to 0x93de400 2024-09-14T08:39:24.121 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:24.124+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:24.148 INFO:teuthology.orchestra.run.smithi188.stdout:111 clone 2 order 18 su 32768 sc 5 2024-09-14T08:39:24.193 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:01.928255+0000", 2024-09-14T08:39:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.271642162999999, 2024-09-14T08:39:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033562680999999997, 2024-09-14T08:39:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1 2024-09-14T08:39:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928255+0000", 2024-09-14T08:39:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928255+0000", 2024-09-14T08:39:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928257+0000", 2024-09-14T08:39:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-14T08:39:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928271+0000", 2024-09-14T08:39:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.419e-05 2024-09-14T08:39:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928294+0000", 2024-09-14T08:39:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2767000000000001e-05 2024-09-14T08:39:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928319+0000", 2024-09-14T08:39:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4732999999999999e-05 2024-09-14T08:39:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928502+0000", 2024-09-14T08:39:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018318499999999999 2024-09-14T08:39:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:39:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928520+0000", 2024-09-14T08:39:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7603000000000001e-05 2024-09-14T08:39:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.958398+0000", 2024-09-14T08:39:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029878400999999999 2024-09-14T08:39:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.958707+0000", 2024-09-14T08:39:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030891000000000002 2024-09-14T08:39:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.959053+0000", 2024-09-14T08:39:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034653499999999997 2024-09-14T08:39:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.960696+0000", 2024-09-14T08:39:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016423690000000001 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.961658+0000", 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00096181900000000004 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.961748+0000", 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919000000000004e-05 2024-09-14T08:39:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.961817+0000", 2024-09-14T08:39:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9777000000000006e-05 2024-09-14T08:39:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:01.994960+0000", 2024-09-14T08:39:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.204936884999999, 2024-09-14T08:39:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010297409, 2024-09-14T08:39:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.994960+0000", 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.994960+0000", 2024-09-14T08:39:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.994961+0000", 2024-09-14T08:39:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.097e-06 2024-09-14T08:39:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.995082+0000", 2024-09-14T08:39:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120782 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.995098+0000", 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6093999999999999e-05 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.995107+0000", 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3600000000000002e-06 2024-09-14T08:39:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.998413+0000", 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033061980000000002 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.998568+0000", 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154122 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.998777+0000", 2024-09-14T08:39:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020909600000000001 2024-09-14T08:39:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.000339+0000", 2024-09-14T08:39:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015626430000000001 2024-09-14T08:39:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.005116+0000", 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047770210000000002 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.005201+0000", 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5109000000000001e-05 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.005257+0000", 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5887000000000002e-05 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:01.995125+0000", 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.204772282, 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010464243, 2024-09-14T08:39:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 25 2024-09-14T08:39:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.995125+0000", 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.995125+0000", 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.995126+0000", 2024-09-14T08:39:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0729999999999999e-06 2024-09-14T08:39:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.995132+0000", 2024-09-14T08:39:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5529999999999998e-06 2024-09-14T08:39:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.995145+0000", 2024-09-14T08:39:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2476999999999999e-05 2024-09-14T08:39:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.995154+0000", 2024-09-14T08:39:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2900000000000008e-06 2024-09-14T08:39:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.999551+0000", 2024-09-14T08:39:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043969539999999998 2024-09-14T08:39:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.999617+0000", 2024-09-14T08:39:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5615000000000001e-05 2024-09-14T08:39:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.999722+0000", 2024-09-14T08:39:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010517400000000001 2024-09-14T08:39:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.000641+0000", 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091915900000000001 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.005383+0000", 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047418499999999997 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.005493+0000", 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110142 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.005589+0000", 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5956000000000001e-05 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.098303+0000", 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.101594025000001, 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013111593, 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 43 2024-09-14T08:39:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098303+0000", 2024-09-14T08:39:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098303+0000", 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098305+0000", 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4339999999999999e-06 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098318+0000", 2024-09-14T08:39:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.29e-05 2024-09-14T08:39:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098344+0000", 2024-09-14T08:39:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-05 2024-09-14T08:39:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098360+0000", 2024-09-14T08:39:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5193e-05 2024-09-14T08:39:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.104143+0000", 2024-09-14T08:39:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057833379999999998 2024-09-14T08:39:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.104314+0000", 2024-09-14T08:39:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017131899999999999 2024-09-14T08:39:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.104547+0000", 2024-09-14T08:39:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232912 2024-09-14T08:39:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.108314+0000", 2024-09-14T08:39:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037672769999999999 2024-09-14T08:39:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.111187+0000", 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028722750000000001 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.111299+0000", 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112506 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.111414+0000", 2024-09-14T08:39:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115209 2024-09-14T08:39:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.098396+0000", 2024-09-14T08:39:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.101500852000001, 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013345951999999999, 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 44 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098396+0000", 2024-09-14T08:39:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098396+0000", 2024-09-14T08:39:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098397+0000", 2024-09-14T08:39:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-06 2024-09-14T08:39:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098557+0000", 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015947800000000001 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098581+0000", 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4239999999999998e-05 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098598+0000", 2024-09-14T08:39:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7373000000000001e-05 2024-09-14T08:39:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.105668+0000", 2024-09-14T08:39:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070699500000000002 2024-09-14T08:39:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.105799+0000", 2024-09-14T08:39:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013028200000000001 2024-09-14T08:39:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.106103+0000", 2024-09-14T08:39:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000304615 2024-09-14T08:39:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.111437+0000", 2024-09-14T08:39:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053337949999999997 2024-09-14T08:39:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.111572+0000", 2024-09-14T08:39:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013510900000000001 2024-09-14T08:39:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.111660+0000", 2024-09-14T08:39:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8032e-05 2024-09-14T08:39:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.111742+0000", 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1884000000000004e-05 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.098634+0000", 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.101262893000001, 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013501895999999999, 2024-09-14T08:39:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 45 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098634+0000", 2024-09-14T08:39:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098634+0000", 2024-09-14T08:39:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098636+0000", 2024-09-14T08:39:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7400000000000001e-06 2024-09-14T08:39:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098649+0000", 2024-09-14T08:39:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3263e-05 2024-09-14T08:39:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098670+0000", 2024-09-14T08:39:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1336999999999999e-05 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098685+0000", 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4756000000000001e-05 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.107196+0000", 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085113329999999994 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.107344+0000", 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014715299999999999 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.107553+0000", 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020906399999999999 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.111910+0000", 2024-09-14T08:39:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043571859999999999 2024-09-14T08:39:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.111959+0000", 2024-09-14T08:39:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9579000000000001e-05 2024-09-14T08:39:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112066+0000", 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106229 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112136+0000", 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0256e-05 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.098717+0000", 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.101179371000001, 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013740362000000001, 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 46 2024-09-14T08:39:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098717+0000", 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098717+0000", 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098719+0000", 2024-09-14T08:39:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6700000000000001e-06 2024-09-14T08:39:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098729+0000", 2024-09-14T08:39:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.029e-05 2024-09-14T08:39:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098752+0000", 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2799999999999999e-05 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098766+0000", 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4113e-05 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.108438+0000", 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0096715489999999998 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.108583+0000", 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014501600000000001 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.108825+0000", 2024-09-14T08:39:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000242222 2024-09-14T08:39:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112152+0000", 2024-09-14T08:39:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033273180000000001 2024-09-14T08:39:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112268+0000", 2024-09-14T08:39:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115652 2024-09-14T08:39:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112350+0000", 2024-09-14T08:39:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1879999999999995e-05 2024-09-14T08:39:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112458+0000", 2024-09-14T08:39:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107852 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.098833+0000", 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.101063811, 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013909309999999999, 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 47 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098833+0000", 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098833+0000", 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098835+0000", 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8700000000000001e-06 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098961+0000", 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126212 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.098984+0000", 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2776999999999999e-05 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099001+0000", 2024-09-14T08:39:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7232999999999999e-05 2024-09-14T08:39:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.109484+0000", 2024-09-14T08:39:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010482963 2024-09-14T08:39:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.109717+0000", 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023261899999999999 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.110099+0000", 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038216699999999999 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112595+0000", 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024964969999999999 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112615+0000", 2024-09-14T08:39:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9530000000000001e-05 2024-09-14T08:39:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112683+0000", 2024-09-14T08:39:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8245999999999997e-05 2024-09-14T08:39:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112742+0000", 2024-09-14T08:39:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9196e-05 2024-09-14T08:39:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.261 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.099034+0000", 2024-09-14T08:39:24.261 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.100862739, 2024-09-14T08:39:24.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018938243, 2024-09-14T08:39:24.261 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.261 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.261 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.261 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.261 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.261 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.262 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 48 2024-09-14T08:39:24.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.262 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099034+0000", 2024-09-14T08:39:24.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099034+0000", 2024-09-14T08:39:24.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099036+0000", 2024-09-14T08:39:24.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8330000000000001e-06 2024-09-14T08:39:24.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099047+0000", 2024-09-14T08:39:24.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0963e-05 2024-09-14T08:39:24.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099067+0000", 2024-09-14T08:39:24.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9623000000000002e-05 2024-09-14T08:39:24.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099081+0000", 2024-09-14T08:39:24.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4304000000000001e-05 2024-09-14T08:39:24.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112833+0000", 2024-09-14T08:39:24.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013752095000000001 2024-09-14T08:39:24.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.112969+0000", 2024-09-14T08:39:24.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000136119 2024-09-14T08:39:24.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.113175+0000", 2024-09-14T08:39:24.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000205582 2024-09-14T08:39:24.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.117679+0000", 2024-09-14T08:39:24.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045040770000000004 2024-09-14T08:39:24.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.117832+0000", 2024-09-14T08:39:24.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153592 2024-09-14T08:39:24.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.117906+0000", 2024-09-14T08:39:24.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3539000000000002e-05 2024-09-14T08:39:24.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.117972+0000", 2024-09-14T08:39:24.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6515999999999998e-05 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.099120+0000", 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.100777272999999, 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019000566, 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.270 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 49 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099120+0000", 2024-09-14T08:39:24.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099120+0000", 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099121+0000", 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4500000000000001e-06 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099132+0000", 2024-09-14T08:39:24.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.049e-05 2024-09-14T08:39:24.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099150+0000", 2024-09-14T08:39:24.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8246000000000001e-05 2024-09-14T08:39:24.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099159+0000", 2024-09-14T08:39:24.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1439999999999992e-06 2024-09-14T08:39:24.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.113820+0000", 2024-09-14T08:39:24.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014660734999999999 2024-09-14T08:39:24.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.113952+0000", 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013238599999999999 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.114171+0000", 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021883499999999999 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.117811+0000", 2024-09-14T08:39:24.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036402819999999999 2024-09-14T08:39:24.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.117990+0000", 2024-09-14T08:39:24.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017903299999999999 2024-09-14T08:39:24.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.118054+0000", 2024-09-14T08:39:24.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3875999999999996e-05 2024-09-14T08:39:24.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.118120+0000", 2024-09-14T08:39:24.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6088999999999997e-05 2024-09-14T08:39:24.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.278 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.278 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.278 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.099177+0000", 2024-09-14T08:39:24.278 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.100719613999999, 2024-09-14T08:39:24.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020242328, 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099177+0000", 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099177+0000", 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099178+0000", 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3399999999999998e-07 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099328+0000", 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015002200000000001 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099343+0000", 2024-09-14T08:39:24.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4566000000000001e-05 2024-09-14T08:39:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099352+0000", 2024-09-14T08:39:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5140000000000007e-06 2024-09-14T08:39:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.114910+0000", 2024-09-14T08:39:24.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015557413000000001 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.115039+0000", 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012990899999999999 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.115271+0000", 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231358 2024-09-14T08:39:24.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.118188+0000", 2024-09-14T08:39:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029167939999999999 2024-09-14T08:39:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119263+0000", 2024-09-14T08:39:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010751560000000001 2024-09-14T08:39:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119350+0000", 2024-09-14T08:39:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7615999999999996e-05 2024-09-14T08:39:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119420+0000", 2024-09-14T08:39:24.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9146000000000005e-05 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.099377+0000", 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.100519808000001, 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020367766999999998, 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.286 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 51 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099377+0000", 2024-09-14T08:39:24.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099377+0000", 2024-09-14T08:39:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099378+0000", 2024-09-14T08:39:24.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:39:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099385+0000", 2024-09-14T08:39:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:39:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099397+0000", 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1653e-05 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099404+0000", 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7039999999999994e-06 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.116489+0000", 2024-09-14T08:39:24.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017084505999999999 2024-09-14T08:39:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.116656+0000", 2024-09-14T08:39:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000167162 2024-09-14T08:39:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.116885+0000", 2024-09-14T08:39:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022872100000000001 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119483+0000", 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00259844 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119549+0000", 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5949000000000002e-05 2024-09-14T08:39:24.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119679+0000", 2024-09-14T08:39:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000130173 2024-09-14T08:39:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119745+0000", 2024-09-14T08:39:24.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5376000000000006e-05 2024-09-14T08:39:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.099417+0000", 2024-09-14T08:39:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.100479348, 2024-09-14T08:39:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020534409, 2024-09-14T08:39:24.294 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.295 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-14T08:39:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099417+0000", 2024-09-14T08:39:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099417+0000", 2024-09-14T08:39:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099418+0000", 2024-09-14T08:39:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:39:24.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099424+0000", 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0430000000000004e-06 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099434+0000", 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4169999999999998e-06 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.099441+0000", 2024-09-14T08:39:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.08e-06 2024-09-14T08:39:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.118296+0000", 2024-09-14T08:39:24.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018855220999999998 2024-09-14T08:39:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.118472+0000", 2024-09-14T08:39:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175608 2024-09-14T08:39:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.118679+0000", 2024-09-14T08:39:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020781900000000001 2024-09-14T08:39:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119774+0000", 2024-09-14T08:39:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001094643 2024-09-14T08:39:24.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119829+0000", 2024-09-14T08:39:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5315999999999997e-05 2024-09-14T08:39:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119900+0000", 2024-09-14T08:39:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0423e-05 2024-09-14T08:39:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.119952+0000", 2024-09-14T08:39:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2135999999999997e-05 2024-09-14T08:39:24.303 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.294758+0000", 2024-09-14T08:39:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.905138669999999, 2024-09-14T08:39:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011117814, 2024-09-14T08:39:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 71 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294758+0000", 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294758+0000", 2024-09-14T08:39:24.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294759+0000", 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7099999999999997e-07 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294761+0000", 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.807e-06 2024-09-14T08:39:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294766+0000", 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294770+0000", 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8240000000000001e-06 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.300297+0000", 2024-09-14T08:39:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055269020000000002 2024-09-14T08:39:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.300434+0000", 2024-09-14T08:39:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013666500000000001 2024-09-14T08:39:24.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.300586+0000", 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015245499999999999 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.302822+0000", 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022362720000000001 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.305797+0000", 2024-09-14T08:39:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029749389999999998 2024-09-14T08:39:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.305839+0000", 2024-09-14T08:39:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2177e-05 2024-09-14T08:39:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.305876+0000", 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6511999999999999e-05 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.294776+0000", 2024-09-14T08:39:24.312 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.905120374999999, 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011217978999999999, 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 72 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294776+0000", 2024-09-14T08:39:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294776+0000", 2024-09-14T08:39:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294777+0000", 2024-09-14T08:39:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499999999999999e-07 2024-09-14T08:39:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294846+0000", 2024-09-14T08:39:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8813000000000007e-05 2024-09-14T08:39:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294855+0000", 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4960000000000002e-06 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294863+0000", 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9300000000000003e-06 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.301008+0000", 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061447300000000002 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.301077+0000", 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9184999999999996e-05 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.301180+0000", 2024-09-14T08:39:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102765 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.303135+0000", 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001955296 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.305918+0000", 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00278305 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.305964+0000", 2024-09-14T08:39:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5759e-05 2024-09-14T08:39:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.305994+0000", 2024-09-14T08:39:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0599999999999998e-05 2024-09-14T08:39:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.319 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.294882+0000", 2024-09-14T08:39:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.905014823999998, 2024-09-14T08:39:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012476963000000001, 2024-09-14T08:39:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.320 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294882+0000", 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294882+0000", 2024-09-14T08:39:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294883+0000", 2024-09-14T08:39:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8700000000000004e-07 2024-09-14T08:39:24.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294888+0000", 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.587e-06 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294900+0000", 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1321999999999999e-05 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294907+0000", 2024-09-14T08:39:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.435e-06 2024-09-14T08:39:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.301922+0000", 2024-09-14T08:39:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070149139999999997 2024-09-14T08:39:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.302036+0000", 2024-09-14T08:39:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114039 2024-09-14T08:39:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.302203+0000", 2024-09-14T08:39:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016647999999999999 2024-09-14T08:39:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.303383+0000", 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011807219999999999 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307272+0000", 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038885 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307319+0000", 2024-09-14T08:39:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7413000000000002e-05 2024-09-14T08:39:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307359+0000", 2024-09-14T08:39:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9663999999999998e-05 2024-09-14T08:39:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.327 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.294921+0000", 2024-09-14T08:39:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.904975719999999, 2024-09-14T08:39:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012579116, 2024-09-14T08:39:24.328 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 74 2024-09-14T08:39:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294921+0000", 2024-09-14T08:39:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294921+0000", 2024-09-14T08:39:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294922+0000", 2024-09-14T08:39:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7100000000000001e-07 2024-09-14T08:39:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294931+0000", 2024-09-14T08:39:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6530000000000006e-06 2024-09-14T08:39:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294944+0000", 2024-09-14T08:39:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2347000000000001e-05 2024-09-14T08:39:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294951+0000", 2024-09-14T08:39:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6499999999999996e-06 2024-09-14T08:39:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.303663+0000", 2024-09-14T08:39:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0087112979999999993 2024-09-14T08:39:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.303723+0000", 2024-09-14T08:39:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9815000000000002e-05 2024-09-14T08:39:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.303825+0000", 2024-09-14T08:39:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010269599999999999 2024-09-14T08:39:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.305888+0000", 2024-09-14T08:39:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020628780000000002 2024-09-14T08:39:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307409+0000", 2024-09-14T08:39:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001520932 2024-09-14T08:39:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307468+0000", 2024-09-14T08:39:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8765999999999999e-05 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307500+0000", 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2410000000000003e-05 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.294971+0000", 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.904926232000001, 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012635303000000001, 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 75 2024-09-14T08:39:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294971+0000", 2024-09-14T08:39:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294971+0000", 2024-09-14T08:39:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.294971+0000", 2024-09-14T08:39:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-07 2024-09-14T08:39:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.295098+0000", 2024-09-14T08:39:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012641799999999999 2024-09-14T08:39:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.295109+0000", 2024-09-14T08:39:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1583000000000001e-05 2024-09-14T08:39:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.295129+0000", 2024-09-14T08:39:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9344999999999999e-05 2024-09-14T08:39:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.304202+0000", 2024-09-14T08:39:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0090731400000000004 2024-09-14T08:39:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.304266+0000", 2024-09-14T08:39:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4071000000000004e-05 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.304374+0000", 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010843700000000001 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.306257+0000", 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018826380000000001 2024-09-14T08:39:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307535+0000", 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012780210000000001 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307579+0000", 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3866999999999999e-05 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307606+0000", 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7106000000000001e-05 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.295147+0000", 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.904749500000001, 2024-09-14T08:39:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012874815, 2024-09-14T08:39:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 76 2024-09-14T08:39:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.295147+0000", 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.295147+0000", 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.295148+0000", 2024-09-14T08:39:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7600000000000006e-07 2024-09-14T08:39:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.295158+0000", 2024-09-14T08:39:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2220000000000008e-06 2024-09-14T08:39:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.295174+0000", 2024-09-14T08:39:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6257e-05 2024-09-14T08:39:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.295182+0000", 2024-09-14T08:39:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7999999999999999e-06 2024-09-14T08:39:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.305195+0000", 2024-09-14T08:39:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010013408999999999 2024-09-14T08:39:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.305294+0000", 2024-09-14T08:39:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9380000000000001e-05 2024-09-14T08:39:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.305458+0000", 2024-09-14T08:39:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016347599999999999 2024-09-14T08:39:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307063+0000", 2024-09-14T08:39:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001605518 2024-09-14T08:39:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307964+0000", 2024-09-14T08:39:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090065000000000002 2024-09-14T08:39:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.307995+0000", 2024-09-14T08:39:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1427999999999998e-05 2024-09-14T08:39:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.308022+0000", 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6699e-05 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:02.565903+0000", 2024-09-14T08:39:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.633994041000001, 2024-09-14T08:39:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013625547, 2024-09-14T08:39:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 94 2024-09-14T08:39:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.565903+0000", 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.565903+0000", 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.565903+0000", 2024-09-14T08:39:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2200000000000004e-07 2024-09-14T08:39:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.565907+0000", 2024-09-14T08:39:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2389999999999998e-06 2024-09-14T08:39:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.565911+0000", 2024-09-14T08:39:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7899999999999999e-06 2024-09-14T08:39:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.565917+0000", 2024-09-14T08:39:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1340000000000001e-06 2024-09-14T08:39:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.569626+0000", 2024-09-14T08:39:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037080920000000001 2024-09-14T08:39:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.569689+0000", 2024-09-14T08:39:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3658999999999995e-05 2024-09-14T08:39:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.569791+0000", 2024-09-14T08:39:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000101866 2024-09-14T08:39:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.570845+0000", 2024-09-14T08:39:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001053684 2024-09-14T08:39:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.579376+0000", 2024-09-14T08:39:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085313260000000005 2024-09-14T08:39:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.579468+0000", 2024-09-14T08:39:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1753000000000001e-05 2024-09-14T08:39:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:02.579528+0000", 2024-09-14T08:39:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0482000000000001e-05 2024-09-14T08:39:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.362 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:24.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:24.365 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:24.368+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:24.464 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:24.468+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:24.500 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:39:24.501 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:24.514 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:24.565 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:24.571+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:24.636 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:24.636 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:24.636 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:24.636 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:24.637 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:24.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:24.665 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:24.668+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:24.766 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:24.772+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:24.818 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:24.818 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:24.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:24.818 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:24.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.818 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:7 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-14T08:39:24.818 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:19.374717+0000", 2024-09-14T08:39:24.818 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.4504069460000002, 2024-09-14T08:39:24.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015894680000000001, 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 7 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374717+0000", 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374717+0000", 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374720+0000", 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2660000000000002e-06 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374737+0000", 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7093999999999999e-05 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374778+0000", 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0389000000000002e-05 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374806+0000", 2024-09-14T08:39:24.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8393000000000001e-05 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374965+0000", 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015911199999999999 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374977+0000", 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1494e-05 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.385317+0000", 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010340177000000001 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.385615+0000", 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029807199999999997 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.385967+0000", 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035150399999999999 2024-09-14T08:39:24.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.387780+0000", 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001813495 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.390367+0000", 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025865520000000002 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.390495+0000", 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128639 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.390612+0000", 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116493 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "MOSDPGPush(1.0 23/22 [PushOp(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head, version: 14'71, data_included: [0~262688], data_size: 262688, omap_header_size: 0, omap_entries_size: 0, attrset_size: 9, recovery_info: ObjectRecoveryInfo(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head@14'71, size: 262688, copy_subset: [(0, 262688)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 262688, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:19.399056+0000", 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.4260678550000003, 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030195019999999999, 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.399056+0000", 2024-09-14T08:39:24.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.399056+0000", 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.399058+0000", 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.623e-06 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.399655+0000", 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059737899999999999 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.399704+0000", 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8933000000000001e-05 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.399736+0000", 2024-09-14T08:39:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2007e-05 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.399986+0000", 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025028399999999998 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.400026+0000", 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9499999999999998e-05 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.402076+0000", 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020497760000000001 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "MOSDPGPush(1.0 23/22 [PushOp(1:30306672:devicehealth::main.db.0000000000000000:head, version: 14'72, data_included: [0~327680], data_size: 327680, omap_header_size: 0, omap_entries_size: 0, attrset_size: 10, recovery_info: ObjectRecoveryInfo(1:30306672:devicehealth::main.db.0000000000000000:head@14'72, size: 327680, copy_subset: [(0, 327680)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 327680, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:19.409553+0000", 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.4155710829999997, 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023693450000000001, 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.409553+0000", 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.409553+0000", 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.409555+0000", 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.410048+0000", 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049287400000000002 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.410098+0000", 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0333000000000001e-05 2024-09-14T08:39:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.410150+0000", 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1949e-05 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.410363+0000", 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021326900000000001 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.410387+0000", 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3903000000000001e-05 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.411922+0000", 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015350470000000001 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:20.387937+0000", 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.437187282, 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061851320000000003, 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 9 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387937+0000", 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387937+0000", 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387939+0000", 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6000000000000001e-06 2024-09-14T08:39:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387952+0000", 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2923e-05 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387976+0000", 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3723e-05 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388000+0000", 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4280000000000001e-05 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388492+0000", 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049212300000000002 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388638+0000", 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014579299999999999 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388900+0000", 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184199999999998 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.390025+0000", 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011250050000000001 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.393955+0000", 2024-09-14T08:39:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039300480000000002 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.394048+0000", 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2563000000000001e-05 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.394122+0000", 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4232000000000003e-05 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4337.0:10 3.1c e24/21 3:3831950c:::rbd_directory:head v 24'1, mlcod=0'0)", 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:20.397932+0000", 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.4271917820000004, 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002581992, 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.397932+0000", 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.397932+0000", 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.397933+0000", 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-06 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.397946+0000", 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2376e-05 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.397977+0000", 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1466e-05 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.397998+0000", 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1217e-05 2024-09-14T08:39:24.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.398137+0000", 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138159 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.398187+0000", 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0776000000000003e-05 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.400345+0000", 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002157576 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.400514+0000", 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000169228 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4470.0:385 3.a e25/21 3:550d4712:::rbd_header.10f1cfbb7ac7:head v 25'37, mlcod=24'35)", 2024-09-14T08:39:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.396237+0000", 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.4288872889999999, 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030661030000000001, 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.396237+0000", 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.396237+0000", 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.396238+0000", 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5069999999999999e-06 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.396250+0000", 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1756000000000001e-05 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.396292+0000", 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1712999999999999e-05 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.396312+0000", 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0242999999999999e-05 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.396474+0000", 2024-09-14T08:39:24.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016179899999999999 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.396527+0000", 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3513000000000001e-05 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.399177+0000", 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026493089999999999 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.399303+0000", 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012626299999999999 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4405.0:158 3.a e25/21 3:51856c9c:::rbd_data.10f13f8886eb.0000000000000019:head v 25'43, mlcod=25'41)", 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.983412+0000", 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.841711706, 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022333320000000002, 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.850 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.983412+0000", 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.983412+0000", 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.983415+0000", 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3269999999999999e-06 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.983481+0000", 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.983520+0000", 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9613000000000002e-05 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.983541+0000", 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0530000000000002e-05 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.983729+0000", 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018842899999999999 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.983794+0000", 2024-09-14T08:39:24.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4479000000000004e-05 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.985584+0000", 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017897150000000001 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.985646+0000", 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2043000000000002e-05 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4405.0:159 3.e e25/21 3:757d3ae0:::rbd_data.10f13f8886eb.0000000000000008:head v 25'1, mlcod=0'0)", 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.984443+0000", 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.84068122300000003, 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023319579999999999, 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.984443+0000", 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.984443+0000", 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.984445+0000", 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2869999999999999e-06 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.984625+0000", 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017993600000000001 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.984661+0000", 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5815999999999997e-05 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.984680+0000", 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9613e-05 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.984814+0000", 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013342599999999999 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.984862+0000", 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7956e-05 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.986689+0000", 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018272049999999999 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.986775+0000", 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5718999999999997e-05 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:217 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 3014656~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043058+0000", 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78206629500000002, 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022873279999999999, 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.859 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 217 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043058+0000", 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043058+0000", 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043058+0000", 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5699999999999999e-07 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043059+0000", 2024-09-14T08:39:24.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.167e-06 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043062+0000", 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.19e-06 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043065+0000", 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.604e-06 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045074+0000", 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002008915 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045194+0000", 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120386 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045345+0000", 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015080900000000001 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.863 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:218 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043068+0000", 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.782055689, 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025155659999999999, 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 218 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043068+0000", 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043068+0000", 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043069+0000", 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5100000000000001e-07 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043070+0000", 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.105e-06 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043073+0000", 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9440000000000001e-06 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043075+0000", 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7250000000000002e-06 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045439+0000", 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023639479999999998 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045499+0000", 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9364000000000003e-05 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045584+0000", 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5228999999999993e-05 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.868 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:219 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 3538944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043079+0000", 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.782045192, 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002695294, 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 219 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043079+0000", 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043079+0000", 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043079+0000", 2024-09-14T08:39:24.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043080+0000", 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043083+0000", 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000001e-06 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043086+0000", 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1240000000000001e-06 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045631+0000", 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025447809999999999 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045694+0000", 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2389000000000002e-05 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045774+0000", 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0593000000000006e-05 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:220 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043090+0000", 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78203394000000004, 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029114850000000001, 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 220 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043090+0000", 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043090+0000", 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043090+0000", 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5100000000000001e-07 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043101+0000", 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0637e-05 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043106+0000", 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6929999999999998e-06 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043109+0000", 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9069999999999999e-06 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045829+0000", 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027201759999999999 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.045918+0000", 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9023999999999993e-05 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046002+0000", 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3796999999999997e-05 2024-09-14T08:39:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:221 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043114+0000", 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78201036700000004, 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030640110000000002, 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 221 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043114+0000", 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043114+0000", 2024-09-14T08:39:24.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043114+0000", 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3700000000000001e-07 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043116+0000", 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3539999999999998e-06 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043124+0000", 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4150000000000002e-06 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043127+0000", 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4860000000000002e-06 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046040+0000", 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029128589999999998 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046093+0000", 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3242000000000003e-05 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046178+0000", 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4217999999999999e-05 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.882 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:222 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 1048576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043132+0000", 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78199177200000003, 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032329979999999999, 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 222 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043132+0000", 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043132+0000", 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043133+0000", 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0499999999999999e-07 2024-09-14T08:39:24.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043134+0000", 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3689999999999999e-06 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043137+0000", 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3100000000000001e-06 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043140+0000", 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6850000000000001e-06 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046215+0000", 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030755079999999998 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046281+0000", 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5571e-05 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046365+0000", 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4250000000000001e-05 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:223 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043144+0000", 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78198046499999996, 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003413513, 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 223 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043144+0000", 2024-09-14T08:39:24.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043144+0000", 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043144+0000", 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.48e-07 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043145+0000", 2024-09-14T08:39:24.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.108e-06 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043148+0000", 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1159999999999999e-06 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043151+0000", 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3639999999999999e-06 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046416+0000", 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032648389999999998 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046488+0000", 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.203e-05 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046557+0000", 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8807999999999996e-05 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.891 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:224 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 2097152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043157+0000", 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78196666400000003, 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003712323, 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 224 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043157+0000", 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043157+0000", 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043158+0000", 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3999999999999997e-07 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043159+0000", 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3149999999999999e-06 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043163+0000", 2024-09-14T08:39:24.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.574e-06 2024-09-14T08:39:24.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043165+0000", 2024-09-14T08:39:24.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7259999999999998e-06 2024-09-14T08:39:24.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046707+0000", 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035418279999999999 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046780+0000", 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2569000000000003e-05 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046870+0000", 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9970999999999996e-05 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:225 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 2621440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043170+0000", 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78195449900000003, 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038334409999999999, 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.897 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 225 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043170+0000", 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043170+0000", 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043170+0000", 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5499999999999999e-07 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043171+0000", 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.624e-06 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043175+0000", 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.844e-06 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043178+0000", 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6000000000000001e-06 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046899+0000", 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037212920000000002 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046948+0000", 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9345999999999998e-05 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047003+0000", 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.448e-05 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:226 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043181+0000", 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78194257099999998, 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039651809999999999, 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 226 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.902 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043181+0000", 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043181+0000", 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043182+0000", 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-07 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043183+0000", 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0809999999999999e-06 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043186+0000", 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.056e-06 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043188+0000", 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.475e-06 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047032+0000", 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038439540000000001 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047073+0000", 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0281000000000003e-05 2024-09-14T08:39:24.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047147+0000", 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4054999999999995e-05 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:227 3.1a 3:5880174d:::rbd_data.10f1cfbb7ac7.0000000000000003:3 [sparse-read 3670016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043192+0000", 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78193219800000002, 2024-09-14T08:39:24.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004108156, 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043192+0000", 2024-09-14T08:39:24.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043192+0000", 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043192+0000", 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6e-07 2024-09-14T08:39:24.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043194+0000", 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6470000000000001e-06 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043197+0000", 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.162e-06 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043200+0000", 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6170000000000001e-06 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047170+0000", 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039702909999999999 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047238+0000", 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8526000000000001e-05 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047300+0000", 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1653000000000001e-05 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:588 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.433001+0000", 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.392123267, 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041541149999999999, 2024-09-14T08:39:24.911 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 588 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.433001+0000", 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.433001+0000", 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.433004+0000", 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2270000000000002e-06 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.433018+0000", 2024-09-14T08:39:24.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3593e-05 2024-09-14T08:39:24.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:24.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.433054+0000", 2024-09-14T08:39:24.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6374000000000001e-05 2024-09-14T08:39:24.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.433079+0000", 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4776000000000001e-05 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.433192+0000", 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113152 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.433198+0000", 2024-09-14T08:39:24.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9599999999999997e-06 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.436865+0000", 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003667245 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.436992+0000", 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012672399999999999 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:24.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.437155+0000", 2024-09-14T08:39:24.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016306400000000001 2024-09-14T08:39:24.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.917 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:24.917 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:24.917 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:24.918 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:24.919 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:24.924+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:25.020 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:25.024+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:25.048 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:39:25.049 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:25.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:25.121 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:25.127+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:25.183 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:25.183 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:25.184 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:25.184 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:25.184 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:25.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:25.218 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-14T08:39:25.221 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:25.224+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:25.322 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:25.328+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:25.372 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4212.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:08.124037+0000", 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.253648109, 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092257620000000002, 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4212", 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.89:0/2943853097", 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124037+0000", 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124037+0000", 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124047+0000", 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9939999999999995e-06 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124058+0000", 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0329999999999999e-05 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124079+0000", 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1803000000000001e-05 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124100+0000", 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0686000000000002e-05 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124285+0000", 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018461899999999999 2024-09-14T08:39:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124305+0000", 2024-09-14T08:39:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0216000000000001e-05 2024-09-14T08:39:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.125957+0000", 2024-09-14T08:39:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016521660000000001 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.125980+0000", 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2860000000000001e-05 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.130171+0000", 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041906620000000004 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.130494+0000", 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000323741 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.130827+0000", 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033251199999999998 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133022+0000", 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021951309999999999 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133117+0000", 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5116000000000002e-05 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133197+0000", 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9599999999999997e-05 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133263+0000", 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6326000000000002e-05 2024-09-14T08:39:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4212.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:09.130559+0000", 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.247126551000001, 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0075139839999999996, 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4212", 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.89:0/2943853097", 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130559+0000", 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130559+0000", 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130562+0000", 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6339999999999999e-06 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130578+0000", 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5460000000000001e-05 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130613+0000", 2024-09-14T08:39:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5123000000000002e-05 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130638+0000", 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5256e-05 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130803+0000", 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000165019 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130814+0000", 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0793e-05 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.134350+0000", 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035354800000000001 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.134586+0000", 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236612 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.134796+0000", 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209395 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.136542+0000", 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017462879999999999 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137919+0000", 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013772579999999999 2024-09-14T08:39:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137999+0000", 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9815999999999996e-05 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.138073+0000", 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3850000000000006e-05 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:10 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:20.396006+0000", 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9816797230000001, 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005034986, 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 10 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396006+0000", 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396006+0000", 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396009+0000", 2024-09-14T08:39:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0800000000000002e-06 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396024+0000", 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5057e-05 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396049+0000", 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5006000000000001e-05 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396073+0000", 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4122999999999999e-05 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396739+0000", 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066631899999999996 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396967+0000", 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000227908 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.397580+0000", 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061268599999999998 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.400283+0000", 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027033090000000001 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.400819+0000", 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053561600000000004 2024-09-14T08:39:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.400915+0000", 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6676999999999996e-05 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.401041+0000", 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000125205 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:154 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.976271+0000", 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.401414728, 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0050497390000000001, 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 154 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976271+0000", 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976271+0000", 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976273+0000", 2024-09-14T08:39:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7199999999999998e-06 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976287+0000", 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3348e-05 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976312+0000", 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5021999999999999e-05 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976325+0000", 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3193000000000001e-05 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976528+0000", 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020316799999999999 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976699+0000", 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017047899999999999 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.977289+0000", 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059064299999999996 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.981061+0000", 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037722509999999999 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.981153+0000", 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1912999999999999e-05 2024-09-14T08:39:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.981236+0000", 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3119000000000002e-05 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.981320+0000", 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3882999999999996e-05 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:155 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.976356+0000", 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.4013291889999999, 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059381030000000001, 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 155 2024-09-14T08:39:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976356+0000", 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976356+0000", 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976357+0000", 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0699999999999996e-07 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976361+0000", 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.912e-06 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976369+0000", 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9650000000000008e-06 2024-09-14T08:39:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976375+0000", 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0170000000000002e-06 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.978093+0000", 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017182880000000001 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.978231+0000", 2024-09-14T08:39:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013811499999999999 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.978902+0000", 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067085500000000004 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.981080+0000", 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021776460000000001 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982115+0000", 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001035046 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982197+0000", 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2043e-05 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982294+0000", 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7409000000000002e-05 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:156 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.976398+0000", 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.40128713, 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067019820000000004, 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 156 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976398+0000", 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976398+0000", 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976399+0000", 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3200000000000005e-07 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976403+0000", 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8240000000000001e-06 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976410+0000", 2024-09-14T08:39:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.464e-06 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976416+0000", 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7950000000000004e-06 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.979595+0000", 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031792639999999998 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.979755+0000", 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000160006 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.980362+0000", 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060659600000000004 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982319+0000", 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019569100000000001 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982851+0000", 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053233299999999996 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982998+0000", 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146613 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.983100+0000", 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102645 2024-09-14T08:39:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:161 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.994548+0000", 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.3831374570000001, 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058483700000000003, 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 161 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994548+0000", 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994548+0000", 2024-09-14T08:39:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994550+0000", 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.84e-06 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994557+0000", 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5970000000000003e-06 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994575+0000", 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7716000000000001e-05 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994587+0000", 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2269999999999999e-05 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.995493+0000", 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090525999999999996 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.995728+0000", 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023593900000000001 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.996835+0000", 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001106335 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.998678+0000", 2024-09-14T08:39:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001842708 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.000090+0000", 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001412787 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.000253+0000", 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000162406 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.000396+0000", 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014351199999999999 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:170 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.008364+0000", 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.369321703, 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064894230000000002, 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 170 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008364+0000", 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008364+0000", 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008372+0000", 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8400000000000001e-06 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008399+0000", 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6699999999999998e-05 2024-09-14T08:39:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008422+0000", 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2702999999999999e-05 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008435+0000", 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2853e-05 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008563+0000", 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012865899999999999 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008792+0000", 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022895599999999999 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.009409+0000", 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061700199999999996 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014530+0000", 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051208019999999998 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014637+0000", 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106536 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014734+0000", 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7336000000000005e-05 2024-09-14T08:39:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014853+0000", 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119036 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:171 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.008595+0000", 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.369090388, 2024-09-14T08:39:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064668570000000003, 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 171 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008595+0000", 2024-09-14T08:39:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008595+0000", 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008597+0000", 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9400000000000001e-06 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008607+0000", 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8039999999999996e-06 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008628+0000", 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1299999999999999e-05 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008645+0000", 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6693000000000001e-05 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.010342+0000", 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016972809999999999 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.010610+0000", 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000268509 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.011714+0000", 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011034090000000001 2024-09-14T08:39:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014617+0000", 2024-09-14T08:39:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029035469999999998 2024-09-14T08:39:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014869+0000", 2024-09-14T08:39:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025124199999999999 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014958+0000", 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8916e-05 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.015062+0000", 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010421600000000001 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:172 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.008722+0000", 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.3689633620000001, 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0074072529999999999, 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 172 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008722+0000", 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008722+0000", 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008730+0000", 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5329999999999994e-06 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008740+0000", 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0440000000000001e-06 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008761+0000", 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1216000000000002e-05 2024-09-14T08:39:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008780+0000", 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9547000000000001e-05 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.012890+0000", 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041102049999999996 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.013046+0000", 2024-09-14T08:39:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015510599999999999 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.013713+0000", 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066785499999999997 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.015081+0000", 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013679079999999999 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.015857+0000", 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00077550500000000001 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.016011+0000", 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153795 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.016129+0000", 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118539 2024-09-14T08:39:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:213 3.c 3:37a15ce0:::rbd_data.10f1cfbb7ac7.0000000000000001:3 [sparse-read 3145728~20992] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043561+0000", 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.334124662, 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052932819999999998, 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 213 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043561+0000", 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043561+0000", 2024-09-14T08:39:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043561+0000", 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043564+0000", 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043573+0000", 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0529999999999996e-06 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043582+0000", 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7600000000000008e-06 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047844+0000", 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042620660000000001 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047985+0000", 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141419 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048854+0000", 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086846700000000005 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:215 3.c 3:37a15ce0:::rbd_data.10f1cfbb7ac7.0000000000000001:3 [sparse-read 3670016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043593+0000", 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.3340924219999999, 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054248780000000002, 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 215 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043593+0000", 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043593+0000", 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043594+0000", 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4700000000000001e-07 2024-09-14T08:39:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043621+0000", 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7319999999999999e-05 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043632+0000", 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0943e-05 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043639+0000", 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2599999999999999e-06 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048879+0000", 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052399780000000002 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048928+0000", 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8729000000000001e-05 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049018+0000", 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9901000000000005e-05 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:248 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.046275+0000", 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.3314104840000001, 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071489910000000004, 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 248 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046275+0000", 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046275+0000", 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046276+0000", 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5799999999999998e-07 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046281+0000", 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7869999999999998e-06 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046294+0000", 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2271e-05 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046302+0000", 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9340000000000006e-06 2024-09-14T08:39:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049040+0000", 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027385310000000002 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049092+0000", 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1378000000000002e-05 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049351+0000", 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025938300000000002 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053283+0000", 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039319000000000003 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053352+0000", 2024-09-14T08:39:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8917000000000004e-05 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053392+0000", 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0682000000000001e-05 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053424+0000", 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1350000000000003e-05 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:249 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.046409+0000", 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.3312763429999999, 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072564029999999998, 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 249 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046409+0000", 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046409+0000", 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046410+0000", 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5999999999999991e-07 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046415+0000", 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3990000000000003e-06 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046435+0000", 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0134999999999999e-05 2024-09-14T08:39:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046450+0000", 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4073000000000001e-05 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049707+0000", 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032576910000000001 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049794+0000", 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6284000000000003e-05 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.050099+0000", 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030514700000000002 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053295+0000", 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031961099999999998 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053502+0000", 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020673600000000001 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053585+0000", 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3024999999999999e-05 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053665+0000", 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0842999999999998e-05 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:262 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.048553+0000", 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.329132062, 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054683309999999999, 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 262 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048553+0000", 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048553+0000", 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048554+0000", 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4e-07 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048562+0000", 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6359999999999994e-06 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048577+0000", 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5116000000000001e-05 2024-09-14T08:39:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048587+0000", 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7180000000000008e-06 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.050551+0000", 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019643 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.050604+0000", 2024-09-14T08:39:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2927999999999999e-05 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.050816+0000", 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196100000000001 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053684+0000", 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002868532 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053813+0000", 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012891500000000001 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053949+0000", 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013596499999999999 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054022+0000", 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2319999999999999e-05 2024-09-14T08:39:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:263 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.049303+0000", 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.328382052, 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049598230000000004, 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 263 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049303+0000", 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049303+0000", 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049305+0000", 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2610000000000001e-06 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049310+0000", 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7910000000000001e-06 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049324+0000", 2024-09-14T08:39:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.376e-05 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049334+0000", 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7529999999999996e-06 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.051135+0000", 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001801219 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.051196+0000", 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1117000000000005e-05 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.051487+0000", 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029052199999999998 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053692+0000", 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022049040000000002 2024-09-14T08:39:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054125+0000", 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043336699999999999 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054205+0000", 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0340000000000007e-05 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054263+0000", 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7788999999999998e-05 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:265 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.049624+0000", 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.328061717, 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005334325, 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 265 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049624+0000", 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049624+0000", 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049624+0000", 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049631+0000", 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2029999999999997e-06 2024-09-14T08:39:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049647+0000", 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6597999999999999e-05 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049656+0000", 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7900000000000005e-06 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.051947+0000", 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022906929999999999 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.052096+0000", 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014928200000000001 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.052758+0000", 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066204299999999996 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054051+0000", 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001292938 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054836+0000", 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078517500000000004 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054906+0000", 2024-09-14T08:39:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9924000000000003e-05 2024-09-14T08:39:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054958+0000", 2024-09-14T08:39:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1780999999999998e-05 2024-09-14T08:39:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:274 3.10 3:0e40f4c4:::rbd_data.10f13f8886eb.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write 2621440~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.054161+0000", 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.3235247700000001, 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043537330000000003, 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 274 2024-09-14T08:39:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054161+0000", 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054161+0000", 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054161+0000", 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.16e-07 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054272+0000", 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110264 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054282+0000", 2024-09-14T08:39:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0362e-05 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054291+0000", 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6880000000000005e-06 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054378+0000", 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7706000000000004e-05 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054599+0000", 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000220509 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.055181+0000", 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058193600000000002 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.057315+0000", 2024-09-14T08:39:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021341480000000002 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.058298+0000", 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098311100000000005 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.058402+0000", 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104156 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.058514+0000", 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111937 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:575 3.c 3:30d18223:::rbd_header.10f13f8886eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.411967+0000", 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.96571859800000004, 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0063602340000000002, 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 575 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.411967+0000", 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.411967+0000", 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.411969+0000", 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.729e-06 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.411982+0000", 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2804e-05 2024-09-14T08:39:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.412006+0000", 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3825999999999999e-05 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.412019+0000", 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3402e-05 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.412137+0000", 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117049 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.412149+0000", 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2429000000000001e-05 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.415368+0000", 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032186179999999999 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.415461+0000", 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3296999999999998e-05 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.415793+0000", 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033259199999999999 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.416932+0000", 2024-09-14T08:39:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001138694 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.418240+0000", 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001307643 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.418288+0000", 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8421000000000003e-05 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.418327+0000", 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8729999999999997e-05 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:642 3.c 3:30d18223:::rbd_header.10f13f8886eb:head [watch reconnect cookie 140227595352256 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.736457+0000", 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.641228452, 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0056721030000000004, 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 642 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736457+0000", 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736457+0000", 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736458+0000", 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736462+0000", 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0369999999999996e-06 2024-09-14T08:39:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736470+0000", 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9489999999999996e-06 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736478+0000", 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2439999999999993e-06 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.737470+0000", 2024-09-14T08:39:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099203599999999996 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.737613+0000", 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143299 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.739214+0000", 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001600466 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.739330+0000", 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116246 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.742129+0000", 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027988829999999998 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:25.496 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:25.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:39:25.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:39:25.499 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:25.500 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:25.504+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:25.599 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:25.607+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:25.670 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:25.671 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:25.671 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:25.672 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:25.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:25.702 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:25.702 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:25.703 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:25.708+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:25.732 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:25.733 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:25.753 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:25.754 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:25.775 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:25.775 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:25.795 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:25.795 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:25.801 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:25.807+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:25.816 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:25.816 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:25.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:25.902 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:25.907+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:25.989 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:25.989 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:26.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:26.003 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:26.011+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:26.104 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:26.108+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:26.126 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:26.126 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:26.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:26.174 INFO:teuthology.orchestra.run.smithi188.stdout:112 write 0x3af7000 thru 0x3af75de (0x5df bytes) 2024-09-14T08:39:26.182 INFO:teuthology.orchestra.run.smithi188.stdout:113 trunc from 0x93de400 to 0x813a600 2024-09-14T08:39:26.226 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:26.232+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:26.245 INFO:teuthology.orchestra.run.smithi188.stdout:115 read 0x28b7800 thru 0x28c3776 (0xbf77 bytes) 2024-09-14T08:39:26.251 INFO:teuthology.orchestra.run.smithi188.stdout:119 clone 3 order 19 su 8192 sc 8 2024-09-14T08:39:26.301 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:26.302 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:26.305 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:26.308+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:26.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:26.406 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:39:26.406 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:26.412+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:26.481 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:26.481 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:26.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:26.538 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:26.544+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:26.561 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone2 from 0x813a600 (overlap 0x813a600) to 0x5a75a00 2024-09-14T08:39:26.609 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:26.612+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:26.645 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:26.645 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:26.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:26.709 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:26.715+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:26.811 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:26.815+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:26.825 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:26.825 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:26.841 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:26.911 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:26.916+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:26.966 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:26.966 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:26.980 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:27.027 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:27.035+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:27.113 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:27.119+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:27.122 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:27.122 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:27.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:27.177 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-14T08:39:27.214 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:27.220+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:27.309 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:27.310 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:27.315 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:27.323+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:27.325 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:27.416 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:27.420+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:27.496 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:27.496 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:27.511 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:27.516 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:27.520+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:27.618 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:27.624+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:27.635 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:27.635 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:27.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:27.718 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:27.723+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:27.781 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:27.781 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:27.795 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:27.818 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:39:27.839 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:27.847+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:27.920 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:27.924+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:27.971 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:27.971 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:27.977 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:27.978 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:27.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:27.994 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:27.994 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:28.010 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:28.011 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:28.021 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:28.024+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:28.028 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:28.028 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:28.045 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:28.046 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:28.063 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:28.063 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:28.110 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:28.111 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:28.111 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:39:28.111 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:28.122 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:28.128+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:28.125 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:28.216 INFO:teuthology.orchestra.run.smithi188.stdout:120 write 0x2e00200 thru 0x2e029f3 (0x27f4 bytes) 2024-09-14T08:39:28.218 INFO:teuthology.orchestra.run.smithi188.stdout:122 read 0x6289200 thru 0x6297154 (0xdf55 bytes) 2024-09-14T08:39:28.223 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:28.228+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:28.248 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:28.248 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:28.248 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:28.248 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:28.248 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:28.263 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:28.301 INFO:teuthology.orchestra.run.smithi188.stdout:124 write 0xc443200 thru 0xc44e8d2 (0xb6d3 bytes) 2024-09-14T08:39:28.311 INFO:teuthology.orchestra.run.smithi188.stdout:125 trunc from 0xc44ea00 to 0x8fe9a00 2024-09-14T08:39:28.325 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:28.328+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:28.397 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4212.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T08:39:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:08.124037+0000", 2024-09-14T08:39:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.280404717, 2024-09-14T08:39:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092257620000000002, 2024-09-14T08:39:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4212", 2024-09-14T08:39:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.89:0/2943853097", 2024-09-14T08:39:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1 2024-09-14T08:39:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124037+0000", 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124037+0000", 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124047+0000", 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9939999999999995e-06 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124058+0000", 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0329999999999999e-05 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124079+0000", 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1803000000000001e-05 2024-09-14T08:39:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124100+0000", 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0686000000000002e-05 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124285+0000", 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018461899999999999 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.124305+0000", 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0216000000000001e-05 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.125957+0000", 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016521660000000001 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.125980+0000", 2024-09-14T08:39:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2860000000000001e-05 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.130171+0000", 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041906620000000004 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.130494+0000", 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000323741 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.130827+0000", 2024-09-14T08:39:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033251199999999998 2024-09-14T08:39:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133022+0000", 2024-09-14T08:39:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021951309999999999 2024-09-14T08:39:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133117+0000", 2024-09-14T08:39:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5116000000000002e-05 2024-09-14T08:39:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133197+0000", 2024-09-14T08:39:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9599999999999997e-05 2024-09-14T08:39:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:08.133263+0000", 2024-09-14T08:39:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6326000000000002e-05 2024-09-14T08:39:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4212.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:09.130559+0000", 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.273883159, 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0075139839999999996, 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4212", 2024-09-14T08:39:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.89:0/2943853097", 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130559+0000", 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130559+0000", 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130562+0000", 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6339999999999999e-06 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130578+0000", 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5460000000000001e-05 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130613+0000", 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5123000000000002e-05 2024-09-14T08:39:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130638+0000", 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5256e-05 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130803+0000", 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000165019 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.130814+0000", 2024-09-14T08:39:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0793e-05 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.134350+0000", 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035354800000000001 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.134586+0000", 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236612 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.134796+0000", 2024-09-14T08:39:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209395 2024-09-14T08:39:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.136542+0000", 2024-09-14T08:39:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017462879999999999 2024-09-14T08:39:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137919+0000", 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013772579999999999 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.137999+0000", 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9815999999999996e-05 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:09.138073+0000", 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3850000000000006e-05 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:10 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:20.396006+0000", 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.0084363310000004, 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005034986, 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:39:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 10 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396006+0000", 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396006+0000", 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396009+0000", 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0800000000000002e-06 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396024+0000", 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5057e-05 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396049+0000", 2024-09-14T08:39:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5006000000000001e-05 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396073+0000", 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4122999999999999e-05 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396739+0000", 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066631899999999996 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.396967+0000", 2024-09-14T08:39:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000227908 2024-09-14T08:39:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-14T08:39:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.397580+0000", 2024-09-14T08:39:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061268599999999998 2024-09-14T08:39:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.400283+0000", 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027033090000000001 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.400819+0000", 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053561600000000004 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.400915+0000", 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6676999999999996e-05 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.401041+0000", 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000125205 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:154 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.976271+0000", 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.4281713360000001, 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0050497390000000001, 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 154 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976271+0000", 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976271+0000", 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976273+0000", 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7199999999999998e-06 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976287+0000", 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3348e-05 2024-09-14T08:39:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976312+0000", 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5021999999999999e-05 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976325+0000", 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3193000000000001e-05 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976528+0000", 2024-09-14T08:39:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020316799999999999 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976699+0000", 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017047899999999999 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.977289+0000", 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059064299999999996 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.981061+0000", 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037722509999999999 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.981153+0000", 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1912999999999999e-05 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.981236+0000", 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3119000000000002e-05 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.981320+0000", 2024-09-14T08:39:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3882999999999996e-05 2024-09-14T08:39:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:155 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.976356+0000", 2024-09-14T08:39:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.4280857969999996, 2024-09-14T08:39:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059381030000000001, 2024-09-14T08:39:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 155 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976356+0000", 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976356+0000", 2024-09-14T08:39:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976357+0000", 2024-09-14T08:39:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0699999999999996e-07 2024-09-14T08:39:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976361+0000", 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.912e-06 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976369+0000", 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9650000000000008e-06 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976375+0000", 2024-09-14T08:39:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0170000000000002e-06 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.978093+0000", 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017182880000000001 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.978231+0000", 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013811499999999999 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.978902+0000", 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067085500000000004 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.981080+0000", 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021776460000000001 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982115+0000", 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001035046 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982197+0000", 2024-09-14T08:39:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2043e-05 2024-09-14T08:39:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982294+0000", 2024-09-14T08:39:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7409000000000002e-05 2024-09-14T08:39:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:156 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.976398+0000", 2024-09-14T08:39:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.4280437380000004, 2024-09-14T08:39:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067019820000000004, 2024-09-14T08:39:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 156 2024-09-14T08:39:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976398+0000", 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976398+0000", 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976399+0000", 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3200000000000005e-07 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976403+0000", 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8240000000000001e-06 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976410+0000", 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.464e-06 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.976416+0000", 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7950000000000004e-06 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.979595+0000", 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031792639999999998 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.979755+0000", 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000160006 2024-09-14T08:39:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.980362+0000", 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060659600000000004 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982319+0000", 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019569100000000001 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982851+0000", 2024-09-14T08:39:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053233299999999996 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.982998+0000", 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146613 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.983100+0000", 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102645 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:161 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:23.994548+0000", 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.4098940649999996, 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058483700000000003, 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 161 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994548+0000", 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994548+0000", 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994550+0000", 2024-09-14T08:39:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.84e-06 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994557+0000", 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5970000000000003e-06 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994575+0000", 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7716000000000001e-05 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.994587+0000", 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2269999999999999e-05 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.995493+0000", 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090525999999999996 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.995728+0000", 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023593900000000001 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.996835+0000", 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001106335 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:23.998678+0000", 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001842708 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.000090+0000", 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001412787 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.000253+0000", 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000162406 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.000396+0000", 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014351199999999999 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:170 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.008364+0000", 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3960783110000001, 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064894230000000002, 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 170 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008364+0000", 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008364+0000", 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008372+0000", 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8400000000000001e-06 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008399+0000", 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6699999999999998e-05 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008422+0000", 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2702999999999999e-05 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008435+0000", 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2853e-05 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008563+0000", 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012865899999999999 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008792+0000", 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022895599999999999 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.009409+0000", 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061700199999999996 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014530+0000", 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051208019999999998 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014637+0000", 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106536 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014734+0000", 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7336000000000005e-05 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014853+0000", 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119036 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:171 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.008595+0000", 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3958469960000004, 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064668570000000003, 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.455 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 171 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008595+0000", 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008595+0000", 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008597+0000", 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9400000000000001e-06 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008607+0000", 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8039999999999996e-06 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008628+0000", 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1299999999999999e-05 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008645+0000", 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6693000000000001e-05 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.010342+0000", 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016972809999999999 2024-09-14T08:39:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.010610+0000", 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000268509 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.011714+0000", 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011034090000000001 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014617+0000", 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029035469999999998 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014869+0000", 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025124199999999999 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.014958+0000", 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8916e-05 2024-09-14T08:39:28.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.015062+0000", 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010421600000000001 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:172 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.008722+0000", 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.39571997, 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0074072529999999999, 2024-09-14T08:39:28.461 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 172 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008722+0000", 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008722+0000", 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008730+0000", 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5329999999999994e-06 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008740+0000", 2024-09-14T08:39:28.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0440000000000001e-06 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008761+0000", 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1216000000000002e-05 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.008780+0000", 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9547000000000001e-05 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.012890+0000", 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041102049999999996 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.013046+0000", 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015510599999999999 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.013713+0000", 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066785499999999997 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.015081+0000", 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013679079999999999 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.015857+0000", 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00077550500000000001 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.016011+0000", 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153795 2024-09-14T08:39:28.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.016129+0000", 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118539 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:213 3.c 3:37a15ce0:::rbd_data.10f1cfbb7ac7.0000000000000001:3 [sparse-read 3145728~20992] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043561+0000", 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3608812700000001, 2024-09-14T08:39:28.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052932819999999998, 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 213 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043561+0000", 2024-09-14T08:39:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043561+0000", 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043561+0000", 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043564+0000", 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043573+0000", 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0529999999999996e-06 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043582+0000", 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7600000000000008e-06 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047844+0000", 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042620660000000001 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.047985+0000", 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141419 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048854+0000", 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086846700000000005 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:215 3.c 3:37a15ce0:::rbd_data.10f1cfbb7ac7.0000000000000001:3 [sparse-read 3670016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.043593+0000", 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3608490299999998, 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054248780000000002, 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.472 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 215 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043593+0000", 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043593+0000", 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043594+0000", 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4700000000000001e-07 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043621+0000", 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7319999999999999e-05 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043632+0000", 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0943e-05 2024-09-14T08:39:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.043639+0000", 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2599999999999999e-06 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048879+0000", 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052399780000000002 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048928+0000", 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8729000000000001e-05 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049018+0000", 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9901000000000005e-05 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.476 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:248 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.046275+0000", 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3581670920000004, 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071489910000000004, 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 248 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046275+0000", 2024-09-14T08:39:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046275+0000", 2024-09-14T08:39:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046276+0000", 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5799999999999998e-07 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046281+0000", 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7869999999999998e-06 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046294+0000", 2024-09-14T08:39:28.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2271e-05 2024-09-14T08:39:28.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046302+0000", 2024-09-14T08:39:28.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9340000000000006e-06 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049040+0000", 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027385310000000002 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049092+0000", 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1378000000000002e-05 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049351+0000", 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025938300000000002 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053283+0000", 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039319000000000003 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053352+0000", 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8917000000000004e-05 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053392+0000", 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0682000000000001e-05 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053424+0000", 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1350000000000003e-05 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:249 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.046409+0000", 2024-09-14T08:39:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3580329510000002, 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072564029999999998, 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 249 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046409+0000", 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046409+0000", 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046410+0000", 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5999999999999991e-07 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046415+0000", 2024-09-14T08:39:28.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3990000000000003e-06 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046435+0000", 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0134999999999999e-05 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.046450+0000", 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4073000000000001e-05 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049707+0000", 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032576910000000001 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049794+0000", 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6284000000000003e-05 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.050099+0000", 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030514700000000002 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053295+0000", 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031961099999999998 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053502+0000", 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020673600000000001 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053585+0000", 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3024999999999999e-05 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053665+0000", 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0842999999999998e-05 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:262 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.048553+0000", 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3558886699999997, 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054683309999999999, 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 262 2024-09-14T08:39:28.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048553+0000", 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048553+0000", 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048554+0000", 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4e-07 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048562+0000", 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6359999999999994e-06 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048577+0000", 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5116000000000001e-05 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.048587+0000", 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7180000000000008e-06 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.050551+0000", 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019643 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.050604+0000", 2024-09-14T08:39:28.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2927999999999999e-05 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.050816+0000", 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196100000000001 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053684+0000", 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002868532 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053813+0000", 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012891500000000001 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053949+0000", 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013596499999999999 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054022+0000", 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2319999999999999e-05 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:263 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.049303+0000", 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3551386599999997, 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049598230000000004, 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 263 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049303+0000", 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049303+0000", 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049305+0000", 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2610000000000001e-06 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049310+0000", 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7910000000000001e-06 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049324+0000", 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.376e-05 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049334+0000", 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7529999999999996e-06 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.051135+0000", 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001801219 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.051196+0000", 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1117000000000005e-05 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.051487+0000", 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029052199999999998 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.053692+0000", 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022049040000000002 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054125+0000", 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043336699999999999 2024-09-14T08:39:28.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054205+0000", 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0340000000000007e-05 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054263+0000", 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7788999999999998e-05 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:265 3.c 3:379b1310:::rbd_object_map.10f13f8886eb:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.049624+0000", 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3548183250000001, 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005334325, 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 265 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049624+0000", 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049624+0000", 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049624+0000", 2024-09-14T08:39:28.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049631+0000", 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2029999999999997e-06 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049647+0000", 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6597999999999999e-05 2024-09-14T08:39:28.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.049656+0000", 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7900000000000005e-06 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.051947+0000", 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022906929999999999 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.052096+0000", 2024-09-14T08:39:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014928200000000001 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.052758+0000", 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066204299999999996 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054051+0000", 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001292938 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054836+0000", 2024-09-14T08:39:28.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078517500000000004 2024-09-14T08:39:28.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054906+0000", 2024-09-14T08:39:28.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9924000000000003e-05 2024-09-14T08:39:28.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054958+0000", 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1780999999999998e-05 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:274 3.10 3:0e40f4c4:::rbd_data.10f13f8886eb.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write 2621440~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.054161+0000", 2024-09-14T08:39:28.508 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.350281378, 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043537330000000003, 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 274 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054161+0000", 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054161+0000", 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054161+0000", 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.16e-07 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054272+0000", 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110264 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054282+0000", 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0362e-05 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054291+0000", 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6880000000000005e-06 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054378+0000", 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7706000000000004e-05 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.054599+0000", 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000220509 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.055181+0000", 2024-09-14T08:39:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058193600000000002 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.057315+0000", 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021341480000000002 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.058298+0000", 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098311100000000005 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.058402+0000", 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104156 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.058514+0000", 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111937 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.515 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:575 3.c 3:30d18223:::rbd_header.10f13f8886eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-14T08:39:28.515 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.411967+0000", 2024-09-14T08:39:28.515 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9924752059999999, 2024-09-14T08:39:28.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0063602340000000002, 2024-09-14T08:39:28.515 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.515 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.515 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:28.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 575 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.411967+0000", 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.411967+0000", 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.411969+0000", 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.729e-06 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.411982+0000", 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2804e-05 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.412006+0000", 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3825999999999999e-05 2024-09-14T08:39:28.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.412019+0000", 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3402e-05 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.412137+0000", 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117049 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.412149+0000", 2024-09-14T08:39:28.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2429000000000001e-05 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.415368+0000", 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032186179999999999 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.415461+0000", 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3296999999999998e-05 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:28.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.415793+0000", 2024-09-14T08:39:28.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033259199999999999 2024-09-14T08:39:28.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:28.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.416932+0000", 2024-09-14T08:39:28.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001138694 2024-09-14T08:39:28.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:28.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.418240+0000", 2024-09-14T08:39:28.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001307643 2024-09-14T08:39:28.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:28.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.418288+0000", 2024-09-14T08:39:28.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8421000000000003e-05 2024-09-14T08:39:28.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.418327+0000", 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8729999999999997e-05 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4405.0:642 3.c 3:30d18223:::rbd_header.10f13f8886eb:head [watch reconnect cookie 140227595352256 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:24.736457+0000", 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.6679850599999999, 2024-09-14T08:39:28.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0056721030000000004, 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4405", 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2066956283", 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 642 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736457+0000", 2024-09-14T08:39:28.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736457+0000", 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736458+0000", 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:28.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736462+0000", 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0369999999999996e-06 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736470+0000", 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9489999999999996e-06 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.736478+0000", 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2439999999999993e-06 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.737470+0000", 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099203599999999996 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.737613+0000", 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143299 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.739214+0000", 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001600466 2024-09-14T08:39:28.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.739330+0000", 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116246 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:24.742129+0000", 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027988829999999998 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:28.527 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:28.528 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:28.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:39:28.530 INFO:teuthology.orchestra.run.smithi188.stdout:128 trunc from 0x8fe9a00 to 0xd188a00 2024-09-14T08:39:28.530 INFO:teuthology.orchestra.run.smithi188.stdout:129 read 0x291d800 thru 0x291f4af (0x1cb0 bytes) 2024-09-14T08:39:28.530 INFO:teuthology.orchestra.run.smithi188.stdout:131 write 0xa90a000 thru 0xa915994 (0xb995 bytes) 2024-09-14T08:39:28.530 INFO:teuthology.orchestra.run.smithi188.stdout:135 trunc from 0xd188a00 to 0x4ccd200 2024-09-14T08:39:28.530 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:28.535+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:28.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:28.571 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T08:39:28.572 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:39:28.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:39:28.590 INFO:teuthology.orchestra.run.smithi188.stdout:136 punch from 0x2e8c600 to 0x2e94800, (0x8200 bytes) 2024-09-14T08:39:28.622 INFO:teuthology.orchestra.run.smithi188.stdout:137 write 0x546ce00 thru 0x54705de (0x37df bytes) 2024-09-14T08:39:28.629 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:28.632+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:28.635 INFO:teuthology.orchestra.run.smithi188.stdout:138 trunc from 0x5470600 to 0xab61a00 2024-09-14T08:39:28.657 INFO:teuthology.orchestra.run.smithi188.stdout:140 read 0x34a0000 thru 0x34aad5f (0xad60 bytes) 2024-09-14T08:39:28.684 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:28.684 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:28.684 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:28.684 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:28.701 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:28.702 INFO:teuthology.orchestra.run.smithi188.stdout:144 trunc from 0xab61a00 to 0x2c53c00 2024-09-14T08:39:28.750 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:28.756+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:28.756 INFO:teuthology.orchestra.run.smithi188.stdout:147 read 0x2565600 thru 0x256e777 (0x9178 bytes) 2024-09-14T08:39:28.772 INFO:teuthology.orchestra.run.smithi188.stdout:148 trunc from 0x2c53c00 to 0x710fc00 2024-09-14T08:39:28.789 INFO:teuthology.orchestra.run.smithi188.stdout:150 read 0x10b2400 thru 0x10b6360 (0x3f61 bytes) 2024-09-14T08:39:28.792 INFO:teuthology.orchestra.run.smithi188.stdout:151 write 0xeda00 thru 0xfbe36 (0xe437 bytes) 2024-09-14T08:39:28.793 INFO:teuthology.orchestra.run.smithi188.stdout:152 write 0x2100200 thru 0x210aa80 (0xa881 bytes) 2024-09-14T08:39:28.794 INFO:teuthology.orchestra.run.smithi188.stdout:153 read 0x1edc200 thru 0x1ee1e84 (0x5c85 bytes) 2024-09-14T08:39:28.796 INFO:teuthology.orchestra.run.smithi188.stdout:159 read 0x670a600 thru 0x6715862 (0xb263 bytes) 2024-09-14T08:39:28.796 INFO:teuthology.orchestra.run.smithi188.stdout:160 read 0x2009a00 thru 0x2016231 (0xc832 bytes) 2024-09-14T08:39:28.798 INFO:teuthology.orchestra.run.smithi188.stdout:161 read 0x17dd200 thru 0x17ecd52 (0xfb53 bytes) 2024-09-14T08:39:28.800 INFO:teuthology.orchestra.run.smithi188.stdout:162 read 0x41ce00 thru 0x4240d0 (0x72d1 bytes) 2024-09-14T08:39:28.802 INFO:teuthology.orchestra.run.smithi188.stdout:165 read 0x2751c00 thru 0x27597c5 (0x7bc6 bytes) 2024-09-14T08:39:28.804 INFO:teuthology.orchestra.run.smithi188.stdout:169 punch from 0x1de3200 to 0x1deb400, (0x8200 bytes) 2024-09-14T08:39:28.832 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:28.836+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:28.839 INFO:teuthology.orchestra.run.smithi188.stdout:170 trunc from 0x710fc00 to 0xbf7aa00 2024-09-14T08:39:28.880 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:28.880 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:28.880 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:28.880 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:28.880 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:28.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:28.932 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:28.939+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:39:28.954 INFO:teuthology.orchestra.run.smithi188.stdout:172 write 0x4e9aa00 thru 0x4ea52cd (0xa8ce bytes) 2024-09-14T08:39:28.956 INFO:teuthology.orchestra.run.smithi188.stdout:174 write 0x5091600 thru 0x5095026 (0x3a27 bytes) 2024-09-14T08:39:28.956 INFO:teuthology.orchestra.run.smithi188.stdout:truncating to largest ever: 0xee2de00 2024-09-14T08:39:28.956 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-14T08:39:28.329952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68519893,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2987,"num_read_kb":5026,"num_write":282,"num_write_kb":2574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":182804,"kb_used_data":3992,"kb_used_omap":9,"kb_used_meta":178678,"kb_avail":566048236,"statfs":{"total":579820584960,"available":579633393664,"internally_reserved":0,"allocated":4087808,"data_stored":2900946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":182966944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":67929457,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":2867,"num_read_kb":4924,"num_write":175,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.941510"},"pg_stats":[{"pgid":"3.1f","version":"24'1","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.982916+0000","last_change":"2024-09-14T08:39:20.404557+0000","last_active":"2024-09-14T08:39:24.982916+0000","last_peered":"2024-09-14T08:39:24.982916+0000","last_clean":"2024-09-14T08:39:24.982916+0000","last_became_active":"2024-09-14T08:39:18.391902+0000","last_became_peered":"2024-09-14T08:39:18.391902+0000","last_unstale":"2024-09-14T08:39:24.982916+0000","last_undegraded":"2024-09-14T08:39:24.982916+0000","last_fullsized":"2024-09-14T08:39:24.982916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:03.291643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001451897,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1e","version":"25'1","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.410651+0000","last_change":"2024-09-14T08:39:20.418973+0000","last_active":"2024-09-14T08:39:24.410651+0000","last_peered":"2024-09-14T08:39:24.410651+0000","last_clean":"2024-09-14T08:39:24.410651+0000","last_became_active":"2024-09-14T08:39:18.380137+0000","last_became_peered":"2024-09-14T08:39:18.380137+0000","last_unstale":"2024-09-14T08:39:24.410651+0000","last_undegraded":"2024-09-14T08:39:24.410651+0000","last_fullsized":"2024-09-14T08:39:24.410651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:19.143080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013459450000000001,"stat_sum":{"num_bytes":3801088,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":132,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1d","version":"25'2","reported_seq":205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.901194+0000","last_change":"2024-09-14T08:39:20.399554+0000","last_active":"2024-09-14T08:39:24.901194+0000","last_peered":"2024-09-14T08:39:24.901194+0000","last_clean":"2024-09-14T08:39:24.901194+0000","last_became_active":"2024-09-14T08:39:18.383208+0000","last_became_peered":"2024-09-14T08:39:18.383208+0000","last_unstale":"2024-09-14T08:39:24.901194+0000","last_undegraded":"2024-09-14T08:39:24.901194+0000","last_fullsized":"2024-09-14T08:39:24.901194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:42.802624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003027493,"stat_sum":{"num_bytes":7595520,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":179,"num_read_kb":784,"num_write":3,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1c","version":"26'4","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.768632+0000","last_change":"2024-09-14T08:39:20.396598+0000","last_active":"2024-09-14T08:39:24.768632+0000","last_peered":"2024-09-14T08:39:24.768632+0000","last_clean":"2024-09-14T08:39:24.768632+0000","last_became_active":"2024-09-14T08:39:18.384784+0000","last_became_peered":"2024-09-14T08:39:18.384784+0000","last_unstale":"2024-09-14T08:39:24.768632+0000","last_undegraded":"2024-09-14T08:39:24.768632+0000","last_fullsized":"2024-09-14T08:39:24.768632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:19.345649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001345691,"stat_sum":{"num_bytes":6255616,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":30,"num_write":4,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.418870+0000","last_change":"2024-09-14T08:39:20.405106+0000","last_active":"2024-09-14T08:39:24.418870+0000","last_peered":"2024-09-14T08:39:24.418870+0000","last_clean":"2024-09-14T08:39:24.418870+0000","last_became_active":"2024-09-14T08:39:18.385569+0000","last_became_peered":"2024-09-14T08:39:18.385569+0000","last_unstale":"2024-09-14T08:39:24.418870+0000","last_undegraded":"2024-09-14T08:39:24.418870+0000","last_fullsized":"2024-09-14T08:39:24.418870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:48.482460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1a","version":"24'5","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:26.253852+0000","last_change":"2024-09-14T08:39:20.388365+0000","last_active":"2024-09-14T08:39:26.253852+0000","last_peered":"2024-09-14T08:39:26.253852+0000","last_clean":"2024-09-14T08:39:26.253852+0000","last_became_active":"2024-09-14T08:39:18.383879+0000","last_became_peered":"2024-09-14T08:39:18.383879+0000","last_unstale":"2024-09-14T08:39:26.253852+0000","last_undegraded":"2024-09-14T08:39:26.253852+0000","last_fullsized":"2024-09-14T08:39:26.253852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:35.899664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211712,"stat_sum":{"num_bytes":1581075,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":257,"num_write":5,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.19","version":"25'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:26.202087+0000","last_change":"2024-09-14T08:39:20.386019+0000","last_active":"2024-09-14T08:39:26.202087+0000","last_peered":"2024-09-14T08:39:26.202087+0000","last_clean":"2024-09-14T08:39:26.202087+0000","last_became_active":"2024-09-14T08:39:18.384097+0000","last_became_peered":"2024-09-14T08:39:18.384097+0000","last_unstale":"2024-09-14T08:39:26.202087+0000","last_undegraded":"2024-09-14T08:39:26.202087+0000","last_fullsized":"2024-09-14T08:39:26.202087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:50.342815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014331750000000001,"stat_sum":{"num_bytes":2752512,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":1,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.409975+0000","last_change":"2024-09-14T08:39:20.418001+0000","last_active":"2024-09-14T08:39:24.409975+0000","last_peered":"2024-09-14T08:39:24.409975+0000","last_clean":"2024-09-14T08:39:24.409975+0000","last_became_active":"2024-09-14T08:39:18.385267+0000","last_became_peered":"2024-09-14T08:39:18.385267+0000","last_unstale":"2024-09-14T08:39:24.409975+0000","last_undegraded":"2024-09-14T08:39:24.409975+0000","last_fullsized":"2024-09-14T08:39:24.409975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:59.616773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.17","version":"26'11","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.869208+0000","last_change":"2024-09-14T08:39:20.404796+0000","last_active":"2024-09-14T08:39:24.869208+0000","last_peered":"2024-09-14T08:39:24.869208+0000","last_clean":"2024-09-14T08:39:24.869208+0000","last_became_active":"2024-09-14T08:39:18.385663+0000","last_became_peered":"2024-09-14T08:39:18.385663+0000","last_unstale":"2024-09-14T08:39:24.869208+0000","last_undegraded":"2024-09-14T08:39:24.869208+0000","last_fullsized":"2024-09-14T08:39:24.869208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:21.569506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862059999999999,"stat_sum":{"num_bytes":5820973,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":101,"num_write":8,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.414966+0000","last_change":"2024-09-14T08:39:20.398753+0000","last_active":"2024-09-14T08:39:24.414966+0000","last_peered":"2024-09-14T08:39:24.414966+0000","last_clean":"2024-09-14T08:39:24.414966+0000","last_became_active":"2024-09-14T08:39:18.390054+0000","last_became_peered":"2024-09-14T08:39:18.390054+0000","last_unstale":"2024-09-14T08:39:24.414966+0000","last_undegraded":"2024-09-14T08:39:24.414966+0000","last_fullsized":"2024-09-14T08:39:24.414966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:44.884514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029337040000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.15","version":"25'1","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.408794+0000","last_change":"2024-09-14T08:39:20.410942+0000","last_active":"2024-09-14T08:39:24.408794+0000","last_peered":"2024-09-14T08:39:24.408794+0000","last_clean":"2024-09-14T08:39:24.408794+0000","last_became_active":"2024-09-14T08:39:18.391530+0000","last_became_peered":"2024-09-14T08:39:18.391530+0000","last_unstale":"2024-09-14T08:39:24.408794+0000","last_undegraded":"2024-09-14T08:39:24.408794+0000","last_fullsized":"2024-09-14T08:39:24.408794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:51.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018449409999999999,"stat_sum":{"num_bytes":3670016,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":44,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.14","version":"24'3","reported_seq":173,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:25.726738+0000","last_change":"2024-09-14T08:39:20.410293+0000","last_active":"2024-09-14T08:39:25.726738+0000","last_peered":"2024-09-14T08:39:25.726738+0000","last_clean":"2024-09-14T08:39:25.726738+0000","last_became_active":"2024-09-14T08:39:18.386000+0000","last_became_peered":"2024-09-14T08:39:18.386000+0000","last_unstale":"2024-09-14T08:39:25.726738+0000","last_undegraded":"2024-09-14T08:39:25.726738+0000","last_fullsized":"2024-09-14T08:39:25.726738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:13.414453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014343330000000001,"stat_sum":{"num_bytes":8828928,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":144,"num_read_kb":463,"num_write":3,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.409446+0000","last_change":"2024-09-14T08:39:10.710340+0000","last_active":"2024-09-14T08:39:24.409446+0000","last_peered":"2024-09-14T08:39:24.409446+0000","last_clean":"2024-09-14T08:39:24.409446+0000","last_became_active":"2024-09-14T08:39:08.202439+0000","last_became_peered":"2024-09-14T08:39:08.202439+0000","last_unstale":"2024-09-14T08:39:24.409446+0000","last_undegraded":"2024-09-14T08:39:24.409446+0000","last_fullsized":"2024-09-14T08:39:24.409446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:23.410553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001636462,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.419107+0000","last_change":"2024-09-14T08:39:20.404871+0000","last_active":"2024-09-14T08:39:24.419107+0000","last_peered":"2024-09-14T08:39:24.419107+0000","last_clean":"2024-09-14T08:39:24.419107+0000","last_became_active":"2024-09-14T08:39:18.385193+0000","last_became_peered":"2024-09-14T08:39:18.385193+0000","last_unstale":"2024-09-14T08:39:24.419107+0000","last_undegraded":"2024-09-14T08:39:24.419107+0000","last_fullsized":"2024-09-14T08:39:24.419107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:34.436045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484614,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.424084+0000","last_change":"2024-09-14T08:39:10.138177+0000","last_active":"2024-09-14T08:39:24.424084+0000","last_peered":"2024-09-14T08:39:24.424084+0000","last_clean":"2024-09-14T08:39:24.424084+0000","last_became_active":"2024-09-14T08:39:08.132530+0000","last_became_peered":"2024-09-14T08:39:08.132530+0000","last_unstale":"2024-09-14T08:39:24.424084+0000","last_undegraded":"2024-09-14T08:39:24.424084+0000","last_fullsized":"2024-09-14T08:39:24.424084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:17.902057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"26'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.778552+0000","last_change":"2024-09-14T08:39:20.419181+0000","last_active":"2024-09-14T08:39:24.778552+0000","last_peered":"2024-09-14T08:39:24.778552+0000","last_clean":"2024-09-14T08:39:24.778552+0000","last_became_active":"2024-09-14T08:39:18.382867+0000","last_became_peered":"2024-09-14T08:39:18.382867+0000","last_unstale":"2024-09-14T08:39:24.778552+0000","last_undegraded":"2024-09-14T08:39:24.778552+0000","last_fullsized":"2024-09-14T08:39:24.778552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:01.238185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015322599999999999,"stat_sum":{"num_bytes":39,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.408958+0000","last_change":"2024-09-14T08:39:10.709775+0000","last_active":"2024-09-14T08:39:24.408958+0000","last_peered":"2024-09-14T08:39:24.408958+0000","last_clean":"2024-09-14T08:39:24.408958+0000","last_became_active":"2024-09-14T08:39:08.126303+0000","last_became_peered":"2024-09-14T08:39:08.126303+0000","last_unstale":"2024-09-14T08:39:24.408958+0000","last_undegraded":"2024-09-14T08:39:24.408958+0000","last_fullsized":"2024-09-14T08:39:24.408958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:58.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.424250+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:39:24.424250+0000","last_peered":"2024-09-14T08:39:24.424250+0000","last_clean":"2024-09-14T08:39:24.424250+0000","last_became_active":"2024-09-14T08:39:18.387737+0000","last_became_peered":"2024-09-14T08:39:18.387737+0000","last_unstale":"2024-09-14T08:39:24.424250+0000","last_undegraded":"2024-09-14T08:39:24.424250+0000","last_fullsized":"2024-09-14T08:39:24.424250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:01.951211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010096059999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.424613+0000","last_change":"2024-09-14T08:39:10.138175+0000","last_active":"2024-09-14T08:39:24.424613+0000","last_peered":"2024-09-14T08:39:24.424613+0000","last_clean":"2024-09-14T08:39:24.424613+0000","last_became_active":"2024-09-14T08:39:08.128925+0000","last_became_peered":"2024-09-14T08:39:08.128925+0000","last_unstale":"2024-09-14T08:39:24.424613+0000","last_undegraded":"2024-09-14T08:39:24.424613+0000","last_fullsized":"2024-09-14T08:39:24.424613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:02.017543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.414966+0000","last_change":"2024-09-14T08:39:20.399293+0000","last_active":"2024-09-14T08:39:24.414966+0000","last_peered":"2024-09-14T08:39:24.414966+0000","last_clean":"2024-09-14T08:39:24.414966+0000","last_became_active":"2024-09-14T08:39:18.382577+0000","last_became_peered":"2024-09-14T08:39:18.382577+0000","last_unstale":"2024-09-14T08:39:24.414966+0000","last_undegraded":"2024-09-14T08:39:24.414966+0000","last_fullsized":"2024-09-14T08:39:24.414966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:05.050650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032365710000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"26'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:26.310417+0000","last_change":"2024-09-14T08:39:20.388762+0000","last_active":"2024-09-14T08:39:26.310417+0000","last_peered":"2024-09-14T08:39:26.310417+0000","last_clean":"2024-09-14T08:39:26.310417+0000","last_became_active":"2024-09-14T08:39:18.388033+0000","last_became_peered":"2024-09-14T08:39:18.388033+0000","last_unstale":"2024-09-14T08:39:26.310417+0000","last_undegraded":"2024-09-14T08:39:26.310417+0000","last_fullsized":"2024-09-14T08:39:26.310417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:54.299474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599846,"stat_sum":{"num_bytes":98304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":68,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.414770+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:24.414770+0000","last_peered":"2024-09-14T08:39:24.414770+0000","last_clean":"2024-09-14T08:39:24.414770+0000","last_became_active":"2024-09-14T08:39:08.130091+0000","last_became_peered":"2024-09-14T08:39:08.130091+0000","last_unstale":"2024-09-14T08:39:24.414770+0000","last_undegraded":"2024-09-14T08:39:24.414770+0000","last_fullsized":"2024-09-14T08:39:24.414770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:12.463612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"26'3","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.841311+0000","last_change":"2024-09-14T08:39:20.385113+0000","last_active":"2024-09-14T08:39:24.841311+0000","last_peered":"2024-09-14T08:39:24.841311+0000","last_clean":"2024-09-14T08:39:24.841311+0000","last_became_active":"2024-09-14T08:39:18.387585+0000","last_became_peered":"2024-09-14T08:39:18.387585+0000","last_unstale":"2024-09-14T08:39:24.841311+0000","last_undegraded":"2024-09-14T08:39:24.841311+0000","last_fullsized":"2024-09-14T08:39:24.841311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:00.754468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058750299999999996,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":3,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.409682+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:39:24.409682+0000","last_peered":"2024-09-14T08:39:24.409682+0000","last_clean":"2024-09-14T08:39:24.409682+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:39:24.409682+0000","last_undegraded":"2024-09-14T08:39:24.409682+0000","last_fullsized":"2024-09-14T08:39:24.409682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.418689+0000","last_change":"2024-09-14T08:39:20.403555+0000","last_active":"2024-09-14T08:39:24.418689+0000","last_peered":"2024-09-14T08:39:24.418689+0000","last_clean":"2024-09-14T08:39:24.418689+0000","last_became_active":"2024-09-14T08:39:18.385570+0000","last_became_peered":"2024-09-14T08:39:18.385570+0000","last_unstale":"2024-09-14T08:39:24.418689+0000","last_undegraded":"2024-09-14T08:39:24.418689+0000","last_fullsized":"2024-09-14T08:39:24.418689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:43.866272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047135900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.408241+0000","last_change":"2024-09-14T08:39:10.709726+0000","last_active":"2024-09-14T08:39:24.408241+0000","last_peered":"2024-09-14T08:39:24.408241+0000","last_clean":"2024-09-14T08:39:24.408241+0000","last_became_active":"2024-09-14T08:39:08.129482+0000","last_became_peered":"2024-09-14T08:39:08.129482+0000","last_unstale":"2024-09-14T08:39:24.408241+0000","last_undegraded":"2024-09-14T08:39:24.408241+0000","last_fullsized":"2024-09-14T08:39:24.408241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.464996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010748229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"26'3","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:26.309035+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:39:26.309035+0000","last_peered":"2024-09-14T08:39:26.309035+0000","last_clean":"2024-09-14T08:39:26.309035+0000","last_became_active":"2024-09-14T08:39:18.387242+0000","last_became_peered":"2024-09-14T08:39:18.387242+0000","last_unstale":"2024-09-14T08:39:26.309035+0000","last_undegraded":"2024-09-14T08:39:26.309035+0000","last_fullsized":"2024-09-14T08:39:26.309035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:32.169008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332069,"stat_sum":{"num_bytes":5551632,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":111,"num_write":3,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.414766+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:39:24.414766+0000","last_peered":"2024-09-14T08:39:24.414766+0000","last_clean":"2024-09-14T08:39:24.414766+0000","last_became_active":"2024-09-14T08:39:08.129594+0000","last_became_peered":"2024-09-14T08:39:08.129594+0000","last_unstale":"2024-09-14T08:39:24.414766+0000","last_undegraded":"2024-09-14T08:39:24.414766+0000","last_fullsized":"2024-09-14T08:39:24.414766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:50.092003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001084296,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.409515+0000","last_change":"2024-09-14T08:39:19.413056+0000","last_active":"2024-09-14T08:39:24.409515+0000","last_peered":"2024-09-14T08:39:24.409515+0000","last_clean":"2024-09-14T08:39:24.409515+0000","last_became_active":"2024-09-14T08:39:19.391073+0000","last_became_peered":"2024-09-14T08:39:19.391073+0000","last_unstale":"2024-09-14T08:39:24.409515+0000","last_undegraded":"2024-09-14T08:39:24.409515+0000","last_fullsized":"2024-09-14T08:39:24.409515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:47.792966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'30","reported_seq":58,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.409994+0000","last_change":"2024-09-14T08:39:20.418935+0000","last_active":"2024-09-14T08:39:24.409994+0000","last_peered":"2024-09-14T08:39:24.409994+0000","last_clean":"2024-09-14T08:39:24.409994+0000","last_became_active":"2024-09-14T08:39:18.382844+0000","last_became_peered":"2024-09-14T08:39:18.382844+0000","last_unstale":"2024-09-14T08:39:24.409994+0000","last_undegraded":"2024-09-14T08:39:24.409994+0000","last_fullsized":"2024-09-14T08:39:24.409994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:40:42.945939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013334390000000001,"stat_sum":{"num_bytes":45,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":96,"num_write":43,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.436460+0000","last_change":"2024-09-14T08:39:20.388278+0000","last_active":"2024-09-14T08:39:24.436460+0000","last_peered":"2024-09-14T08:39:24.436460+0000","last_clean":"2024-09-14T08:39:24.436460+0000","last_became_active":"2024-09-14T08:39:18.383829+0000","last_became_peered":"2024-09-14T08:39:18.383829+0000","last_unstale":"2024-09-14T08:39:24.436460+0000","last_undegraded":"2024-09-14T08:39:24.436460+0000","last_fullsized":"2024-09-14T08:39:24.436460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:03.039856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011980249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.a","version":"26'51","reported_seq":551,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:26.023910+0000","last_change":"2024-09-14T08:39:20.413449+0000","last_active":"2024-09-14T08:39:26.023910+0000","last_peered":"2024-09-14T08:39:26.023910+0000","last_clean":"2024-09-14T08:39:26.023910+0000","last_became_active":"2024-09-14T08:39:18.385339+0000","last_became_peered":"2024-09-14T08:39:18.385339+0000","last_unstale":"2024-09-14T08:39:26.023910+0000","last_undegraded":"2024-09-14T08:39:26.023910+0000","last_fullsized":"2024-09-14T08:39:26.023910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:20.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002911753,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1079,"num_read_kb":927,"num_write":24,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.424623+0000","last_change":"2024-09-14T08:39:20.385900+0000","last_active":"2024-09-14T08:39:24.424623+0000","last_peered":"2024-09-14T08:39:24.424623+0000","last_clean":"2024-09-14T08:39:24.424623+0000","last_became_active":"2024-09-14T08:39:18.388739+0000","last_became_peered":"2024-09-14T08:39:18.388739+0000","last_unstale":"2024-09-14T08:39:24.424623+0000","last_undegraded":"2024-09-14T08:39:24.424623+0000","last_fullsized":"2024-09-14T08:39:24.424623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:47.645036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013500459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.c","version":"26'56","reported_seq":444,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:25.329116+0000","last_change":"2024-09-14T08:39:20.397310+0000","last_active":"2024-09-14T08:39:25.329116+0000","last_peered":"2024-09-14T08:39:25.329116+0000","last_clean":"2024-09-14T08:39:25.329116+0000","last_became_active":"2024-09-14T08:39:18.391373+0000","last_became_peered":"2024-09-14T08:39:18.391373+0000","last_unstale":"2024-09-14T08:39:25.329116+0000","last_undegraded":"2024-09-14T08:39:25.329116+0000","last_fullsized":"2024-09-14T08:39:25.329116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:38.878941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652499,"stat_sum":{"num_bytes":3167783,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":860,"num_read_kb":816,"num_write":60,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.d","version":"25'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.408709+0000","last_change":"2024-09-14T08:39:20.411611+0000","last_active":"2024-09-14T08:39:24.408709+0000","last_peered":"2024-09-14T08:39:24.408709+0000","last_clean":"2024-09-14T08:39:24.408709+0000","last_became_active":"2024-09-14T08:39:18.373934+0000","last_became_peered":"2024-09-14T08:39:18.373934+0000","last_unstale":"2024-09-14T08:39:24.408709+0000","last_undegraded":"2024-09-14T08:39:24.408709+0000","last_fullsized":"2024-09-14T08:39:24.408709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:33.950747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024901429999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.e","version":"25'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.415210+0000","last_change":"2024-09-14T08:39:20.397983+0000","last_active":"2024-09-14T08:39:24.415210+0000","last_peered":"2024-09-14T08:39:24.415210+0000","last_clean":"2024-09-14T08:39:24.415210+0000","last_became_active":"2024-09-14T08:39:18.384061+0000","last_became_peered":"2024-09-14T08:39:18.384061+0000","last_unstale":"2024-09-14T08:39:24.415210+0000","last_undegraded":"2024-09-14T08:39:24.415210+0000","last_fullsized":"2024-09-14T08:39:24.415210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:37.950746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002389113,"stat_sum":{"num_bytes":3801088,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":36,"num_write":2,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.f","version":"25'2","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.415353+0000","last_change":"2024-09-14T08:39:20.398068+0000","last_active":"2024-09-14T08:39:24.415353+0000","last_peered":"2024-09-14T08:39:24.415353+0000","last_clean":"2024-09-14T08:39:24.415353+0000","last_became_active":"2024-09-14T08:39:18.389870+0000","last_became_peered":"2024-09-14T08:39:18.389870+0000","last_unstale":"2024-09-14T08:39:24.415353+0000","last_undegraded":"2024-09-14T08:39:24.415353+0000","last_fullsized":"2024-09-14T08:39:24.415353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:00.077672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023917970000000002,"stat_sum":{"num_bytes":3677696,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":72,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.10","version":"26'4","reported_seq":124,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:25.253760+0000","last_change":"2024-09-14T08:39:20.397454+0000","last_active":"2024-09-14T08:39:25.253760+0000","last_peered":"2024-09-14T08:39:25.253760+0000","last_clean":"2024-09-14T08:39:25.253760+0000","last_became_active":"2024-09-14T08:39:18.391204+0000","last_became_peered":"2024-09-14T08:39:18.391204+0000","last_unstale":"2024-09-14T08:39:25.253760+0000","last_undegraded":"2024-09-14T08:39:25.253760+0000","last_fullsized":"2024-09-14T08:39:25.253760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:25.727739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024547029999999999,"stat_sum":{"num_bytes":11327159,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":1007,"num_write":5,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.11","version":"25'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.408348+0000","last_change":"2024-09-14T08:39:20.410176+0000","last_active":"2024-09-14T08:39:24.408348+0000","last_peered":"2024-09-14T08:39:24.408348+0000","last_clean":"2024-09-14T08:39:24.408348+0000","last_became_active":"2024-09-14T08:39:18.385169+0000","last_became_peered":"2024-09-14T08:39:18.385169+0000","last_unstale":"2024-09-14T08:39:24.408348+0000","last_undegraded":"2024-09-14T08:39:24.408348+0000","last_fullsized":"2024-09-14T08:39:24.408348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:49.609321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001362044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.418583+0000","last_change":"2024-09-14T08:39:20.404573+0000","last_active":"2024-09-14T08:39:24.418583+0000","last_peered":"2024-09-14T08:39:24.418583+0000","last_clean":"2024-09-14T08:39:24.418583+0000","last_became_active":"2024-09-14T08:39:18.390426+0000","last_became_peered":"2024-09-14T08:39:18.390426+0000","last_unstale":"2024-09-14T08:39:24.418583+0000","last_undegraded":"2024-09-14T08:39:24.418583+0000","last_fullsized":"2024-09-14T08:39:24.418583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:48.960988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013117140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.13","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T08:39:24.408769+0000","last_change":"2024-09-14T08:39:20.410788+0000","last_active":"2024-09-14T08:39:24.408769+0000","last_peered":"2024-09-14T08:39:24.408769+0000","last_clean":"2024-09-14T08:39:24.408769+0000","last_became_active":"2024-09-14T08:39:18.381187+0000","last_became_peered":"2024-09-14T08:39:18.381187+0000","last_unstale":"2024-09-14T08:39:24.408769+0000","last_undegraded":"2024-09-14T08:39:24.408769+0000","last_fullsized":"2024-09-14T08:39:24.408769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:01.881399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018326740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":67929506,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2921,"num_read_kb":4971,"num_write":179,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1331200,"data_stored":1164100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1241088,"data_stored":1042100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":413696,"data_stored":233105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":872448,"data_stored":685317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":137499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607561,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":741376,"data_stored":517184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607562,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":479232,"data_stored":285741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":196379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":42631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":138256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":358931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":427803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:39:28.985 INFO:teuthology.orchestra.run.smithi188.stdout:175 trunc from 0xbf7aa00 to 0xee2de00 2024-09-14T08:39:29.022 INFO:teuthology.orchestra.run.smithi188.stdout:176 read 0x13a1600 thru 0x13b1567 (0xff68 bytes) 2024-09-14T08:39:29.025 INFO:teuthology.orchestra.run.smithi188.stdout:179 punch from 0x4ead400 to 0x4ebb400, (0xe000 bytes) 2024-09-14T08:39:29.026 INFO:teuthology.orchestra.run.smithi188.stdout:180 punch from 0xdd3fa00 to 0xdd47200, (0x7800 bytes) 2024-09-14T08:39:29.026 INFO:teuthology.orchestra.run.smithi188.stdout:181 write 0x74b8c00 thru 0x74c368f (0xaa90 bytes) 2024-09-14T08:39:29.026 INFO:teuthology.orchestra.run.smithi188.stdout:184 read 0x5aaec00 thru 0x5ab1d0c (0x310d bytes) 2024-09-14T08:39:29.027 INFO:teuthology.orchestra.run.smithi188.stdout:186 write 0x11f2a00 thru 0x11fda91 (0xb092 bytes) 2024-09-14T08:39:29.028 INFO:teuthology.orchestra.run.smithi188.stdout:189 write 0xb5b4200 thru 0xb5bdac1 (0x98c2 bytes) 2024-09-14T08:39:29.028 INFO:teuthology.orchestra.run.smithi188.stdout:190 punch from 0x8950200 to 0x8956400, (0x6200 bytes) 2024-09-14T08:39:29.033 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:29.036+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:29.036 INFO:teuthology.orchestra.run.smithi188.stdout:191 punch from 0x46c600 to 0x471600, (0x5000 bytes) 2024-09-14T08:39:29.039 INFO:teuthology.orchestra.run.smithi188.stdout:192 read 0x6924e00 thru 0x6931441 (0xc642 bytes) 2024-09-14T08:39:29.039 INFO:teuthology.orchestra.run.smithi188.stdout:193 read 0xeb37000 thru 0xeb37a9a (0xa9b bytes) 2024-09-14T08:39:29.039 INFO:teuthology.orchestra.run.smithi188.stdout:195 write 0x6400e00 thru 0x640521f (0x4420 bytes) 2024-09-14T08:39:29.042 INFO:teuthology.orchestra.run.smithi188.stdout:196 trunc from 0xee2de00 to 0xdd0d000 2024-09-14T08:39:29.071 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:29.071 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:29.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:29.071 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:29.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.071 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2390 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.071 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.820688+0000", 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.257471748, 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019638604, 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2390 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820688+0000", 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820688+0000", 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820689+0000", 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8800000000000003e-07 2024-09-14T08:39:29.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820691+0000", 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3549999999999999e-06 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820697+0000", 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.139e-06 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820702+0000", 2024-09-14T08:39:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8099999999999997e-06 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.835619+0000", 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014917298000000001 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.835704+0000", 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4636999999999996e-05 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.840327+0000", 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046228770000000001 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2955 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7512064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836658+0000", 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24150173899999999, 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018285289999999999, 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.076 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2955 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836658+0000", 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836658+0000", 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836659+0000", 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836662+0000", 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7319999999999998e-06 2024-09-14T08:39:29.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836668+0000", 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8619999999999997e-06 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836674+0000", 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3890000000000004e-06 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854792+0000", 2024-09-14T08:39:29.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018118499 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854869+0000", 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6482000000000004e-05 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854944+0000", 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4745000000000003e-05 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2960 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7643136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24143339799999999, 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018428944999999999, 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.081 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2960 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8699999999999995e-07 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836730+0000", 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0809999999999998e-06 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836739+0000", 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9660000000000002e-06 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836746+0000", 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4019999999999999e-06 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854986+0000", 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018240648000000002 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855068+0000", 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2202999999999999e-05 2024-09-14T08:39:29.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855156+0000", 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7058000000000006e-05 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2961 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7577600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.241404482, 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018591317, 2024-09-14T08:39:29.085 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2961 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3300000000000002e-07 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836758+0000", 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2060000000000001e-06 2024-09-14T08:39:29.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836765+0000", 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8159999999999996e-06 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836770+0000", 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1560000000000003e-06 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855196+0000", 2024-09-14T08:39:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018425862000000001 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855273+0000", 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6497999999999998e-05 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855347+0000", 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4245999999999994e-05 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2964 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7774208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24137945799999999, 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018777391000000001, 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2964 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836783+0000", 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2050000000000001e-06 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836790+0000", 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5459999999999997e-06 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836795+0000", 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1050000000000003e-06 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855391+0000", 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018595749000000002 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855473+0000", 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2539000000000004e-05 2024-09-14T08:39:29.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855558+0000", 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4698999999999997e-05 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2966 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7708672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24134926800000001, 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018940373, 2024-09-14T08:39:29.094 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2966 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4199999999999996e-07 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836814+0000", 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6769999999999999e-06 2024-09-14T08:39:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836821+0000", 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5399999999999998e-06 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836827+0000", 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855597+0000", 2024-09-14T08:39:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018769969000000001 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855672+0000", 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4946999999999999e-05 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855751+0000", 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9052000000000001e-05 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2970 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7839744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837047+0000", 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24111300199999999, 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018916101000000001, 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2970 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837047+0000", 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837047+0000", 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837048+0000", 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5199999999999995e-07 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837051+0000", 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5319999999999998e-06 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837062+0000", 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0506000000000001e-05 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837069+0000", 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.905e-06 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855794+0000", 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018725308 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855878+0000", 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4141000000000006e-05 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855963+0000", 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4857000000000004e-05 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2971 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7970816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837079+0000", 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24108070200000001, 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019075076999999999, 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2971 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837079+0000", 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837079+0000", 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837080+0000", 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7199999999999999e-07 2024-09-14T08:39:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837082+0000", 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2129999999999998e-06 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837089+0000", 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837093+0000", 2024-09-14T08:39:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.95e-06 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856003+0000", 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018909281999999999 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856080+0000", 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6796000000000001e-05 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856154+0000", 2024-09-14T08:39:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4844000000000004e-05 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2976 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8101888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24105997000000001, 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019265681999999999, 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2976 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4499999999999997e-07 2024-09-14T08:39:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837102+0000", 2024-09-14T08:39:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:39:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837108+0000", 2024-09-14T08:39:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0190000000000003e-06 2024-09-14T08:39:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837113+0000", 2024-09-14T08:39:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8890000000000001e-06 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856198+0000", 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019084455 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856282+0000", 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4143999999999999e-05 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856366+0000", 2024-09-14T08:39:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3825999999999993e-05 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2980 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7905280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837123+0000", 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.241036997, 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019431517999999998, 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2980 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837123+0000", 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837123+0000", 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837124+0000", 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7000000000000005e-07 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837126+0000", 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1110000000000002e-06 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837132+0000", 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4829999999999996e-06 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837146+0000", 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3647e-05 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856403+0000", 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019256711999999999 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856480+0000", 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7355999999999996e-05 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856555+0000", 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4639000000000001e-05 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2984 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8036352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837196+0000", 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24096363700000001, 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019573896, 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2984 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837196+0000", 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837196+0000", 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837197+0000", 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5099999999999999e-07 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837200+0000", 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3009999999999998e-06 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837209+0000", 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9099999999999994e-06 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837215+0000", 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.767e-06 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856598+0000", 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019382771 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856685+0000", 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7480999999999998e-05 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856770+0000", 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5014999999999998e-05 2024-09-14T08:39:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2985 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8167424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837224+0000", 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24093585100000001, 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019738647000000002, 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2985 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837224+0000", 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837224+0000", 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837225+0000", 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3599999999999999e-07 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837234+0000", 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837240+0000", 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5860000000000001e-06 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837245+0000", 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.87e-06 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856810+0000", 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019564873999999999 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856888+0000", 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8262000000000004e-05 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856963+0000", 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4516000000000003e-05 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2988 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8298496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837494+0000", 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24066586800000001, 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019679070999999999, 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2988 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837494+0000", 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837494+0000", 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837495+0000", 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7700000000000003e-07 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837499+0000", 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9419999999999997e-06 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837509+0000", 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7499999999999998e-06 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837516+0000", 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1840000000000002e-06 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857004+0000", 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019488594000000001 2024-09-14T08:39:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857088+0000", 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3504999999999994e-05 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857173+0000", 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5218999999999998e-05 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2989 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8232960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837527+0000", 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.240632655, 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019838205000000001, 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2989 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837527+0000", 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837527+0000", 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837528+0000", 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-07 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837530+0000", 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5849999999999998e-06 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837537+0000", 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837542+0000", 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3920000000000002e-06 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857212+0000", 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019669902999999999 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857289+0000", 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000005e-05 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857366+0000", 2024-09-14T08:39:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6172000000000002e-05 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2992 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8364032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.24060946799999999, 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0200152, 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2992 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837561+0000", 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.679e-06 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837568+0000", 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8369999999999999e-06 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837575+0000", 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9879999999999998e-06 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857394+0000", 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019819735000000002 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857480+0000", 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5414999999999995e-05 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857566+0000", 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6050000000000005e-05 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3656 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 1892352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050004+0000", 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028155838999999998, 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018387283000000001, 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3656 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050004+0000", 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050004+0000", 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050005+0000", 2024-09-14T08:39:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050006+0000", 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.858e-06 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050013+0000", 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9e-06 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050018+0000", 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7520000000000004e-06 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068297+0000", 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018278846000000001 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068336+0000", 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9428000000000003e-05 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068391+0000", 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5072999999999999e-05 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3658 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 1826816~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028135034, 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018527910000000002, 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3658 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8800000000000003e-07 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050028+0000", 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1500000000000002e-06 2024-09-14T08:39:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050034+0000", 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1489999999999999e-06 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050039+0000", 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7840000000000003e-06 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068425+0000", 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018386131 2024-09-14T08:39:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068481+0000", 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6779e-05 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068553+0000", 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1428999999999997e-05 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3663 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 1957888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050045+0000", 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028114832999999999, 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018631442000000002, 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3663 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050045+0000", 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050045+0000", 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050046+0000", 2024-09-14T08:39:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000002e-07 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050047+0000", 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.776e-06 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050053+0000", 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8880000000000002e-06 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050059+0000", 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2789999999999998e-06 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068582+0000", 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018523054000000001 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068623+0000", 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1216e-05 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068677+0000", 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3770000000000002e-05 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3666 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 2088960~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050065+0000", 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028094613000000001, 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018806007999999999, 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3666 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050065+0000", 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050065+0000", 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050066+0000", 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7199999999999998e-07 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050068+0000", 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9549999999999999e-06 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050074+0000", 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.93e-06 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050079+0000", 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1590000000000001e-06 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068709+0000", 2024-09-14T08:39:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018630192 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068763+0000", 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4064000000000003e-05 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068871+0000", 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010803599999999999 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3669 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 2023424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028074373, 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018925582, 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3669 2024-09-14T08:39:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4999999999999998e-07 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050088+0000", 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.874e-06 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050094+0000", 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8529999999999997e-06 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050099+0000", 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7079999999999996e-06 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068907+0000", 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018808945000000001 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068951+0000", 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3649999999999997e-05 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.069011+0000", 2024-09-14T08:39:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0102000000000002e-05 2024-09-14T08:39:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.161 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:29.163 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:29.164 INFO:teuthology.orchestra.run.smithi188.stdout:198 punch from 0x77d7600 to 0x77dc200, (0x4c00 bytes) 2024-09-14T08:39:29.164 INFO:teuthology.orchestra.run.smithi188.stdout:199 write 0x43ef800 thru 0x43f23c5 (0x2bc6 bytes) 2024-09-14T08:39:29.164 INFO:teuthology.orchestra.run.smithi188.stdout:200 read 0xae88800 thru 0xae97f42 (0xf743 bytes) 2024-09-14T08:39:29.164 INFO:teuthology.orchestra.run.smithi188.stdout:201 write 0x2084200 thru 0x208a5c3 (0x63c4 bytes) 2024-09-14T08:39:29.165 INFO:teuthology.orchestra.run.smithi188.stdout:204 write 0x90b000 thru 0x90f269 (0x426a bytes) 2024-09-14T08:39:29.165 INFO:teuthology.orchestra.run.smithi188.stdout:206 write 0x932cc00 thru 0x93306fa (0x3afb bytes) 2024-09-14T08:39:29.165 INFO:teuthology.orchestra.run.smithi188.stdout:209 read 0x2000a00 thru 0x200dc65 (0xd266 bytes) 2024-09-14T08:39:29.165 INFO:teuthology.orchestra.run.smithi188.stdout:210 write 0x81e3e00 thru 0x81ecec9 (0x90ca bytes) 2024-09-14T08:39:29.165 INFO:teuthology.orchestra.run.smithi188.stdout:212 read 0x109c00 thru 0x112857 (0x8c58 bytes) 2024-09-14T08:39:29.165 INFO:teuthology.orchestra.run.smithi188.stdout:213 read 0x67d6400 thru 0x67e2457 (0xc058 bytes) 2024-09-14T08:39:29.165 INFO:teuthology.orchestra.run.smithi188.stdout:214 read 0x4d6fc00 thru 0x4d7b430 (0xb831 bytes) 2024-09-14T08:39:29.165 INFO:teuthology.orchestra.run.smithi188.stdout:217 read 0xa41d800 thru 0xa428720 (0xaf21 bytes) 2024-09-14T08:39:29.165 INFO:teuthology.orchestra.run.smithi188.stdout:218 write 0x4482800 thru 0x4490877 (0xe078 bytes) 2024-09-14T08:39:29.165 INFO:teuthology.orchestra.run.smithi188.stdout:219 read 0x7f5aa00 thru 0x7f5d029 (0x262a bytes) 2024-09-14T08:39:29.166 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:29.167+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:29.213 INFO:teuthology.orchestra.run.smithi188.stdout:220 write 0xed76000 thru 0xed79bb2 (0x3bb3 bytes) 2024-09-14T08:39:29.216 INFO:teuthology.orchestra.run.smithi188.stdout:223 write 0xcfda800 thru 0xcfe1e36 (0x7637 bytes) 2024-09-14T08:39:29.216 INFO:teuthology.orchestra.run.smithi188.stdout:224 punch from 0x1d7ee00 to 0x1d85c00, (0x6e00 bytes) 2024-09-14T08:39:29.219 INFO:teuthology.orchestra.run.smithi188.stdout:225 write 0xa3a4600 thru 0xa3b1e05 (0xd806 bytes) 2024-09-14T08:39:29.219 INFO:teuthology.orchestra.run.smithi188.stdout:227 punch from 0x2e5f000 to 0x2e6da00, (0xea00 bytes) 2024-09-14T08:39:29.221 INFO:teuthology.orchestra.run.smithi188.stdout:228 write 0xb8c5c00 thru 0xb8ceccd (0x90ce bytes) 2024-09-14T08:39:29.221 INFO:teuthology.orchestra.run.smithi188.stdout:231 read 0x7b52000 thru 0x7b5be64 (0x9e65 bytes) 2024-09-14T08:39:29.221 INFO:teuthology.orchestra.run.smithi188.stdout:233 read 0xbe45a00 thru 0xbe47aed (0x20ee bytes) 2024-09-14T08:39:29.221 INFO:teuthology.orchestra.run.smithi188.stdout:234 read 0x972c600 thru 0x9732d21 (0x6722 bytes) 2024-09-14T08:39:29.221 INFO:teuthology.orchestra.run.smithi188.stdout:235 punch from 0xea11400 to 0xea1d200, (0xbe00 bytes) 2024-09-14T08:39:29.237 INFO:teuthology.orchestra.run.smithi188.stdout:236 trunc from 0xed79c00 to 0x639fe00 2024-09-14T08:39:29.263 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:29.271+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:29.307 INFO:teuthology.orchestra.run.smithi188.stdout:237 read 0x468e400 thru 0x469d7ff (0xf400 bytes) 2024-09-14T08:39:29.310 INFO:teuthology.orchestra.run.smithi188.stdout:238 write 0x920000 thru 0x92f0ba (0xf0bb bytes) 2024-09-14T08:39:29.311 INFO:teuthology.orchestra.run.smithi188.stdout:239 write 0x1bbe000 thru 0x1bc513a (0x713b bytes) 2024-09-14T08:39:29.312 INFO:teuthology.orchestra.run.smithi188.stdout:240 write 0xe1a800 thru 0xe1e004 (0x3805 bytes) 2024-09-14T08:39:29.321 INFO:teuthology.orchestra.run.smithi188.stdout:242 trunc from 0x639fe00 to 0x2cc0e00 2024-09-14T08:39:29.352 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:29.352 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:29.364 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:29.368+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:29.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:39:29.436 INFO:teuthology.orchestra.run.smithi188.stdout:246 write 0x3e35c00 thru 0x3e3d9d9 (0x7dda bytes) 2024-09-14T08:39:29.437 INFO:teuthology.orchestra.run.smithi188.stdout:247 write 0x1610400 thru 0x161c175 (0xbd76 bytes) 2024-09-14T08:39:29.438 INFO:teuthology.orchestra.run.smithi188.stdout:248 trunc from 0x3e3da00 to 0x3fc5600 2024-09-14T08:39:29.465 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:29.471+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:29.516 INFO:teuthology.orchestra.run.smithi188.stdout:250 trunc from 0x3fc5600 to 0x63d1e00 2024-09-14T08:39:29.544 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:29.544 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:29.545 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:29.545 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:29.545 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:29.554 INFO:teuthology.orchestra.run.smithi188.stdout:251 write 0x63ddc00 thru 0x63eb6b2 (0xdab3 bytes) 2024-09-14T08:39:29.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:29.575 INFO:teuthology.orchestra.run.smithi188.stdout:252 trunc from 0x63eb800 to 0x20aec00 2024-09-14T08:39:29.606 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:29.612+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:29.661 INFO:teuthology.orchestra.run.smithi188.stdout:254 trunc from 0x20aec00 to 0x5dff600 2024-09-14T08:39:29.667 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:29.675+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:29.691 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:29.691 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:29.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:29.691 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:29.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.691 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:382 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3350528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.267599+0000", 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4302519339999999, 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0099075840000000005, 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 382 2024-09-14T08:39:29.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267599+0000", 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267599+0000", 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267600+0000", 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.54e-07 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267608+0000", 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5390000000000007e-06 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267618+0000", 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1139999999999995e-06 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267628+0000", 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0010000000000001e-05 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277107+0000", 2024-09-14T08:39:29.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0094791300000000005 2024-09-14T08:39:29.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277305+0000", 2024-09-14T08:39:29.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019872600000000001 2024-09-14T08:39:29.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277507+0000", 2024-09-14T08:39:29.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000201311 2024-09-14T08:39:29.697 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.697 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.697 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.697 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:384 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3481600~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.698 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.267666+0000", 2024-09-14T08:39:29.698 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4301847839999999, 2024-09-14T08:39:29.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010352873, 2024-09-14T08:39:29.698 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.698 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.698 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 384 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267666+0000", 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267666+0000", 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267667+0000", 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.23e-07 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267670+0000", 2024-09-14T08:39:29.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:39:29.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267678+0000", 2024-09-14T08:39:29.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4230000000000005e-06 2024-09-14T08:39:29.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267685+0000", 2024-09-14T08:39:29.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5799999999999997e-06 2024-09-14T08:39:29.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277600+0000", 2024-09-14T08:39:29.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.009915597 2024-09-14T08:39:29.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277792+0000", 2024-09-14T08:39:29.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000191712 2024-09-14T08:39:29.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278019+0000", 2024-09-14T08:39:29.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022718099999999999 2024-09-14T08:39:29.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.703 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:387 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3612672~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.267722+0000", 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.430128608, 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010841773000000001, 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 387 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267722+0000", 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267722+0000", 2024-09-14T08:39:29.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267724+0000", 2024-09-14T08:39:29.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2270000000000001e-06 2024-09-14T08:39:29.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267726+0000", 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7159999999999999e-06 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267735+0000", 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4670000000000004e-06 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267741+0000", 2024-09-14T08:39:29.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5830000000000003e-06 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278124+0000", 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010382827000000001 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278325+0000", 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000200865 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278564+0000", 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023908800000000001 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:391 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3416064~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.267881+0000", 2024-09-14T08:39:29.709 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.429970373, 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011100285, 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 391 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267881+0000", 2024-09-14T08:39:29.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267881+0000", 2024-09-14T08:39:29.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267882+0000", 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9699999999999994e-07 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267885+0000", 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9270000000000001e-06 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267894+0000", 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2429999999999994e-06 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267901+0000", 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0430000000000002e-06 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278662+0000", 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010761336999999999 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278871+0000", 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000209166 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278981+0000", 2024-09-14T08:39:29.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109572 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:395 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3547136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268005+0000", 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4298465069999999, 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011351343, 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 395 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268005+0000", 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268005+0000", 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268005+0000", 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268008+0000", 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0199999999999999e-06 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268017+0000", 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9099999999999994e-06 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268024+0000", 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5300000000000002e-06 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279064+0000", 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011040705 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279210+0000", 2024-09-14T08:39:29.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145449 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279356+0000", 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014599900000000001 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.720 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:396 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3678208~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268033+0000", 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4298179040000001, 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011722507, 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 396 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.721 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268033+0000", 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268033+0000", 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268034+0000", 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.004e-06 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268037+0000", 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8229999999999999e-06 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268046+0000", 2024-09-14T08:39:29.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6929999999999996e-06 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268052+0000", 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4570000000000002e-06 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279436+0000", 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011384019 2024-09-14T08:39:29.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279604+0000", 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016770199999999999 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279756+0000", 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015180900000000001 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.725 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:402 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3809280~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268216+0000", 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4296351650000001, 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012040080999999999, 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.726 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 402 2024-09-14T08:39:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268216+0000", 2024-09-14T08:39:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268216+0000", 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268217+0000", 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268219+0000", 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6299999999999998e-06 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268228+0000", 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7399999999999993e-06 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268235+0000", 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6000000000000003e-06 2024-09-14T08:39:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279866+0000", 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011631743999999999 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280063+0000", 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019661799999999999 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280256+0000", 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019305599999999999 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:404 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268244+0000", 2024-09-14T08:39:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4296069890000001, 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012130254, 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 404 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268244+0000", 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268244+0000", 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268245+0000", 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9400000000000005e-07 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268247+0000", 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5500000000000001e-06 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268256+0000", 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6230000000000003e-06 2024-09-14T08:39:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268275+0000", 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8593e-05 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280346+0000", 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01207104 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280374+0000", 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8753999999999999e-05 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:406 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268285+0000", 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4295661319999999, 2024-09-14T08:39:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012190431999999999, 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 406 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268285+0000", 2024-09-14T08:39:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268285+0000", 2024-09-14T08:39:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268286+0000", 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.16e-07 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268291+0000", 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8239999999999999e-06 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268302+0000", 2024-09-14T08:39:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.11e-05 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268308+0000", 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7329999999999997e-06 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280461+0000", 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012152108999999999 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280475+0000", 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.485e-05 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:407 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 3809280~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268318+0000", 2024-09-14T08:39:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4295331760000001, 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097176720000000001, 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 407 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268318+0000", 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268318+0000", 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268319+0000", 2024-09-14T08:39:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:39:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268321+0000", 2024-09-14T08:39:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6299999999999998e-06 2024-09-14T08:39:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268330+0000", 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.473e-06 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268336+0000", 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6640000000000001e-06 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277535+0000", 2024-09-14T08:39:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0091981589999999992 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277732+0000", 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019699799999999999 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278036+0000", 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00030402100000000002 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:408 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268346+0000", 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4295053090000001, 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012253852000000001, 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 408 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268346+0000", 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268346+0000", 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268347+0000", 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6000000000000003e-07 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268349+0000", 2024-09-14T08:39:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:39:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268358+0000", 2024-09-14T08:39:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5099999999999998e-06 2024-09-14T08:39:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268364+0000", 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6030000000000001e-06 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280567+0000", 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012202401999999999 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280600+0000", 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2767e-05 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:411 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268374+0000", 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4294775200000001, 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012270715999999999, 2024-09-14T08:39:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 411 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268374+0000", 2024-09-14T08:39:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268374+0000", 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268374+0000", 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268387+0000", 2024-09-14T08:39:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2247e-05 2024-09-14T08:39:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268396+0000", 2024-09-14T08:39:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5599999999999999e-06 2024-09-14T08:39:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268403+0000", 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9460000000000001e-06 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280631+0000", 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01222824 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280644+0000", 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2993000000000001e-05 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:412 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 3940352~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268463+0000", 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.429387693, 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0099268389999999998, 2024-09-14T08:39:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 412 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268463+0000", 2024-09-14T08:39:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268463+0000", 2024-09-14T08:39:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268464+0000", 2024-09-14T08:39:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0130000000000001e-06 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268467+0000", 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0699999999999998e-06 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268477+0000", 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7359999999999996e-06 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268485+0000", 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.537e-06 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278107+0000", 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096220060000000007 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278209+0000", 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000102026 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278390+0000", 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018145100000000001 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:413 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 4071424~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268496+0000", 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.429355004, 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010346253999999999, 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.763 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 413 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268496+0000", 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268496+0000", 2024-09-14T08:39:29.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268497+0000", 2024-09-14T08:39:29.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:39:29.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268500+0000", 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6840000000000001e-06 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268508+0000", 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6060000000000003e-06 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268517+0000", 2024-09-14T08:39:29.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3070000000000003e-06 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278461+0000", 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0099446740000000006 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278569+0000", 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108119 2024-09-14T08:39:29.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278842+0000", 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027291099999999998 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:414 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268526+0000", 2024-09-14T08:39:29.768 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.4293247710000001, 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01216796, 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 414 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268526+0000", 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268526+0000", 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268527+0000", 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7999999999999995e-07 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268529+0000", 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.503e-06 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268538+0000", 2024-09-14T08:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7399999999999993e-06 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268545+0000", 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5699999999999998e-06 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280678+0000", 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012133194 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280694+0000", 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6273000000000002e-05 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:415 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 4136960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268554+0000", 2024-09-14T08:39:29.773 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.429296978, 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010900155999999999, 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 415 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268554+0000", 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268554+0000", 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268555+0000", 2024-09-14T08:39:29.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:39:29.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268557+0000", 2024-09-14T08:39:29.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5670000000000002e-06 2024-09-14T08:39:29.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268566+0000", 2024-09-14T08:39:29.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5429999999999994e-06 2024-09-14T08:39:29.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268573+0000", 2024-09-14T08:39:29.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6329999999999999e-06 2024-09-14T08:39:29.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278910+0000", 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010337259999999999 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279112+0000", 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020262899999999999 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279454+0000", 2024-09-14T08:39:29.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00034179700000000002 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:416 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268582+0000", 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.429269431, 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012174413, 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.779 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.780 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:29.780 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.780 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.780 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.780 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 416 2024-09-14T08:39:29.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.780 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268582+0000", 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268582+0000", 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268582+0000", 2024-09-14T08:39:29.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268592+0000", 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.713e-06 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268604+0000", 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.243e-05 2024-09-14T08:39:29.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268622+0000", 2024-09-14T08:39:29.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7989e-05 2024-09-14T08:39:29.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280744+0000", 2024-09-14T08:39:29.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012121364000000001 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280756+0000", 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.219e-05 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.784 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1478 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 3858432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.603228+0000", 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.0946228730000001, 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096318700000000007, 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1478 2024-09-14T08:39:29.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603228+0000", 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603228+0000", 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603229+0000", 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0800000000000004e-07 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603257+0000", 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8215e-05 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603266+0000", 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.867e-06 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603272+0000", 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3169999999999998e-06 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612712+0000", 2024-09-14T08:39:29.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0094399779999999999 2024-09-14T08:39:29.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612780+0000", 2024-09-14T08:39:29.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7879000000000005e-05 2024-09-14T08:39:29.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612860+0000", 2024-09-14T08:39:29.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0006000000000006e-05 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1482 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 4120576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.603306+0000", 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.0945452950000001, 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096890110000000008, 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.790 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1482 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603306+0000", 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603306+0000", 2024-09-14T08:39:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603306+0000", 2024-09-14T08:39:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6600000000000002e-07 2024-09-14T08:39:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603315+0000", 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6240000000000008e-06 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603322+0000", 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2309999999999999e-06 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603328+0000", 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4410000000000001e-06 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612890+0000", 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0095622740000000008 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612945+0000", 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4787000000000002e-05 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612995+0000", 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0188000000000001e-05 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1484 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 4186112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.603368+0000", 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.094483546, 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0098103970000000002, 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:29.796 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1484 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603368+0000", 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603368+0000", 2024-09-14T08:39:29.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603368+0000", 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7100000000000002e-07 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603370+0000", 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3479999999999998e-06 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603377+0000", 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0700000000000001e-06 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603383+0000", 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6509999999999998e-06 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:29.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.613021+0000", 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096374979999999996 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.613079+0000", 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8700999999999999e-05 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.613178+0000", 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8658000000000003e-05 2024-09-14T08:39:29.800 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.801 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.801 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.801 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:29.801 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:29.801 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:29.803 INFO:teuthology.orchestra.run.smithi188.stdout:255 trunc from 0x5dff600 to 0xe3ff800 2024-09-14T08:39:29.803 INFO:teuthology.orchestra.run.smithi188.stdout:257 write 0xec9de00 thru 0xeca3f26 (0x6127 bytes) 2024-09-14T08:39:29.803 INFO:teuthology.orchestra.run.smithi188.stdout:258 trunc from 0xeca4000 to 0xb699c00 2024-09-14T08:39:29.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:29.804 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:29.807+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:29.804 INFO:teuthology.orchestra.run.smithi188.stdout:259 trunc from 0xb699c00 to 0x1c92200 2024-09-14T08:39:29.855 INFO:teuthology.orchestra.run.smithi188.stdout:260 read 0x48b800 thru 0x4943f4 (0x8bf5 bytes) 2024-09-14T08:39:29.861 INFO:teuthology.orchestra.run.smithi188.stdout:264 punch from 0x241400 to 0x24aa00, (0x9600 bytes) 2024-09-14T08:39:29.903 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:29.908+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:29.909 INFO:teuthology.orchestra.run.smithi188.stdout:267 write 0xc882e00 thru 0xc88d2e8 (0xa4e9 bytes) 2024-09-14T08:39:29.911 INFO:teuthology.orchestra.run.smithi188.stdout:270 read 0x6373200 thru 0x6382b99 (0xf99a bytes) 2024-09-14T08:39:29.912 INFO:teuthology.orchestra.run.smithi188.stdout:271 write 0x742ea00 thru 0x743004b (0x164c bytes) 2024-09-14T08:39:29.957 INFO:teuthology.orchestra.run.smithi188.stdout:273 write 0xcd0e200 thru 0xcd193d9 (0xb1da bytes) 2024-09-14T08:39:29.958 INFO:teuthology.orchestra.run.smithi188.stdout:274 read 0xaf05e00 thru 0xaf0f1c3 (0x93c4 bytes) 2024-09-14T08:39:29.988 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:29.988 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:29.988 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:29.988 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:30.004 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:30.008+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:30.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:30.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:39:30.104 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:30.111+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:30.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:30.206 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:30.211+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:30.233 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:30.234 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:30.251 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:30.251 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:30.252 INFO:teuthology.orchestra.run.smithi188.stdout:275 write 0xe83f400 thru 0xe8427d7 (0x33d8 bytes) 2024-09-14T08:39:30.252 INFO:teuthology.orchestra.run.smithi188.stdout:278 punch from 0xb3ef000 to 0xb3ef800, (0x800 bytes) 2024-09-14T08:39:30.253 INFO:teuthology.orchestra.run.smithi188.stdout:279 write 0xac09600 thru 0xac163e1 (0xcde2 bytes) 2024-09-14T08:39:30.253 INFO:teuthology.orchestra.run.smithi188.stdout:280 read 0x32e3200 thru 0x32f1936 (0xe737 bytes) 2024-09-14T08:39:30.254 INFO:teuthology.orchestra.run.smithi188.stdout:281 read 0x8182000 thru 0x818c7b1 (0xa7b2 bytes) 2024-09-14T08:39:30.254 INFO:teuthology.orchestra.run.smithi188.stdout:282 read 0x7707200 thru 0x7715675 (0xe476 bytes) 2024-09-14T08:39:30.265 INFO:teuthology.orchestra.run.smithi188.stdout:285 read 0x6adf000 thru 0x6ae51ff (0x6200 bytes) 2024-09-14T08:39:30.265 INFO:teuthology.orchestra.run.smithi188.stdout:288 write 0xcd1e200 thru 0xcd1e5c7 (0x3c8 bytes) 2024-09-14T08:39:30.267 INFO:teuthology.orchestra.run.smithi188.stdout:290 write 0x2dd7600 thru 0x2de4ff4 (0xd9f5 bytes) 2024-09-14T08:39:30.269 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:30.270 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:30.271 INFO:teuthology.orchestra.run.smithi188.stdout:291 trunc from 0xe842800 to 0xd1bf200 2024-09-14T08:39:30.292 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:30.292 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:30.307 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:30.307 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:30.307 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:30.315+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:30.317 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:30.317 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:30.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:30.339 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:30.339 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:30.357 INFO:teuthology.orchestra.run.smithi188.stdout:293 write 0xe3ec000 thru 0xe3f2704 (0x6705 bytes) 2024-09-14T08:39:30.358 INFO:teuthology.orchestra.run.smithi188.stdout:294 read 0xad58800 thru 0xad5e732 (0x5f33 bytes) 2024-09-14T08:39:30.359 INFO:teuthology.orchestra.run.smithi188.stdout:296 read 0xa134c00 thru 0xa13ff32 (0xb333 bytes) 2024-09-14T08:39:30.359 INFO:teuthology.orchestra.run.smithi188.stdout:298 read 0x95e4a00 thru 0x95ee28e (0x988f bytes) 2024-09-14T08:39:30.360 INFO:teuthology.orchestra.run.smithi188.stdout:300 clone 4 order 25 su 2097152 sc 14 2024-09-14T08:39:30.407 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:30.412+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:30.462 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:30.462 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:30.477 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:30.507 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:30.512+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:30.603 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:30.604 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:30.608 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:30.612+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:30.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:30.622 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone3 from 0xe3f2800 (overlap 0x1c92200) to 0x2db600 2024-09-14T08:39:30.709 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:30.715+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:30.768 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:30.768 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:30.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:30.809 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:30.812+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:30.910 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:30.915+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:30.949 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:30.949 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:30.963 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:31.051 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:31.059+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:31.113 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:31.116+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:31.131 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:31.131 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:31.145 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:31.235 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:31.243+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:31.312 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:31.312 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:31.313 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-14T08:39:31.314 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:31.320+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:31.326 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:31.414 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:31.420+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:31.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:39:31.515 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:31.515 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:31.515 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:31.520+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:31.532 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:31.616 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:31.623+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:31.667 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:31.667 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:31.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:31.727 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:31.735+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:31.818 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:31.823+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:31.865 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:31.865 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:31.881 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:31.923 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:31.931+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:32.020 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:32.024+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:32.022 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:32.022 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:32.038 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:32.126 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:32.132+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:32.207 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:32.208 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:32.221 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:32.224+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:32.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:32.322 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:32.328+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:32.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:39:32.389 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:32.389 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:32.400 INFO:teuthology.orchestra.run.smithi188.stdout:301 punch from 0x3d34600 to 0x3d38e00, (0x4800 bytes) 2024-09-14T08:39:32.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:32.445 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:39:32.446 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:32.452+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:32.506 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:32.506 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:32.523 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:32.524 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:32.528+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:32.528 INFO:teuthology.orchestra.run.smithi188.stdout:302 trunc from 0xe3f2800 to 0xd68a00 2024-09-14T08:39:32.541 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:32.541 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:32.565 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:32.565 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:32.566 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:32.566 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:32.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:32.587 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:32.587 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:32.610 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:32.610 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:32.624 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:32.628+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:32.674 INFO:teuthology.orchestra.run.smithi188.stdout:303 read 0x5b7600 thru 0x5c06ab (0x90ac bytes) 2024-09-14T08:39:32.699 INFO:teuthology.orchestra.run.smithi188.stdout:304 write 0x1319a00 thru 0x1322ec0 (0x94c1 bytes) 2024-09-14T08:39:32.702 INFO:teuthology.orchestra.run.smithi188.stdout:306 read 0xa6a00 thru 0xb4f2b (0xe52c bytes) 2024-09-14T08:39:32.711 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:32.711 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:32.711 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:32.711 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:32.712 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:32.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:32.726 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:32.728+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:32.758 INFO:teuthology.orchestra.run.smithi188.stdout:308 write 0xcb49a00 thru 0xcb533da (0x99db bytes) 2024-09-14T08:39:32.761 INFO:teuthology.orchestra.run.smithi188.stdout:311 write 0x7e41600 thru 0x7e48705 (0x7106 bytes) 2024-09-14T08:39:32.763 INFO:teuthology.orchestra.run.smithi188.stdout:313 trunc from 0xcb53400 to 0xc103800 2024-09-14T08:39:32.795 INFO:teuthology.orchestra.run.smithi188.stdout:315 punch from 0xa49ae00 to 0xa4aaa00, (0xfc00 bytes) 2024-09-14T08:39:32.798 INFO:teuthology.orchestra.run.smithi188.stdout:316 write 0x65af000 thru 0x65b0154 (0x1155 bytes) 2024-09-14T08:39:32.799 INFO:teuthology.orchestra.run.smithi188.stdout:317 write 0x1af4a00 thru 0x1b002fb (0xb8fc bytes) 2024-09-14T08:39:32.799 INFO:teuthology.orchestra.run.smithi188.stdout:318 read 0xbfbba00 thru 0xbfc2e10 (0x7411 bytes) 2024-09-14T08:39:32.799 INFO:teuthology.orchestra.run.smithi188.stdout:319 read 0xbc6d000 thru 0xbc79e40 (0xce41 bytes) 2024-09-14T08:39:32.799 INFO:teuthology.orchestra.run.smithi188.stdout:322 write 0x462c800 thru 0x4638613 (0xbe14 bytes) 2024-09-14T08:39:32.800 INFO:teuthology.orchestra.run.smithi188.stdout:323 punch from 0x1933800 to 0x193ec00, (0xb400 bytes) 2024-09-14T08:39:32.819 INFO:teuthology.orchestra.run.smithi188.stdout:324 trunc from 0xc103800 to 0x5001c00 2024-09-14T08:39:32.825 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:32.831+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:32.884 INFO:teuthology.orchestra.run.smithi188.stdout:326 write 0x76e6400 thru 0x76eee23 (0x8a24 bytes) 2024-09-14T08:39:32.888 INFO:teuthology.orchestra.run.smithi188.stdout:327 read 0x40a0e00 thru 0x40a7667 (0x6868 bytes) 2024-09-14T08:39:32.889 INFO:teuthology.orchestra.run.smithi188.stdout:332 read 0x59c3a00 thru 0x59c5ad9 (0x20da bytes) 2024-09-14T08:39:32.890 INFO:teuthology.orchestra.run.smithi188.stdout:333 punch from 0xb96600 to 0xba2200, (0xbc00 bytes) 2024-09-14T08:39:32.891 INFO:teuthology.orchestra.run.smithi188.stdout:334 read 0x39b7c00 thru 0x39c2544 (0xa945 bytes) 2024-09-14T08:39:32.892 INFO:teuthology.orchestra.run.smithi188.stdout:335 punch from 0x3ada800 to 0x3ae7600, (0xce00 bytes) 2024-09-14T08:39:32.892 INFO:teuthology.orchestra.run.smithi188.stdout:337 read 0x4f69600 thru 0x4f74619 (0xb01a bytes) 2024-09-14T08:39:32.892 INFO:teuthology.orchestra.run.smithi188.stdout:339 write 0x740e00 thru 0x74b90f (0xab10 bytes) 2024-09-14T08:39:32.895 INFO:teuthology.orchestra.run.smithi188.stdout:344 write 0x419f600 thru 0x41a6e29 (0x782a bytes) 2024-09-14T08:39:32.897 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:32.897 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:32.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:32.897 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:32.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.897 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:382 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3350528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.897 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.267599+0000", 2024-09-14T08:39:32.897 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6343422160000003, 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0099075840000000005, 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 382 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267599+0000", 2024-09-14T08:39:32.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267599+0000", 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267600+0000", 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.54e-07 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267608+0000", 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5390000000000007e-06 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267618+0000", 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1139999999999995e-06 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267628+0000", 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0010000000000001e-05 2024-09-14T08:39:32.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277107+0000", 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0094791300000000005 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277305+0000", 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019872600000000001 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277507+0000", 2024-09-14T08:39:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000201311 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:384 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3481600~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.267666+0000", 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6342750659999998, 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010352873, 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.903 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 384 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267666+0000", 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267666+0000", 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267667+0000", 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.23e-07 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267670+0000", 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267678+0000", 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4230000000000005e-06 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267685+0000", 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5799999999999997e-06 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277600+0000", 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.009915597 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277792+0000", 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000191712 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278019+0000", 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022718099999999999 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.907 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:387 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3612672~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.267722+0000", 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6342188899999996, 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010841773000000001, 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 387 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267722+0000", 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267722+0000", 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267724+0000", 2024-09-14T08:39:32.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2270000000000001e-06 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267726+0000", 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7159999999999999e-06 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267735+0000", 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4670000000000004e-06 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267741+0000", 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5830000000000003e-06 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278124+0000", 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010382827000000001 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278325+0000", 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000200865 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278564+0000", 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023908800000000001 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:391 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3416064~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.267881+0000", 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6340606549999999, 2024-09-14T08:39:32.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011100285, 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 391 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267881+0000", 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267881+0000", 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267882+0000", 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9699999999999994e-07 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267885+0000", 2024-09-14T08:39:32.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9270000000000001e-06 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267894+0000", 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2429999999999994e-06 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.267901+0000", 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0430000000000002e-06 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278662+0000", 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010761336999999999 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278871+0000", 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000209166 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278981+0000", 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109572 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:395 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3547136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268005+0000", 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6339367889999998, 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011351343, 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 395 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268005+0000", 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268005+0000", 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268005+0000", 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268008+0000", 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0199999999999999e-06 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268017+0000", 2024-09-14T08:39:32.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9099999999999994e-06 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268024+0000", 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5300000000000002e-06 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279064+0000", 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011040705 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279210+0000", 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145449 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279356+0000", 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014599900000000001 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:396 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3678208~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268033+0000", 2024-09-14T08:39:32.921 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6339081860000002, 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011722507, 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 396 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268033+0000", 2024-09-14T08:39:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268033+0000", 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268034+0000", 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.004e-06 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268037+0000", 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8229999999999999e-06 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268046+0000", 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6929999999999996e-06 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268052+0000", 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4570000000000002e-06 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279436+0000", 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011384019 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279604+0000", 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016770199999999999 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279756+0000", 2024-09-14T08:39:32.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015180900000000001 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:402 3.19 3:9d0961fc:::rbd_data.10f13f8886eb.0000000000000006:4 [read 3809280~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268216+0000", 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6337254469999998, 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012040080999999999, 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 402 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268216+0000", 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268216+0000", 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268217+0000", 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268219+0000", 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6299999999999998e-06 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268228+0000", 2024-09-14T08:39:32.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7399999999999993e-06 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268235+0000", 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6000000000000003e-06 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279866+0000", 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011631743999999999 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280063+0000", 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019661799999999999 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280256+0000", 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019305599999999999 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:404 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268244+0000", 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.633697271, 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012130254, 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 404 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268244+0000", 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268244+0000", 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268245+0000", 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9400000000000005e-07 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268247+0000", 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5500000000000001e-06 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268256+0000", 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6230000000000003e-06 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268275+0000", 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8593e-05 2024-09-14T08:39:32.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280346+0000", 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01207104 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280374+0000", 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8753999999999999e-05 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:406 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268285+0000", 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6336564139999998, 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012190431999999999, 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 406 2024-09-14T08:39:32.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268285+0000", 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268285+0000", 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268286+0000", 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.16e-07 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268291+0000", 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8239999999999999e-06 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268302+0000", 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.11e-05 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268308+0000", 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7329999999999997e-06 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280461+0000", 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012152108999999999 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280475+0000", 2024-09-14T08:39:32.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.485e-05 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:407 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 3809280~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268318+0000", 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6336234579999998, 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097176720000000001, 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 407 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268318+0000", 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268318+0000", 2024-09-14T08:39:32.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268319+0000", 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268321+0000", 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6299999999999998e-06 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268330+0000", 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.473e-06 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268336+0000", 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6640000000000001e-06 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277535+0000", 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0091981589999999992 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.277732+0000", 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019699799999999999 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278036+0000", 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00030402100000000002 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.943 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:408 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268346+0000", 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6335955909999997, 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012253852000000001, 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 408 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268346+0000", 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268346+0000", 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268347+0000", 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6000000000000003e-07 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268349+0000", 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268358+0000", 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5099999999999998e-06 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268364+0000", 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6030000000000001e-06 2024-09-14T08:39:32.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280567+0000", 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012202401999999999 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280600+0000", 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2767e-05 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:411 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268374+0000", 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.633567802, 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012270715999999999, 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 411 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.948 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268374+0000", 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268374+0000", 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268374+0000", 2024-09-14T08:39:32.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268387+0000", 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2247e-05 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268396+0000", 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5599999999999999e-06 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268403+0000", 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9460000000000001e-06 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280631+0000", 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01222824 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280644+0000", 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2993000000000001e-05 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:412 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 3940352~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268463+0000", 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6334779749999999, 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0099268389999999998, 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 412 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268463+0000", 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268463+0000", 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268464+0000", 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0130000000000001e-06 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268467+0000", 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0699999999999998e-06 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268477+0000", 2024-09-14T08:39:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7359999999999996e-06 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268485+0000", 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.537e-06 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278107+0000", 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096220060000000007 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278209+0000", 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000102026 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278390+0000", 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018145100000000001 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.956 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:413 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 4071424~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268496+0000", 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6334452859999997, 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010346253999999999, 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 413 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268496+0000", 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268496+0000", 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268497+0000", 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:39:32.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268500+0000", 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6840000000000001e-06 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268508+0000", 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6060000000000003e-06 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268517+0000", 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3070000000000003e-06 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278461+0000", 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0099446740000000006 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278569+0000", 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108119 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278842+0000", 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027291099999999998 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:414 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268526+0000", 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6334150530000002, 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01216796, 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 414 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268526+0000", 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268526+0000", 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268527+0000", 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7999999999999995e-07 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268529+0000", 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.503e-06 2024-09-14T08:39:32.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268538+0000", 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7399999999999993e-06 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268545+0000", 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5699999999999998e-06 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280678+0000", 2024-09-14T08:39:32.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012133194 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280694+0000", 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6273000000000002e-05 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:415 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 4136960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268554+0000", 2024-09-14T08:39:32.965 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6333872600000001, 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010900155999999999, 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 415 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268554+0000", 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268554+0000", 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268555+0000", 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268557+0000", 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5670000000000002e-06 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268566+0000", 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5429999999999994e-06 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268573+0000", 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6329999999999999e-06 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.278910+0000", 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010337259999999999 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279112+0000", 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020262899999999999 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.279454+0000", 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00034179700000000002 2024-09-14T08:39:32.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:416 3.19 3.3f8690b9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.268582+0000", 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6333597129999999, 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012174413, 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 416 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268582+0000", 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268582+0000", 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268582+0000", 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268592+0000", 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.713e-06 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268604+0000", 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.243e-05 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.268622+0000", 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7989e-05 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280744+0000", 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012121364000000001 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.280756+0000", 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.219e-05 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1478 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 3858432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.603228+0000", 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.2987131549999997, 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096318700000000007, 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.974 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1478 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603228+0000", 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603228+0000", 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603229+0000", 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0800000000000004e-07 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603257+0000", 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8215e-05 2024-09-14T08:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603266+0000", 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.867e-06 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603272+0000", 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3169999999999998e-06 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612712+0000", 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0094399779999999999 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612780+0000", 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7879000000000005e-05 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612860+0000", 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0006000000000006e-05 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1482 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 4120576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.603306+0000", 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.2986355769999998, 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096890110000000008, 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.979 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1482 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603306+0000", 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603306+0000", 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603306+0000", 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6600000000000002e-07 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603315+0000", 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6240000000000008e-06 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603322+0000", 2024-09-14T08:39:32.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2309999999999999e-06 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603328+0000", 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4410000000000001e-06 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612890+0000", 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0095622740000000008 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612945+0000", 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4787000000000002e-05 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.612995+0000", 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0188000000000001e-05 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1484 3.2 3:40fd0adb:::rbd_data.10f13f8886eb.0000000000000004:4 [read 4186112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.603368+0000", 2024-09-14T08:39:32.983 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.2985738280000003, 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0098103970000000002, 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1484 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:32.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603368+0000", 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603368+0000", 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603368+0000", 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7100000000000002e-07 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603370+0000", 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3479999999999998e-06 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603377+0000", 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0700000000000001e-06 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.603383+0000", 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6509999999999998e-06 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.613021+0000", 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096374979999999996 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.613079+0000", 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8700999999999999e-05 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.613178+0000", 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8658000000000003e-05 2024-09-14T08:39:32.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.988 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:32.988 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:32.988 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:32.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:347 write 0x8bea400 thru 0x8bf9dba (0xf9bb bytes) 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:352 read 0x624ae00 thru 0x6251213 (0x6414 bytes) 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:353 write 0xd606c00 thru 0xd60b36f (0x4770 bytes) 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:354 write 0xc163400 thru 0xc1712bf (0xdec0 bytes) 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:355 write 0x284ec00 thru 0x285bb33 (0xcf34 bytes) 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:357 write 0xa8e5200 thru 0xa8ec641 (0x7442 bytes) 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:360 write 0xc69a800 thru 0xc6a5e71 (0xb672 bytes) 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:363 read 0xc1bf800 thru 0xc1c39d1 (0x41d2 bytes) 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:364 read 0x679f000 thru 0x67aea82 (0xfa83 bytes) 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:369 write 0x9889600 thru 0x988f6bf (0x60c0 bytes) 2024-09-14T08:39:32.991 INFO:teuthology.orchestra.run.smithi188.stdout:371 read 0x130ce00 thru 0x1316bb2 (0x9db3 bytes) 2024-09-14T08:39:32.992 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:32.995+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:33.009 INFO:teuthology.orchestra.run.smithi188.stdout:373 trunc from 0xd60b400 to 0x42bfc00 2024-09-14T08:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout:375 read 0x890000 thru 0x89632d (0x632e bytes) 2024-09-14T08:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout:376 punch from 0x1fcfe00 to 0x1fd4600, (0x4800 bytes) 2024-09-14T08:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout:379 write 0x3637a00 thru 0x3638ca8 (0x12a9 bytes) 2024-09-14T08:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout:380 punch from 0x335d200 to 0x336c000, (0xee00 bytes) 2024-09-14T08:39:33.090 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:33.095+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:33.114 INFO:teuthology.orchestra.run.smithi188.stdout:383 write 0xda6ba00 thru 0xda7985b (0xde5c bytes) 2024-09-14T08:39:33.117 INFO:teuthology.orchestra.run.smithi188.stdout:387 write 0x2f2c200 thru 0x2f3274f (0x6550 bytes) 2024-09-14T08:39:33.119 INFO:teuthology.orchestra.run.smithi188.stdout:389 punch from 0x3653000 to 0x3654200, (0x1200 bytes) 2024-09-14T08:39:33.125 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:33.125 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:33.133 INFO:teuthology.orchestra.run.smithi188.stdout:394 trunc from 0xda79a00 to 0x7482c00 2024-09-14T08:39:33.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:33.169 INFO:teuthology.orchestra.run.smithi188.stdout:396 punch from 0x3dbe400 to 0x3dbf400, (0x1000 bytes) 2024-09-14T08:39:33.172 INFO:teuthology.orchestra.run.smithi188.stdout:397 trunc from 0x7482c00 to 0x7729e00 2024-09-14T08:39:33.191 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:33.199+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:33.412 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:33.412 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:33.412 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:33.412 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:33.413 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:33.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:398 write 0x58fc200 thru 0x5909ea2 (0xdca3 bytes) 2024-09-14T08:39:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:399 punch from 0x580b000 to 0x580d400, (0x2400 bytes) 2024-09-14T08:39:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:400 read 0x51e000 thru 0x52636f (0x8370 bytes) 2024-09-14T08:39:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:401 read 0x2face00 thru 0x2fb9e1c (0xd01d bytes) 2024-09-14T08:39:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:402 trunc from 0x7729e00 to 0xe90e600 2024-09-14T08:39:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:404 write 0xde03000 thru 0xde11a4b (0xea4c bytes) 2024-09-14T08:39:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:405 write 0x8387200 thru 0x83900db (0x8edc bytes) 2024-09-14T08:39:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:407 trunc from 0xe90e600 to 0x19ed200 2024-09-14T08:39:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:408 trunc from 0x19ed200 to 0x1bc400 2024-09-14T08:39:33.415 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:33.419+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:33.512 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:33.516+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:410 trunc from 0x1bc400 to 0xbf73e00 2024-09-14T08:39:33.549 INFO:teuthology.orchestra.run.smithi188.stdout:411 read 0x785fa00 thru 0x786a747 (0xad48 bytes) 2024-09-14T08:39:33.551 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:33.551 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1218 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.541784+0000", 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0155012340000003, 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032912087999999999, 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.552 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1218 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541784+0000", 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541784+0000", 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541785+0000", 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.44e-07 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541787+0000", 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5459999999999998e-06 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541796+0000", 2024-09-14T08:39:33.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2770000000000005e-06 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541803+0000", 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2459999999999997e-06 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.574505+0000", 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032702249000000003 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.574600+0000", 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4769e-05 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.574696+0000", 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6356999999999999e-05 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.556 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1224 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 4177920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.541812+0000", 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0154737540000003, 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033062610999999999, 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1224 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541812+0000", 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541812+0000", 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541812+0000", 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3300000000000002e-07 2024-09-14T08:39:33.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541815+0000", 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6400000000000001e-06 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541824+0000", 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5140000000000001e-06 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541842+0000", 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8493000000000001e-05 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.574743+0000", 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032901447 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.574810+0000", 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6810999999999994e-05 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.574874+0000", 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4072999999999995e-05 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1230 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3981312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.541853+0000", 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0154328939999999, 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033257367000000003, 2024-09-14T08:39:33.561 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1230 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541853+0000", 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541853+0000", 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541853+0000", 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3699999999999999e-07 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541857+0000", 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0800000000000002e-06 2024-09-14T08:39:33.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541866+0000", 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541873+0000", 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0700000000000001e-06 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.574921+0000", 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033047967999999997 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575015+0000", 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4691999999999994e-05 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575110+0000", 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4530000000000005e-05 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1235 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 4112384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.541882+0000", 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0154036079999997, 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033386912999999997, 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.566 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1235 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541882+0000", 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541882+0000", 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541883+0000", 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7999999999999995e-07 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541893+0000", 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0730000000000001e-05 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541902+0000", 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1700000000000003e-06 2024-09-14T08:39:33.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541910+0000", 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1829999999999997e-06 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575146+0000", 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033235954999999998 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575207+0000", 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1420000000000005e-05 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575269+0000", 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1774999999999997e-05 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1238 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3203072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.570 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.541919+0000", 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.015366598, 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033613587, 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1238 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541919+0000", 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541919+0000", 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541920+0000", 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541922+0000", 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6960000000000001e-06 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541931+0000", 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7700000000000007e-06 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541941+0000", 2024-09-14T08:39:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.03e-05 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575317+0000", 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033375498000000003 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575414+0000", 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7103999999999997e-05 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575532+0000", 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000118509 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1240 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3268608~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.541951+0000", 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0153348879999999, 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033771390999999998, 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.575 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1240 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541951+0000", 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541951+0000", 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541951+0000", 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6300000000000005e-07 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541954+0000", 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541963+0000", 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7199999999999995e-06 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541971+0000", 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4770000000000003e-06 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575572+0000", 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033601049000000001 2024-09-14T08:39:33.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575633+0000", 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0822999999999997e-05 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575722+0000", 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8929000000000002e-05 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1242 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3399680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.541981+0000", 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0153046080000001, 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034090711000000003, 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1242 2024-09-14T08:39:33.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541981+0000", 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541981+0000", 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541982+0000", 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9599999999999999e-07 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541985+0000", 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.541993+0000", 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-06 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542000+0000", 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999999e-06 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575803+0000", 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033802580999999998 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.575905+0000", 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010247399999999999 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576072+0000", 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016642 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1248 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3530752~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542010+0000", 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.015275795, 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034315816999999998, 2024-09-14T08:39:33.584 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1248 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542010+0000", 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542010+0000", 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542010+0000", 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542014+0000", 2024-09-14T08:39:33.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4539999999999999e-06 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542023+0000", 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.183e-06 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542030+0000", 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0929999999999997e-06 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576130+0000", 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034100088000000001 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576196+0000", 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5981000000000004e-05 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576326+0000", 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012937199999999999 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.588 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1254 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3334144~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542040+0000", 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0152454889999998, 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034657195000000002, 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.589 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1254 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542040+0000", 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542040+0000", 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542041+0000", 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0270000000000001e-06 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542048+0000", 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5560000000000004e-06 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542064+0000", 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6820000000000002e-05 2024-09-14T08:39:33.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542073+0000", 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3429999999999996e-06 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576414+0000", 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034341693999999999 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576517+0000", 2024-09-14T08:39:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000102959 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576697+0000", 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000179796 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1259 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3465216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542095+0000", 2024-09-14T08:39:33.593 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0151900329999997, 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034808329999999998, 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1259 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542095+0000", 2024-09-14T08:39:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542095+0000", 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542097+0000", 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9599999999999999e-06 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542102+0000", 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6840000000000004e-06 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542123+0000", 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0942999999999999e-05 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542136+0000", 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3329999999999999e-05 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576757+0000", 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034620851000000001 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576824+0000", 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6670999999999999e-05 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576904+0000", 2024-09-14T08:39:33.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9890999999999998e-05 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1261 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3596288~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542157+0000", 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0151281900000004, 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034994887000000002, 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.598 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.599 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.599 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.599 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1261 2024-09-14T08:39:33.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.599 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542157+0000", 2024-09-14T08:39:33.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542157+0000", 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542158+0000", 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542163+0000", 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000004e-06 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542185+0000", 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1963e-05 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542208+0000", 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3269999999999999e-05 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.576951+0000", 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034743002000000002 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577036+0000", 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4899000000000001e-05 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577152+0000", 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000116253 2024-09-14T08:39:33.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1268 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3727360~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542228+0000", 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0150573999999999, 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035093640000000002, 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1268 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542228+0000", 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542228+0000", 2024-09-14T08:39:33.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542229+0000", 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1629999999999999e-06 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542235+0000", 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6930000000000004e-06 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542253+0000", 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7589999999999999e-05 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542270+0000", 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7116999999999999e-05 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577189+0000", 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034919512 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577241+0000", 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1477999999999997e-05 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577322+0000", 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1087000000000005e-05 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1269 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3661824~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542293+0000", 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0149924840000004, 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035291401, 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1269 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542293+0000", 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542293+0000", 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542294+0000", 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1260000000000001e-06 2024-09-14T08:39:33.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542299+0000", 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-06 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542320+0000", 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0703000000000002e-05 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542350+0000", 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0164000000000001e-05 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577367+0000", 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035017049000000001 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577455+0000", 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7678999999999999e-05 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577584+0000", 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012977999999999999 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1271 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3858432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542388+0000", 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0148975609999997, 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035468371999999998, 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.612 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1271 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542388+0000", 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542388+0000", 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542389+0000", 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2860000000000001e-06 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542395+0000", 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5929999999999996e-06 2024-09-14T08:39:33.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542414+0000", 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9493000000000001e-05 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542437+0000", 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.251e-05 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577641+0000", 2024-09-14T08:39:33.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035204006000000003 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577743+0000", 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010255399999999999 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577856+0000", 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011293 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.616 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1275 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3792896~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542458+0000", 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0148271360000001, 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035717237999999998, 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1275 2024-09-14T08:39:33.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542458+0000", 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542458+0000", 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542460+0000", 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1799999999999999e-06 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542465+0000", 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3739999999999997e-06 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542497+0000", 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1633e-05 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542510+0000", 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3553000000000001e-05 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577909+0000", 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035398873999999997 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.577996+0000", 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6588000000000005e-05 2024-09-14T08:39:33.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578176+0000", 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018003600000000001 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1280 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3923968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542530+0000", 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0147559990000001, 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035887163, 2024-09-14T08:39:33.621 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1280 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542530+0000", 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542530+0000", 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542531+0000", 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.096e-06 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542570+0000", 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9363000000000002e-05 2024-09-14T08:39:33.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542589+0000", 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9077e-05 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542603+0000", 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.393e-05 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578212+0000", 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035609256999999998 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578300+0000", 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7480999999999998e-05 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578417+0000", 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000116959 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.625 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1282 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 4055040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542624+0000", 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0146611930000002, 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035996632000000001, 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.626 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1282 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542624+0000", 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542624+0000", 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542626+0000", 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2759999999999999e-06 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542631+0000", 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.22e-06 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542647+0000", 2024-09-14T08:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6169999999999999e-05 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542679+0000", 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2366000000000001e-05 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578453+0000", 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035774029999999998 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578536+0000", 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2541999999999997e-05 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578621+0000", 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5028e-05 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1288 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 4186112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542700+0000", 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0145851910000001, 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.03610273, 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1288 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542700+0000", 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542700+0000", 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542701+0000", 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.15e-06 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542707+0000", 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4600000000000002e-06 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542728+0000", 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0886999999999998e-05 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542741+0000", 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3206e-05 2024-09-14T08:39:33.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578652+0000", 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035911371999999997 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578717+0000", 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4894000000000006e-05 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578803+0000", 2024-09-14T08:39:33.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5760999999999994e-05 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1294 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 3989504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542816+0000", 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0144697479999998, 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036175419, 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.635 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1294 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542816+0000", 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542816+0000", 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542817+0000", 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0299999999999998e-07 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542823+0000", 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3799999999999999e-06 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542834+0000", 2024-09-14T08:39:33.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.15e-05 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542842+0000", 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4730000000000003e-06 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578833+0000", 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035990787000000003 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578901+0000", 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8589000000000003e-05 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.578991+0000", 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9887000000000002e-05 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:1299 3.1e 3:7812b96e:::rbd_data.10f13f8886eb.0000000000000009:4 [read 4120576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.542854+0000", 2024-09-14T08:39:33.639 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.0144312150000001, 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036437511999999998, 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1299 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542854+0000", 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542854+0000", 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542855+0000", 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1600000000000001e-07 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542858+0000", 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9639999999999999e-06 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542867+0000", 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999993e-06 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.542875+0000", 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2460000000000003e-06 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.579142+0000", 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036266519999999997 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.579208+0000", 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6599000000000004e-05 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.579292+0000", 2024-09-14T08:39:33.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3367000000000003e-05 2024-09-14T08:39:33.644 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.644 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.644 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.644 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:33.644 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:33.644 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:33.646 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:412 write 0xc9c8a00 thru 0xc9cbb25 (0x3126 bytes) 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:416 punch from 0x13d5000 to 0x13db800, (0x6800 bytes) 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:417 read 0x8d71c00 thru 0x8d80ce9 (0xf0ea bytes) 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:418 read 0xbd67a00 thru 0xbd755b6 (0xdbb7 bytes) 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:420 write 0xeb51c00 thru 0xeb592e0 (0x76e1 bytes) 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:421 read 0x9e44a00 thru 0x9e526fa (0xdcfb bytes) 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:423 read 0x52c2a00 thru 0x52cb464 (0x8a65 bytes) 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:425 read 0xd98c800 thru 0xd992227 (0x5a28 bytes) 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:skipping zero length punch hole 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:427 punch from 0x948bc00 to 0x9494a00, (0x8e00 bytes) 2024-09-14T08:39:33.647 INFO:teuthology.orchestra.run.smithi188.stdout:432 trunc from 0xeb59400 to 0xaff7400 2024-09-14T08:39:33.648 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:33.651+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:33.650 INFO:teuthology.orchestra.run.smithi188.stdout:433 clone 5 order 23 su 262144 sc 9 2024-09-14T08:39:33.747 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:33.755+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:33.783 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:33.783 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:33.783 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:39:33.783 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:33.797 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:33.848 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:33.852+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:33.949 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:33.956+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:33.959 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T08:39:33.959 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:39:33.959 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-14T08:39:33.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T08:39:33.967 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:33.967 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:33.967 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:33.967 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:33.967 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:33.981 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:34.051 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:34.056+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:34.104 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:01.928255+0000", 2024-09-14T08:39:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.181534526999997, 2024-09-14T08:39:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033562680999999997, 2024-09-14T08:39:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928255+0000", 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928255+0000", 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928257+0000", 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928271+0000", 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.419e-05 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928294+0000", 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2767000000000001e-05 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928319+0000", 2024-09-14T08:39:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4732999999999999e-05 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928502+0000", 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018318499999999999 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928520+0000", 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7603000000000001e-05 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.958398+0000", 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029878400999999999 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.958707+0000", 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030891000000000002 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.959053+0000", 2024-09-14T08:39:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034653499999999997 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.960696+0000", 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016423690000000001 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.961658+0000", 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00096181900000000004 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.961748+0000", 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919000000000004e-05 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.961817+0000", 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9777000000000006e-05 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1153 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3842048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.538347+0000", 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5714422519999998, 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026047579000000001, 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1153 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538347+0000", 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538347+0000", 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538348+0000", 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1829999999999999e-06 2024-09-14T08:39:34.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538370+0000", 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.226e-05 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538409+0000", 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8609000000000003e-05 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538425+0000", 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5837000000000001e-05 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.560369+0000", 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021944643 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.560477+0000", 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107575 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.564395+0000", 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003917472 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1231 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540112+0000", 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5696775370000005, 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025101333, 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.116 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1231 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540112+0000", 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540112+0000", 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540113+0000", 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.353e-06 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540119+0000", 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8529999999999997e-06 2024-09-14T08:39:34.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540141+0000", 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1733e-05 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540158+0000", 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7316000000000002e-05 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565032+0000", 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024874446000000001 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565122+0000", 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9456999999999994e-05 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565213+0000", 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1174999999999994e-05 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.120 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1236 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 4177920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540226+0000", 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.569563015, 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025193242000000001, 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.121 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1236 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540226+0000", 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540226+0000", 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540228+0000", 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.353e-06 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540234+0000", 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1199999999999999e-06 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540253+0000", 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9697000000000001e-05 2024-09-14T08:39:34.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540273+0000", 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.931e-05 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565252+0000", 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024979632000000002 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565336+0000", 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3319000000000006e-05 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565419+0000", 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3811000000000001e-05 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1241 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3203072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540297+0000", 2024-09-14T08:39:34.125 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5694921720000004, 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025364491999999999, 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1241 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540297+0000", 2024-09-14T08:39:34.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540297+0000", 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540299+0000", 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5030000000000001e-06 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540326+0000", 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7912999999999999e-05 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540348+0000", 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1832999999999999e-05 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540374+0000", 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5394000000000001e-05 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565456+0000", 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025082528999999999 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565543+0000", 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6594999999999993e-05 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565662+0000", 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118725 2024-09-14T08:39:34.129 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1247 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3334144~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540414+0000", 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5693754460000005, 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025491073, 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.130 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1247 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540414+0000", 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540414+0000", 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540415+0000", 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.426e-06 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540422+0000", 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.55e-06 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540441+0000", 2024-09-14T08:39:34.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9412999999999999e-05 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540456+0000", 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4803e-05 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565699+0000", 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025242674 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565788+0000", 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9560000000000003e-05 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565905+0000", 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116647 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1249 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3268608~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.134 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540475+0000", 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5693137899999998, 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025701721, 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1249 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540475+0000", 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540475+0000", 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540477+0000", 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.223e-06 2024-09-14T08:39:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540482+0000", 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6570000000000002e-06 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540501+0000", 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8689999999999999e-05 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540516+0000", 2024-09-14T08:39:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4516e-05 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565943+0000", 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025427226000000001 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566041+0000", 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8627000000000003e-05 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566177+0000", 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013578200000000001 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1253 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3465216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540536+0000", 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.569253357, 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025878167000000001, 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1253 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540536+0000", 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540536+0000", 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540537+0000", 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1829999999999999e-06 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540542+0000", 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540561+0000", 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8546000000000002e-05 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540609+0000", 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7695999999999999e-05 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566218+0000", 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025609123000000001 2024-09-14T08:39:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566305+0000", 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7375999999999998e-05 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566414+0000", 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108859 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1255 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3399680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540632+0000", 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5691574780000002, 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025984159, 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1255 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540632+0000", 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540632+0000", 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540633+0000", 2024-09-14T08:39:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.42e-06 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540639+0000", 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540658+0000", 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8787000000000002e-05 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540672+0000", 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4843e-05 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566449+0000", 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025776578000000001 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566546+0000", 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6809000000000001e-05 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566616+0000", 2024-09-14T08:39:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0009e-05 2024-09-14T08:39:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1260 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3530752~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540732+0000", 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5690570279999996, 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026027419, 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1260 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540732+0000", 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540732+0000", 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540734+0000", 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.553e-06 2024-09-14T08:39:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540740+0000", 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.353e-06 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540759+0000", 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9026999999999999e-05 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540776+0000", 2024-09-14T08:39:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6863000000000001e-05 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566637+0000", 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02586136 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566684+0000", 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7039000000000001e-05 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566760+0000", 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5223999999999997e-05 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1262 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3661824~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540797+0000", 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5689923119999998, 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026162857000000001, 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1262 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540797+0000", 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540797+0000", 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540798+0000", 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5030000000000001e-06 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540804+0000", 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3870000000000003e-06 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540822+0000", 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8615999999999999e-05 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540854+0000", 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1989999999999997e-05 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566781+0000", 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025926293 2024-09-14T08:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566849+0000", 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8563000000000001e-05 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566960+0000", 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110505 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1267 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3792896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540883+0000", 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5689060929999998, 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026283298, 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1267 2024-09-14T08:39:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540883+0000", 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540883+0000", 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540884+0000", 2024-09-14T08:39:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-06 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540889+0000", 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1660000000000002e-06 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540912+0000", 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2563000000000001e-05 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540926+0000", 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3910000000000001e-05 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566997+0000", 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026071061 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567081+0000", 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4046000000000001e-05 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567166+0000", 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5377999999999995e-05 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1274 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3596288~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540953+0000", 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5688364000000004, 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026407103000000001, 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1274 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540953+0000", 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540953+0000", 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540954+0000", 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.127e-06 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540959+0000", 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5230000000000003e-06 2024-09-14T08:39:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540980+0000", 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0270000000000001e-05 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541017+0000", 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7292999999999997e-05 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567203+0000", 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026185724 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567281+0000", 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8722999999999998e-05 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567360+0000", 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8442999999999994e-05 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1278 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3727360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541040+0000", 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.568749457, 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026435001999999999, 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1278 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541040+0000", 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541040+0000", 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541041+0000", 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.277e-06 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541061+0000", 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9536000000000001e-05 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541088+0000", 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7013e-05 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541109+0000", 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1457000000000001e-05 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567381+0000", 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026272058000000001 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567428+0000", 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6578e-05 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567475+0000", 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7083000000000003e-05 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1281 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3858432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541135+0000", 2024-09-14T08:39:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5686546010000004, 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026491632000000001, 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1281 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541135+0000", 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541135+0000", 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541136+0000", 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8500000000000001e-06 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541143+0000", 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1029999999999998e-06 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541165+0000", 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2099999999999998e-05 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541201+0000", 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6423e-05 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567498+0000", 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026296760999999998 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567555+0000", 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7067000000000001e-05 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567626+0000", 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1328000000000006e-05 2024-09-14T08:39:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1287 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3989504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541225+0000", 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5685641019999998, 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026607223999999999, 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1287 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541225+0000", 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541225+0000", 2024-09-14T08:39:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541226+0000", 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.31e-06 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541249+0000", 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2243e-05 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541273+0000", 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3983999999999999e-05 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541288+0000", 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567661+0000", 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026373799999999999 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567743+0000", 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1094999999999995e-05 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567832+0000", 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9782000000000002e-05 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1289 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3923968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541311+0000", 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.568478679, 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026734557999999999, 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1289 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541311+0000", 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541311+0000", 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541313+0000", 2024-09-14T08:39:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0870000000000001e-06 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541319+0000", 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1970000000000001e-06 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541338+0000", 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9213000000000001e-05 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541358+0000", 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9666000000000001e-05 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567869+0000", 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026511585000000001 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567957+0000", 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7355000000000006e-05 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568045+0000", 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8455000000000006e-05 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1292 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 4120576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541382+0000", 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5684070459999999, 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026880907999999998, 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1292 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541382+0000", 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541382+0000", 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541383+0000", 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.24e-06 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541389+0000", 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541407+0000", 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8476999999999999e-05 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541424+0000", 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6719999999999999e-05 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568080+0000", 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026656497000000001 2024-09-14T08:39:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568174+0000", 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3276000000000006e-05 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568263+0000", 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9435e-05 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1296 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 4055040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541444+0000", 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5683448259999997, 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027044634000000001, 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1296 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541444+0000", 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541444+0000", 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541446+0000", 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3599999999999999e-06 2024-09-14T08:39:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541469+0000", 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2806000000000002e-05 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541488+0000", 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9830000000000002e-05 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541505+0000", 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6773e-05 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568300+0000", 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026794552999999999 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568397+0000", 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7108000000000006e-05 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568489+0000", 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2204e-05 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1300 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 4186112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541546+0000", 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5682428809999998, 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027163320000000001, 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1300 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541546+0000", 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541546+0000", 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541548+0000", 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-06 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541553+0000", 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8629999999999996e-06 2024-09-14T08:39:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541576+0000", 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.251e-05 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541611+0000", 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5312999999999999e-05 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568525+0000", 2024-09-14T08:39:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026913313000000001 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568611+0000", 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6549000000000001e-05 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568710+0000", 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8578000000000004e-05 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.199 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:34.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:34.201 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:34.204+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 31, 2024-09-14T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "57b092b7-5550-41a0-8f78-531de0e7c469", 2024-09-14T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-09-14T08:38:48.610112+0000", 2024-09-14T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-09-14T08:39:32.445565+0000", 2024-09-14T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-09-14T08:39:00.908063+0000", 2024-09-14T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-09-14T08:38:51.099971+0000", 2024-09-14T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5806080, 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "nodeep-scrub", 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "noscrub", 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 5, 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T08:39:34.276 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 3, 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 6, 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "luminous", 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:00.306403+0000", 2024-09-14T08:39:34.277 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:39:34.278 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.279 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "15", 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:39:34.280 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:39:34.281 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:39:34.282 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 6.059999942779541, 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 6.059999942779541, 2024-09-14T08:39:34.283 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 1, 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 1 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:06.370159+0000", 2024-09-14T08:39:34.284 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:39:34.285 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:39:34.286 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 2, 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 19, 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:39:34.287 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:39:34.288 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:39:34.289 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.25, 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.25, 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 1, 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2.25, 2024-09-14T08:39:34.290 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2.25, 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 1, 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 1 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "pool_client.0", 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:16.437713+0000", 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:39:34.291 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-09-14T08:39:34.292 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "30", 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:39:34.293 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 6, 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 30, 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:39:34.294 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:39:34.295 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.296 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 1.5, 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 1.5, 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 1, 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.5, 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.5, 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 1, 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 1 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:34.297 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d", 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6800", 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6801", 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6802", 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6803", 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.300 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6806", 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6807", 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:34.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6804", 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6805", 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:39:34.302 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6801/2282442554", 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6803/2282442554", 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6807/2282442554", 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6805/2282442554", 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.303 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:39:34.304 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "09ba1390-a0d1-48a3-9342-5f5aa64e2217", 2024-09-14T08:39:34.304 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:34.304 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:34.304 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:34.304 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:34.304 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:34.304 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:34.304 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:39:34.304 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:39:34.304 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6808", 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6809", 2024-09-14T08:39:34.305 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:34.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.306 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.306 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:34.306 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.306 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.306 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6810", 2024-09-14T08:39:34.306 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6811", 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.307 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6814", 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6815", 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6812", 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6813", 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.309 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6809/2739597491", 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6811/2739597491", 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6815/2739597491", 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6813/2739597491", 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.310 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "a7cd8610-d8e1-44e7-a423-4419cad90d8e", 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 22, 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:34.311 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6816", 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817", 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.312 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.313 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:34.313 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.313 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.313 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818", 2024-09-14T08:39:34.313 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:34.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.314 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.314 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819", 2024-09-14T08:39:34.314 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:34.314 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.314 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.314 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:34.314 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.314 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6822", 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6823", 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6820", 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6821", 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:39:34.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.317 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.317 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6817/1157205327", 2024-09-14T08:39:34.317 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6819/1157205327", 2024-09-14T08:39:34.317 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6823/1157205327", 2024-09-14T08:39:34.317 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6821/1157205327", 2024-09-14T08:39:34.317 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:34.317 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:34.317 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:34.318 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.318 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:39:34.318 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "1339fb05-5d1c-4c0a-8388-314119543bb6", 2024-09-14T08:39:34.318 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:34.318 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:34.318 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:34.318 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:34.319 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:34.319 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:34.319 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:39:34.319 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:39:34.319 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:34.319 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:34.319 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:34.319 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.319 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6808", 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6809", 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6810", 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6811", 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.321 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6814", 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6815", 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6812", 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6813", 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.323 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6809/1656791341", 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6811/1656791341", 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6815/1656791341", 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6813/1656791341", 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:39:34.324 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "0cebba54-9019-47bd-870f-306664e390e1", 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6816", 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6817", 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:34.326 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6818", 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6819", 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.327 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6822", 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6823", 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6820", 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6821", 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6817/1186206237", 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6819/1186206237", 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6823/1186206237", 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6821/1186206237", 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "e571e73b-0e9d-417d-b01c-59b651016763", 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:39:34.330 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.331 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6800", 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6801", 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.332 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6802", 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6803", 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6806", 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6807", 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:39:34.334 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6804", 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6805", 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.335 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6801/796623465", 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6803/796623465", 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6807/796623465", 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6805/796623465", 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:39:34.336 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.174731+0000", 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:34.337 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.475467+0000", 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.606174+0000", 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:34.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.835957+0000", 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:34.339 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.753547+0000", 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:39:34.340 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.284212+0000", 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [ 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "1.0", 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: 4 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:34.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.342 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:34.342 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [], 2024-09-14T08:39:34.342 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-09-14T08:39:34.342 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-09-14T08:39:34.342 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-09-14T08:39:34.342 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-09-14T08:39:34.342 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-09-14T08:39:34.342 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-09-14T08:39:34.342 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-09-14T08:39:34.342 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-09-14T08:39:34.343 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-09-14T08:39:34.344 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-09-14T08:39:34.344 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-09-14T08:39:34.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:34.344 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:34.346 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:34.346 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:34.346 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:39:34.346 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:34.347 INFO:tasks.thrashosds.thrasher:j is {'epoch': 31, 'fsid': '57b092b7-5550-41a0-8f78-531de0e7c469', 'created': '2024-09-14T08:38:48.610112+0000', 'modified': '2024-09-14T08:39:32.445565+0000', 'last_up_change': '2024-09-14T08:39:00.908063+0000', 'last_in_change': '2024-09-14T08:38:51.099971+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T08:39:00.306403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T08:39:06.370159+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T08:39:16.437713+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 6, 'snap_epoch': 30, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 2282442554}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 2282442554}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 2282442554}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 2282442554}]}, 'public_addr': '172.21.15.89:6801/2282442554', 'cluster_addr': '172.21.15.89:6803/2282442554', 'heartbeat_back_addr': '172.21.15.89:6807/2282442554', 'heartbeat_front_addr': '172.21.15.89:6805/2282442554', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '09ba1390-a0d1-48a3-9342-5f5aa64e2217', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6808', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6809', 'nonce': 2739597491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6810', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6811', 'nonce': 2739597491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6814', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6815', 'nonce': 2739597491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6812', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6813', 'nonce': 2739597491}]}, 'public_addr': '172.21.15.89:6809/2739597491', 'cluster_addr': '172.21.15.89:6811/2739597491', 'heartbeat_back_addr': '172.21.15.89:6815/2739597491', 'heartbeat_front_addr': '172.21.15.89:6813/2739597491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a7cd8610-d8e1-44e7-a423-4419cad90d8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6816', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6817', 'nonce': 1157205327}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6818', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 1157205327}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6822', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6823', 'nonce': 1157205327}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6820', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6821', 'nonce': 1157205327}]}, 'public_addr': '172.21.15.89:6817/1157205327', 'cluster_addr': '172.21.15.89:6819/1157205327', 'heartbeat_back_addr': '172.21.15.89:6823/1157205327', 'heartbeat_front_addr': '172.21.15.89:6821/1157205327', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1339fb05-5d1c-4c0a-8388-314119543bb6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6808', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6809', 'nonce': 1656791341}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6810', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6811', 'nonce': 1656791341}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6814', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6815', 'nonce': 1656791341}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6812', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6813', 'nonce': 1656791341}]}, 'public_addr': '172.21.15.112:6809/1656791341', 'cluster_addr': '172.21.15.112:6811/1656791341', 'heartbeat_back_addr': '172.21.15.112:6815/1656791341', 'heartbeat_front_addr': '172.21.15.112:6813/1656791341', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0cebba54-9019-47bd-870f-306664e390e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6816', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6817', 'nonce': 1186206237}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6818', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6819', 'nonce': 1186206237}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6822', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6823', 'nonce': 1186206237}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6820', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6821', 'nonce': 1186206237}]}, 'public_addr': '172.21.15.112:6817/1186206237', 'cluster_addr': '172.21.15.112:6819/1186206237', 'heartbeat_back_addr': '172.21.15.112:6823/1186206237', 'heartbeat_front_addr': '172.21.15.112:6821/1186206237', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e571e73b-0e9d-417d-b01c-59b651016763', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 796623465}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 796623465}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 796623465}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 796623465}]}, 'public_addr': '172.21.15.112:6801/796623465', 'cluster_addr': '172.21.15.112:6803/796623465', 'heartbeat_back_addr': '172.21.15.112:6807/796623465', 'heartbeat_front_addr': '172.21.15.112:6805/796623465', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.174731+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.475467+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.606174+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.835957+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.753547+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.284212+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '1.0', 'osds': [2, 4]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T08:39:34.347 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-14T08:39:34.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:34.348 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:34.351+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:34.446 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:34.451+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:34.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:39:34.522 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:34.522 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:34.522 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:34.522 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:34.522 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:34.536 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:34.579 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:34.587+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:34.629 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone4 from 0xaff7400 (overlap 0x1bc400) to 0x136e00 2024-09-14T08:39:34.634 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:39:34.677 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:34.684+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:34.712 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:34.712 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:34.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:34.712 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:34.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.712 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:7 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-14T08:39:34.712 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:19.374717+0000", 2024-09-14T08:39:34.712 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.344366914, 2024-09-14T08:39:34.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015894680000000001, 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 7 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374717+0000", 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374717+0000", 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374720+0000", 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2660000000000002e-06 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374737+0000", 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7093999999999999e-05 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374778+0000", 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0389000000000002e-05 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374806+0000", 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8393000000000001e-05 2024-09-14T08:39:34.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374965+0000", 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015911199999999999 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374977+0000", 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1494e-05 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.385317+0000", 2024-09-14T08:39:34.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010340177000000001 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.385615+0000", 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029807199999999997 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.385967+0000", 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035150399999999999 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.387780+0000", 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001813495 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.390367+0000", 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025865520000000002 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.390495+0000", 2024-09-14T08:39:34.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128639 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.390612+0000", 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116493 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:20.387937+0000", 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.331147250000001, 2024-09-14T08:39:34.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061851320000000003, 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 9 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387937+0000", 2024-09-14T08:39:34.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387937+0000", 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387939+0000", 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6000000000000001e-06 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387952+0000", 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2923e-05 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387976+0000", 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3723e-05 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388000+0000", 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4280000000000001e-05 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388492+0000", 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049212300000000002 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388638+0000", 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014579299999999999 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388900+0000", 2024-09-14T08:39:34.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184199999999998 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.390025+0000", 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011250050000000001 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.393955+0000", 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039300480000000002 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.394048+0000", 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2563000000000001e-05 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.394122+0000", 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4232000000000003e-05 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4441.0:3030 3.1b e28/21 3:de0a10ea:::rbd_data.10f1c460e0d1.0000000000000039:head v 28'12, mlcod=28'10)", 2024-09-14T08:39:34.725 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.937944+0000", 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.7811403400000003, 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010339281000000001, 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937944+0000", 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937944+0000", 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937946+0000", 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0990000000000001e-06 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.939082+0000", 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011361959999999999 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.939103+0000", 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1236000000000001e-05 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.939117+0000", 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.36e-05 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.939264+0000", 2024-09-14T08:39:34.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000147439 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.939299+0000", 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4413999999999999e-05 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.948236+0000", 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0089377239999999993 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.948283+0000", 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6573000000000003e-05 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4441.0:3029 3.e e28/21 3:70e9fa61:::rbd_data.10f1c460e0d1.0000000000000045:head v 28'11, mlcod=27'9)", 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.937988+0000", 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.7810955899999996, 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.009489417, 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.730 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937988+0000", 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937988+0000", 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937991+0000", 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.938685+0000", 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069423900000000003 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.938722+0000", 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6832000000000002e-05 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.938737+0000", 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5512e-05 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.938874+0000", 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013735700000000001 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.938916+0000", 2024-09-14T08:39:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1341999999999998e-05 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.947387+0000", 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084711939999999996 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.947478+0000", 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0809000000000004e-05 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3031 3.9 3:914ae794:::rbd_data.10f1c460e0d1.000000000000003a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 245760~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.940861+0000", 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.7782232149999997, 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0089889559999999993, 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.735 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3031 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.940861+0000", 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.940861+0000", 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.940863+0000", 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4710000000000001e-06 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941935+0000", 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010721509999999999 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941956+0000", 2024-09-14T08:39:34.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1086000000000001e-05 2024-09-14T08:39:34.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941967+0000", 2024-09-14T08:39:34.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0915e-05 2024-09-14T08:39:34.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942064+0000", 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6566999999999999e-05 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942690+0000", 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062580600000000002 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943192+0000", 2024-09-14T08:39:34.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00050203499999999996 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.948133+0000", 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049407030000000003 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.949657+0000", 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015247189999999999 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.949757+0000", 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100148 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.949850+0000", 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2355000000000006e-05 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3033 3.9 3:95c18a6e:::rbd_data.10f1c460e0d1.0000000000000000:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.742 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.941990+0000", 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.7770941660000004, 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060635919999999996, 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3033 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941990+0000", 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941990+0000", 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941991+0000", 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0279999999999999e-06 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941994+0000", 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.478e-06 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942001+0000", 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942006+0000", 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7709999999999997e-06 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.947828+0000", 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058221439999999996 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.947909+0000", 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0390999999999997e-05 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.948053+0000", 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144876 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3034 3.1a 3:591ca50c:::rbd_data.10f1c460e0d1.000000000000003c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 245760~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.942309+0000", 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.7767750869999999, 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077847960000000001, 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.747 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3034 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942309+0000", 2024-09-14T08:39:34.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942309+0000", 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942310+0000", 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.514e-06 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943066+0000", 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075553800000000004 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943092+0000", 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5582999999999999e-05 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943105+0000", 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3258000000000001e-05 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943233+0000", 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012818700000000001 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943456+0000", 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022338100000000001 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.944279+0000", 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082216899999999998 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.948166+0000", 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038872669999999998 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.949829+0000", 2024-09-14T08:39:34.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016634569999999999 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.949976+0000", 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014712500000000001 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.950094+0000", 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117317 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:4051 3.1a 3:5b543f1c:::rbd_data.10f1c460e0d1.0000000000000120:head [set-alloc-hint object_size 524288 write_size 524288,write 417792~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.199513+0000", 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.5195709969999998, 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0056900620000000001, 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4051 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199513+0000", 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199513+0000", 2024-09-14T08:39:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199515+0000", 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.719e-06 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199522+0000", 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3599999999999998e-06 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199541+0000", 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9279e-05 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199552+0000", 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0919e-05 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199625+0000", 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2410999999999995e-05 2024-09-14T08:39:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199743+0000", 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118387 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199873+0000", 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012997599999999999 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.201149+0000", 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00127622 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.205106+0000", 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039564780000000003 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.205161+0000", 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4832e-05 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.205203+0000", 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2481000000000002e-05 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:4290 3.9 3:901b84fe:::rbd_data.10f1c460e0d1.000000000000005c:head [stat,write 311296~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.229961+0000", 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.4891231129999998, 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071079389999999998, 2024-09-14T08:39:34.760 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4290 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229961+0000", 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229961+0000", 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229962+0000", 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.432e-06 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229979+0000", 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6922000000000002e-05 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229990+0000", 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0603e-05 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229998+0000", 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1019999999999997e-06 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.230964+0000", 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00096597700000000002 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.231041+0000", 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7336999999999995e-05 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.231165+0000", 2024-09-14T08:39:34.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012340800000000001 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.232655+0000", 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014907430000000001 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.237000+0000", 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043442000000000003 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.237040+0000", 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0469000000000002e-05 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.237069+0000", 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8745999999999999e-05 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:4317 3.3 3:c1e541e7:::rbd_data.10f1c460e0d1.00000000000001db:head [set-alloc-hint object_size 524288 write_size 524288,write 188416~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.233505+0000", 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.4855791529999998, 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059797629999999999, 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4317 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233505+0000", 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233505+0000", 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233506+0000", 2024-09-14T08:39:34.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.291e-06 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233522+0000", 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6347000000000001e-05 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233535+0000", 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2364999999999999e-05 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233544+0000", 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2469999999999997e-06 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233612+0000", 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8145999999999994e-05 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233767+0000", 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015470699999999999 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233923+0000", 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015633699999999999 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.234746+0000", 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082310399999999996 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.239376+0000", 2024-09-14T08:39:34.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00462993 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.239437+0000", 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0817999999999999e-05 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.239485+0000", 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7471e-05 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4441.0:4464 3.1c e28/21 3:3bae972c:::rbd_data.10f1c460e0d1.0000000000000113:head v 28'25, mlcod=28'23)", 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.277965+0000", 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.4411186210000002, 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062191520000000004, 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277965+0000", 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277965+0000", 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277966+0000", 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8100000000000003e-07 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277970+0000", 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6540000000000001e-06 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277976+0000", 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6109999999999999e-06 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277981+0000", 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8729999999999998e-06 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.278042+0000", 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0918999999999997e-05 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.278063+0000", 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:39:34.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.284118+0000", 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060546849999999998 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.284185+0000", 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6715000000000001e-05 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:4592 3.3 3:c1e541e7:::rbd_data.10f1c460e0d1.00000000000001db:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.297265+0000", 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.4218193960000001, 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059672140000000002, 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4592 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.778 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297265+0000", 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297265+0000", 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297265+0000", 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.78e-07 2024-09-14T08:39:34.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297270+0000", 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2239999999999997e-06 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297281+0000", 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790000000000001e-05 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297287+0000", 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4609999999999999e-06 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297333+0000", 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6227000000000003e-05 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297400+0000", 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7185000000000001e-05 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297468+0000", 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7638000000000005e-05 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.301074+0000", 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036057440000000001 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.303164+0000", 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020902009999999999 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.303194+0000", 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0227e-05 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.303232+0000", 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7639000000000003e-05 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:5858 3.1a 3:5987c70c:::rbd_data.10f1c460e0d1.000000000000002a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 270336~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.495200+0000", 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.2238838200000002, 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0095000129999999999, 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5858 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.495200+0000", 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.495200+0000", 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.495201+0000", 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9100000000000002e-07 2024-09-14T08:39:34.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496087+0000", 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00088577999999999997 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496102+0000", 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5502000000000002e-05 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496112+0000", 2024-09-14T08:39:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0152e-05 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496219+0000", 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106319 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496426+0000", 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000207467 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496877+0000", 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00045093500000000002 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.499402+0000", 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025248710000000001 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.504575+0000", 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051732200000000001 2024-09-14T08:39:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.504631+0000", 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5980999999999998e-05 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.504700+0000", 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8894999999999997e-05 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:6654 3.3 3:c5c43db1:::rbd_data.10f1c460e0d1.0000000000000047:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.823327+0000", 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.8957572369999998, 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069456800000000001, 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 6654 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823327+0000", 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823327+0000", 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823329+0000", 2024-09-14T08:39:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.77e-06 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823341+0000", 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.296e-05 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823364+0000", 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2963e-05 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823382+0000", 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7180000000000002e-05 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.824367+0000", 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098520500000000007 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.825047+0000", 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067997299999999995 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.825179+0000", 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013178699999999999 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.827817+0000", 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026386650000000001 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.830202+0000", 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023848239999999998 2024-09-14T08:39:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.830244+0000", 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2045999999999997e-05 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.830272+0000", 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8306999999999999e-05 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:6704 3.9 3:914ae794:::rbd_data.10f1c460e0d1.000000000000003a:head [stat,truncate 73728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.834256+0000", 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.8848284529999999, 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073976650000000003, 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 6704 2024-09-14T08:39:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834256+0000", 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834256+0000", 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834258+0000", 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0499999999999999e-06 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834268+0000", 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0217000000000001e-05 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834300+0000", 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2053e-05 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834321+0000", 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1140000000000001e-05 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834488+0000", 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016654199999999999 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834698+0000", 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021053200000000001 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.835247+0000", 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054885000000000003 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.838732+0000", 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034850969999999999 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.841435+0000", 2024-09-14T08:39:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027033220000000002 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.841553+0000", 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117439 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.841653+0000", 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100423 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:6793 3.9 3:95c18a6e:::rbd_data.10f1c460e0d1.0000000000000000:head [read 3584~512] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.868722+0000", 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.8503618020000001, 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059062899999999998, 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 6793 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868722+0000", 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868722+0000", 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868723+0000", 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0300000000000001e-06 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868728+0000", 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0329999999999999e-06 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868751+0000", 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3082999999999999e-05 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868768+0000", 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6433e-05 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.874077+0000", 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053093910000000001 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.874271+0000", 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000193492 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.874628+0000", 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035782799999999998 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:6800 3.9 3:95c18a6e:::rbd_data.10f1c460e0d1.0000000000000000:head [stat,write 300032~3072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.871176+0000", 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.8479076660000002, 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0068706740000000002, 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 6800 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871176+0000", 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871176+0000", 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871179+0000", 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3039999999999999e-06 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871191+0000", 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2303000000000001e-05 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871240+0000", 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8912999999999997e-05 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871255+0000", 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5376999999999999e-05 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.874712+0000", 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034570730000000002 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.874925+0000", 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021293500000000001 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.875152+0000", 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022652499999999999 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.877411+0000", 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022589089999999999 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.877733+0000", 2024-09-14T08:39:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032236400000000001 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.877807+0000", 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4456000000000007e-05 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.878047+0000", 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023951500000000001 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4477.0:855 3.1a 3:5a1187ee:::rbd_object_map.10f136b23724:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:32.808459+0000", 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.9106252910000001, 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057786540000000003, 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4477", 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2349213865", 2024-09-14T08:39:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 855 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808459+0000", 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808459+0000", 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808461+0000", 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808472+0000", 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.099e-05 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808502+0000", 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0306000000000001e-05 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808517+0000", 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.488e-05 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808640+0000", 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123199 2024-09-14T08:39:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808790+0000", 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014959899999999999 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.809332+0000", 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054187300000000001 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.813965+0000", 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046331760000000001 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.814092+0000", 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012720200000000001 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.814164+0000", 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2303000000000002e-05 2024-09-14T08:39:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.814237+0000", 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2939000000000001e-05 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4477.0:1701 3.1a 3:5a1187ee:::rbd_object_map.10f136b23724:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:33.588528+0000", 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.130556095, 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055173339999999996, 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4477", 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2349213865", 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1701 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588528+0000", 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588528+0000", 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588538+0000", 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0414000000000001e-05 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588551+0000", 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2523e-05 2024-09-14T08:39:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588593+0000", 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2262999999999998e-05 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588611+0000", 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8162999999999999e-05 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.590501+0000", 2024-09-14T08:39:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018895610000000001 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.590761+0000", 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025974800000000002 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.591883+0000", 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00112246 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.593746+0000", 2024-09-14T08:39:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018634509999999999 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.593901+0000", 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015500900000000001 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.593981+0000", 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9505999999999994e-05 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.594045+0000", 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4236e-05 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4477.0:1754 3.1a 3:5a1187ee:::rbd_object_map.10f136b23724:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:33.625747+0000", 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.0933373930000001, 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057650590000000003, 2024-09-14T08:39:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4477", 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2349213865", 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1754 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625747+0000", 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625747+0000", 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625748+0000", 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.697e-06 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625756+0000", 2024-09-14T08:39:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9070000000000007e-06 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625774+0000", 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7703e-05 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625784+0000", 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8660000000000001e-06 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.627982+0000", 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002198569 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.628218+0000", 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023595800000000001 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.628983+0000", 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076440799999999995 2024-09-14T08:39:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.630353+0000", 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013707509999999999 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.631370+0000", 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010160569999999999 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.631456+0000", 2024-09-14T08:39:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6805999999999995e-05 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.631512+0000", 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5337000000000002e-05 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:34.831 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:34.832 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:34.833 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:34.833 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:34.834 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:34.834 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:34.834 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:34.835 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:34.835 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:34.835 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:34.835 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:34.836+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:34.850 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:34.869 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:34.869 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:34.934 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:34.939+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:34.966 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:34.967 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:34.981 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:35.067 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:35.075+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:35.136 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:35.140+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:35.147 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:35.147 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:35.161 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:35.251 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:35.259+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:35.325 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:35.326 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:35.337 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:35.340+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:35.339 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:35.438 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:35.443+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:35.454 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-14T08:39:35.463 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:39:35.480 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:35.480 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:35.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:35.542 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:35.548+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:35.639 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:35.644+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:35.658 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:35.658 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:35.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:35.762 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:35.768+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:35.841 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:35.844+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:35.841 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:35.841 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:35.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:35.878 INFO:teuthology.orchestra.run.smithi188.stdout:434 trunc from 0xaff7400 to 0xc00000 2024-09-14T08:39:35.941 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:35.947+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:35.944 INFO:teuthology.orchestra.run.smithi188.stdout:435 read 0x3f7200 thru 0x3ffab8 (0x88b9 bytes) 2024-09-14T08:39:35.953 INFO:teuthology.orchestra.run.smithi188.stdout:436 trunc from 0xc00000 to 0x31cd600 2024-09-14T08:39:36.025 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:36.025 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:36.037 INFO:teuthology.orchestra.run.smithi188.stdout:438 write 0xdb8a000 thru 0xdb92b51 (0x8b52 bytes) 2024-09-14T08:39:36.040 INFO:teuthology.orchestra.run.smithi188.stdout:440 write 0x89dea00 thru 0x89ec517 (0xdb18 bytes) 2024-09-14T08:39:36.040 INFO:teuthology.orchestra.run.smithi188.stdout:441 read 0x7f0ac00 thru 0x7f0b69f (0xaa0 bytes) 2024-09-14T08:39:36.040 INFO:teuthology.orchestra.run.smithi188.stdout:443 write 0x3f46e00 thru 0x3f4f558 (0x8759 bytes) 2024-09-14T08:39:36.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:36.042 INFO:teuthology.orchestra.run.smithi188.stdout:446 write 0x24f7200 thru 0x24f9204 (0x2005 bytes) 2024-09-14T08:39:36.042 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:36.048+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:36.044 INFO:teuthology.orchestra.run.smithi188.stdout:447 write 0xc973200 thru 0xc97ef2b (0xbd2c bytes) 2024-09-14T08:39:36.044 INFO:teuthology.orchestra.run.smithi188.stdout:449 punch from 0x2e19e00 to 0x2e23a00, (0x9c00 bytes) 2024-09-14T08:39:36.045 INFO:teuthology.orchestra.run.smithi188.stdout:451 write 0x7193e00 thru 0x719bb3e (0x7d3f bytes) 2024-09-14T08:39:36.046 INFO:teuthology.orchestra.run.smithi188.stdout:453 read 0xb9b2400 thru 0xb9b390e (0x150f bytes) 2024-09-14T08:39:36.046 INFO:teuthology.orchestra.run.smithi188.stdout:454 write 0x9883600 thru 0x98845e7 (0xfe8 bytes) 2024-09-14T08:39:36.046 INFO:teuthology.orchestra.run.smithi188.stdout:455 punch from 0xfb5c00 to 0xfb6200, (0x600 bytes) 2024-09-14T08:39:36.071 INFO:teuthology.orchestra.run.smithi188.stdout:457 trunc from 0xdb92c00 to 0x3a46a00 2024-09-14T08:39:36.143 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:36.148+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:36.167 INFO:teuthology.orchestra.run.smithi188.stdout:458 write 0xea7d000 thru 0xea83a7b (0x6a7c bytes) 2024-09-14T08:39:36.169 INFO:teuthology.orchestra.run.smithi188.stdout:460 write 0xa641c00 thru 0xa64898a (0x6d8b bytes) 2024-09-14T08:39:36.180 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:36.183 INFO:teuthology.orchestra.run.smithi188.stdout:461 trunc from 0xea83c00 to 0x9981800 2024-09-14T08:39:36.262 INFO:teuthology.orchestra.run.smithi188.stdout:462 write 0xb69f000 thru 0xb6a4438 (0x5439 bytes) 2024-09-14T08:39:36.263 INFO:teuthology.orchestra.run.smithi188.stdout:463 write 0x7b86000 thru 0x7b88da7 (0x2da8 bytes) 2024-09-14T08:39:36.263 INFO:teuthology.orchestra.run.smithi188.stdout:464 read 0x3da4000 thru 0x3da58f3 (0x18f4 bytes) 2024-09-14T08:39:36.264 INFO:teuthology.orchestra.run.smithi188.stdout:468 write 0x686be00 thru 0x686f3c7 (0x35c8 bytes) 2024-09-14T08:39:36.265 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:36.272+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:36.271 INFO:teuthology.orchestra.run.smithi188.stdout:469 trunc from 0xb6a4600 to 0xe343200 2024-09-14T08:39:36.302 INFO:teuthology.orchestra.run.smithi188.stdout:470 read 0x3f21c00 thru 0x3f288db (0x6cdc bytes) 2024-09-14T08:39:36.306 INFO:teuthology.orchestra.run.smithi188.stdout:471 read 0xe00be00 thru 0xe00f5f0 (0x37f1 bytes) 2024-09-14T08:39:36.306 INFO:teuthology.orchestra.run.smithi188.stdout:473 read 0x4177a00 thru 0x418550b (0xdb0c bytes) 2024-09-14T08:39:36.309 INFO:teuthology.orchestra.run.smithi188.stdout:478 read 0x3ed9200 thru 0x3ee5a38 (0xc839 bytes) 2024-09-14T08:39:36.310 INFO:teuthology.orchestra.run.smithi188.stdout:480 read 0x55c400 thru 0x55e0ce (0x1ccf bytes) 2024-09-14T08:39:36.314 INFO:teuthology.orchestra.run.smithi188.stdout:482 trunc from 0xe343200 to 0xd18dc00 2024-09-14T08:39:36.340 INFO:teuthology.orchestra.run.smithi188.stdout:483 read 0x48c6800 thru 0x48c7883 (0x1084 bytes) 2024-09-14T08:39:36.343 INFO:teuthology.orchestra.run.smithi188.stdout:485 write 0x521a000 thru 0x521a79b (0x79c bytes) 2024-09-14T08:39:36.343 INFO:teuthology.orchestra.run.smithi188.stdout:486 read 0x71dce00 thru 0x71ea358 (0xd559 bytes) 2024-09-14T08:39:36.344 INFO:teuthology.orchestra.run.smithi188.stdout:490 punch from 0xcaa00 to 0xd7200, (0xc800 bytes) 2024-09-14T08:39:36.345 INFO:teuthology.orchestra.run.smithi188.stdout:492 read 0xa9e2200 thru 0xa9eca19 (0xa81a bytes) 2024-09-14T08:39:36.345 INFO:teuthology.orchestra.run.smithi188.stdout:493 read 0xb6dda00 thru 0xb6e2b09 (0x510a bytes) 2024-09-14T08:39:36.345 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:36.351+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:36.347 INFO:teuthology.orchestra.run.smithi188.stdout:496 trunc from 0xd18dc00 to 0xc2c3800 2024-09-14T08:39:36.352 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:36.352 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:36.368 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:36.378 INFO:teuthology.orchestra.run.smithi188.stdout:498 punch from 0xaf3a400 to 0xaf3bc00, (0x1800 bytes) 2024-09-14T08:39:36.380 INFO:teuthology.orchestra.run.smithi188.stdout:500 read 0x9c32c00 thru 0x9c3a49d (0x789e bytes) 2024-09-14T08:39:36.380 INFO:teuthology.orchestra.run.smithi188.stdout:501 write 0xb136400 thru 0xb137659 (0x125a bytes) 2024-09-14T08:39:36.380 INFO:teuthology.orchestra.run.smithi188.stdout:502 punch from 0x16d8c00 to 0x16da000, (0x1400 bytes) 2024-09-14T08:39:36.381 INFO:teuthology.orchestra.run.smithi188.stdout:503 write 0x6065000 thru 0x6072b82 (0xdb83 bytes) 2024-09-14T08:39:36.381 INFO:teuthology.orchestra.run.smithi188.stdout:504 punch from 0x2867e00 to 0x286cc00, (0x4e00 bytes) 2024-09-14T08:39:36.381 INFO:teuthology.orchestra.run.smithi188.stdout:505 write 0x6c77e00 thru 0x6c80d6e (0x8f6f bytes) 2024-09-14T08:39:36.411 INFO:teuthology.orchestra.run.smithi188.stdout:507 write 0xd77fe00 thru 0xd781c25 (0x1e26 bytes) 2024-09-14T08:39:36.414 INFO:teuthology.orchestra.run.smithi188.stdout:508 write 0x8867a00 thru 0x88751a3 (0xd7a4 bytes) 2024-09-14T08:39:36.421 INFO:teuthology.orchestra.run.smithi188.stdout:510 trunc from 0xd781e00 to 0xa9f6000 2024-09-14T08:39:36.445 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:36.451+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:36.478 INFO:teuthology.orchestra.run.smithi188.stdout:512 write 0xc549e00 thru 0xc55181f (0x7a20 bytes) 2024-09-14T08:39:36.482 INFO:teuthology.orchestra.run.smithi188.stdout:513 punch from 0x6452800 to 0x6457a00, (0x5200 bytes) 2024-09-14T08:39:36.484 INFO:teuthology.orchestra.run.smithi188.stdout:515 flatten 2024-09-14T08:39:36.512 INFO:teuthology.orchestra.run.smithi188.stdout:516 read 0x7383800 thru 0x7389cbc (0x64bd bytes) 2024-09-14T08:39:36.512 INFO:teuthology.orchestra.run.smithi188.stdout:518 write 0x898b800 thru 0x898f89d (0x409e bytes) 2024-09-14T08:39:36.512 INFO:teuthology.orchestra.run.smithi188.stdout:521 write 0xbb2da00 thru 0xbb3289b (0x4e9c bytes) 2024-09-14T08:39:36.514 INFO:teuthology.orchestra.run.smithi188.stdout:524 write 0xa134800 thru 0xa13987b (0x507c bytes) 2024-09-14T08:39:36.514 INFO:teuthology.orchestra.run.smithi188.stdout:526 punch from 0x4e0c00 to 0x4e9800, (0x8c00 bytes) 2024-09-14T08:39:36.515 INFO:teuthology.orchestra.run.smithi188.stdout:528 write 0x815fa00 thru 0x815ff6c (0x56d bytes) 2024-09-14T08:39:36.533 INFO:teuthology.orchestra.run.smithi188.stdout:529 trunc from 0xc551a00 to 0x1185800 2024-09-14T08:39:36.540 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:36.540 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:36.546 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:36.552+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:36.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:36.599 INFO:teuthology.orchestra.run.smithi188.stdout:530 trunc from 0x1185800 to 0x4601200 2024-09-14T08:39:36.647 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:36.655+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:36.661 INFO:teuthology.orchestra.run.smithi188.stdout:531 write 0xa711c00 thru 0xa71421e (0x261f bytes) 2024-09-14T08:39:36.663 INFO:teuthology.orchestra.run.smithi188.stdout:533 read 0x6a0c00 thru 0x6a5e27 (0x5228 bytes) 2024-09-14T08:39:36.664 INFO:teuthology.orchestra.run.smithi188.stdout:537 punch from 0x3eabc00 to 0x3eb7e00, (0xc200 bytes) 2024-09-14T08:39:36.665 INFO:teuthology.orchestra.run.smithi188.stdout:539 read 0x5be6800 thru 0x5be6f3f (0x740 bytes) 2024-09-14T08:39:36.674 INFO:teuthology.orchestra.run.smithi188.stdout:540 trunc from 0xa714400 to 0x6bc0400 2024-09-14T08:39:36.711 INFO:teuthology.orchestra.run.smithi188.stdout:541 read 0x5752600 thru 0x57569dc (0x43dd bytes) 2024-09-14T08:39:36.712 INFO:teuthology.orchestra.run.smithi188.stdout:542 read 0x2fdba00 thru 0x2fe42ba (0x88bb bytes) 2024-09-14T08:39:36.727 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:36.728 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:36.728 INFO:teuthology.orchestra.run.smithi188.stdout:543 trunc from 0x6bc0400 to 0xc029200 2024-09-14T08:39:36.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:36.748 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:36.755+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:36.750 INFO:teuthology.orchestra.run.smithi188.stdout:544 read 0x90ba200 thru 0x90c95a0 (0xf3a1 bytes) 2024-09-14T08:39:36.755 INFO:teuthology.orchestra.run.smithi188.stdout:546 read 0xdd7400 thru 0xde6c09 (0xf80a bytes) 2024-09-14T08:39:36.755 INFO:teuthology.orchestra.run.smithi188.stdout:547 read 0x8d51a00 thru 0x8d5e3f7 (0xc9f8 bytes) 2024-09-14T08:39:36.771 INFO:teuthology.orchestra.run.smithi188.stdout:548 trunc from 0xc029200 to 0x6514000 2024-09-14T08:39:36.806 INFO:teuthology.orchestra.run.smithi188.stdout:549 trunc from 0x6514000 to 0x14f6800 2024-09-14T08:39:36.834 INFO:teuthology.orchestra.run.smithi188.stdout:554 read 0xcde800 thru 0xce9ff1 (0xb7f2 bytes) 2024-09-14T08:39:36.837 INFO:teuthology.orchestra.run.smithi188.stdout:555 read 0x21b000 thru 0x221759 (0x675a bytes) 2024-09-14T08:39:36.838 INFO:teuthology.orchestra.run.smithi188.stdout:556 read 0x542200 thru 0x5449f2 (0x27f3 bytes) 2024-09-14T08:39:36.848 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:36.855+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:36.864 INFO:teuthology.orchestra.run.smithi188.stdout:561 trunc from 0x14f6800 to 0xb652600 2024-09-14T08:39:36.872 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:36.872 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:36.886 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:39:36.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:36.893 INFO:teuthology.orchestra.run.smithi188.stdout:562 write 0x61d0800 thru 0x61de2b8 (0xdab9 bytes) 2024-09-14T08:39:36.894 INFO:teuthology.orchestra.run.smithi188.stdout:564 write 0x9ed1200 thru 0x9ed34e3 (0x22e4 bytes) 2024-09-14T08:39:36.905 INFO:teuthology.orchestra.run.smithi188.stdout:565 trunc from 0xb652600 to 0xed4be00 2024-09-14T08:39:36.925 INFO:teuthology.orchestra.run.smithi188.stdout:566 punch from 0x252fc00 to 0x2534000, (0x4400 bytes) 2024-09-14T08:39:36.934 INFO:teuthology.orchestra.run.smithi188.stdout:567 trunc from 0xed4be00 to 0xba83200 2024-09-14T08:39:36.949 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:36.955+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:36.956 INFO:teuthology.orchestra.run.smithi188.stdout:569 write 0xb70a600 thru 0xb710a19 (0x641a bytes) 2024-09-14T08:39:36.957 INFO:teuthology.orchestra.run.smithi188.stdout:572 punch from 0x37c4a00 to 0x37c5c00, (0x1200 bytes) 2024-09-14T08:39:36.976 INFO:teuthology.orchestra.run.smithi188.stdout:574 write 0xcad8400 thru 0xcae4e04 (0xca05 bytes) 2024-09-14T08:39:36.978 INFO:teuthology.orchestra.run.smithi188.stdout:575 write 0x18f9000 thru 0x19060ad (0xd0ae bytes) 2024-09-14T08:39:36.978 INFO:teuthology.orchestra.run.smithi188.stdout:576 punch from 0x50ba400 to 0x50bc000, (0x1c00 bytes) 2024-09-14T08:39:36.979 INFO:teuthology.orchestra.run.smithi188.stdout:580 read 0x9c83a00 thru 0x9c861fb (0x27fc bytes) 2024-09-14T08:39:37.000 INFO:teuthology.orchestra.run.smithi188.stdout:581 trunc from 0xcae5000 to 0x2178200 2024-09-14T08:39:37.036 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:37.036 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:37.038 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:37.038 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:37.038 INFO:teuthology.orchestra.run.smithi188.stdout:582 trunc from 0x2178200 to 0x3e39c00 2024-09-14T08:39:37.049 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:37.055+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:37.051 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:37.055 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:37.055 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:37.071 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:37.071 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:37.074 INFO:teuthology.orchestra.run.smithi188.stdout:584 write 0x6b60200 thru 0x6b61c0e (0x1a0f bytes) 2024-09-14T08:39:37.075 INFO:teuthology.orchestra.run.smithi188.stdout:586 read 0x50b6400 thru 0x50bd533 (0x7134 bytes) 2024-09-14T08:39:37.075 INFO:teuthology.orchestra.run.smithi188.stdout:588 read 0x28da200 thru 0x28df4d3 (0x52d4 bytes) 2024-09-14T08:39:37.076 INFO:teuthology.orchestra.run.smithi188.stdout:589 read 0x61ca800 thru 0x61cdf29 (0x372a bytes) 2024-09-14T08:39:37.076 INFO:teuthology.orchestra.run.smithi188.stdout:591 read 0x3d23600 thru 0x3d253ad (0x1dae bytes) 2024-09-14T08:39:37.077 INFO:teuthology.orchestra.run.smithi188.stdout:594 write 0x38bda00 thru 0x38cd719 (0xfd1a bytes) 2024-09-14T08:39:37.090 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:37.090 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:37.109 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:37.109 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:37.115 INFO:teuthology.orchestra.run.smithi188.stdout:596 write 0xcc8c800 thru 0xcc92f26 (0x6727 bytes) 2024-09-14T08:39:37.126 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:37.135 INFO:teuthology.orchestra.run.smithi188.stdout:597 trunc from 0xcc93000 to 0x32f4400 2024-09-14T08:39:37.150 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:37.155+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:37.168 INFO:teuthology.orchestra.run.smithi188.stdout:598 read 0x2050000 thru 0x20526d0 (0x26d1 bytes) 2024-09-14T08:39:37.170 INFO:teuthology.orchestra.run.smithi188.stdout:599 punch from 0x12f0a00 to 0x12faa00, (0xa000 bytes) 2024-09-14T08:39:37.203 INFO:teuthology.orchestra.run.smithi188.stdout:600 write 0xb00fa00 thru 0xb0110fc (0x16fd bytes) 2024-09-14T08:39:37.206 INFO:teuthology.orchestra.run.smithi188.stdout:601 read 0x782b400 thru 0x782ecc5 (0x38c6 bytes) 2024-09-14T08:39:37.206 INFO:teuthology.orchestra.run.smithi188.stdout:603 write 0x769ba00 thru 0x769fe70 (0x4471 bytes) 2024-09-14T08:39:37.206 INFO:teuthology.orchestra.run.smithi188.stdout:604 write 0x673ae00 thru 0x6741281 (0x6482 bytes) 2024-09-14T08:39:37.232 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:37.233 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:37.233 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:37.233 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:37.233 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:37.237 INFO:teuthology.orchestra.run.smithi188.stdout:610 write 0xe55dc00 thru 0xe55e0c4 (0x4c5 bytes) 2024-09-14T08:39:37.238 INFO:teuthology.orchestra.run.smithi188.stdout:613 write 0x448a00 thru 0x44fa2a (0x702b bytes) 2024-09-14T08:39:37.240 INFO:teuthology.orchestra.run.smithi188.stdout:615 punch from 0x73ca00 to 0x741000, (0x4600 bytes) 2024-09-14T08:39:37.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:37.263 INFO:teuthology.orchestra.run.smithi188.stdout:618 write 0xe871e00 thru 0xe87ba20 (0x9c21 bytes) 2024-09-14T08:39:37.265 INFO:teuthology.orchestra.run.smithi188.stdout:619 write 0xfd600 thru 0xfeff3 (0x19f4 bytes) 2024-09-14T08:39:37.267 INFO:teuthology.orchestra.run.smithi188.stdout:620 punch from 0x6070e00 to 0x6078e00, (0x8000 bytes) 2024-09-14T08:39:37.267 INFO:teuthology.orchestra.run.smithi188.stdout:621 write 0x2319200 thru 0x231e08c (0x4e8d bytes) 2024-09-14T08:39:37.269 INFO:teuthology.orchestra.run.smithi188.stdout:623 write 0x513ce00 thru 0x5144b45 (0x7d46 bytes) 2024-09-14T08:39:37.270 INFO:teuthology.orchestra.run.smithi188.stdout:624 read 0xabe1a00 thru 0xabea8d2 (0x8ed3 bytes) 2024-09-14T08:39:37.270 INFO:teuthology.orchestra.run.smithi188.stdout:626 write 0x697c200 thru 0x697dca3 (0x1aa4 bytes) 2024-09-14T08:39:37.272 INFO:teuthology.orchestra.run.smithi188.stdout:627 write 0x7d65a00 thru 0x7d6e9cc (0x8fcd bytes) 2024-09-14T08:39:37.274 INFO:teuthology.orchestra.run.smithi188.stdout:629 write 0xb6e4800 thru 0xb6eaf3d (0x673e bytes) 2024-09-14T08:39:37.274 INFO:teuthology.orchestra.run.smithi188.stdout:632 write 0x3e0f400 thru 0x3e0f50b (0x10c bytes) 2024-09-14T08:39:37.275 INFO:teuthology.orchestra.run.smithi188.stdout:635 read 0x6e0a000 thru 0x6e1375b (0x975c bytes) 2024-09-14T08:39:37.276 INFO:teuthology.orchestra.run.smithi188.stdout:636 write 0xb344000 thru 0xb34b3b6 (0x73b7 bytes) 2024-09-14T08:39:37.276 INFO:teuthology.orchestra.run.smithi188.stdout:640 read 0xdbae600 thru 0xdbbcb0b (0xe50c bytes) 2024-09-14T08:39:37.277 INFO:teuthology.orchestra.run.smithi188.stdout:641 write 0x3714e00 thru 0x37238e9 (0xeaea bytes) 2024-09-14T08:39:37.286 INFO:teuthology.orchestra.run.smithi188.stdout:643 trunc from 0xe87bc00 to 0xb9af200 2024-09-14T08:39:37.291 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:37.299+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:37.352 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:37.359+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:37.356 INFO:teuthology.orchestra.run.smithi188.stdout:645 trunc from 0xb9af200 to 0x319cc00 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4189.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:01.928255+0000", 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.500475182999999, 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033562680999999997, 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4189", 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/667407553", 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928255+0000", 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928255+0000", 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928257+0000", 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928271+0000", 2024-09-14T08:39:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.419e-05 2024-09-14T08:39:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928294+0000", 2024-09-14T08:39:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2767000000000001e-05 2024-09-14T08:39:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928319+0000", 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4732999999999999e-05 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928502+0000", 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018318499999999999 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.928520+0000", 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7603000000000001e-05 2024-09-14T08:39:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.958398+0000", 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029878400999999999 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.958707+0000", 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030891000000000002 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.959053+0000", 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034653499999999997 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.960696+0000", 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016423690000000001 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.961658+0000", 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00096181900000000004 2024-09-14T08:39:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.961748+0000", 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919000000000004e-05 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:01.961817+0000", 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9777000000000006e-05 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1153 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3842048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.538347+0000", 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8903829079999994, 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026047579000000001, 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1153 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538347+0000", 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538347+0000", 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538348+0000", 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1829999999999999e-06 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538370+0000", 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.226e-05 2024-09-14T08:39:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538409+0000", 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8609000000000003e-05 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.538425+0000", 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5837000000000001e-05 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.560369+0000", 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021944643 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.560477+0000", 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107575 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.564395+0000", 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003917472 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1231 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540112+0000", 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8886181929999992, 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025101333, 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1231 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540112+0000", 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540112+0000", 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540113+0000", 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.353e-06 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540119+0000", 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8529999999999997e-06 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540141+0000", 2024-09-14T08:39:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1733e-05 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540158+0000", 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7316000000000002e-05 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565032+0000", 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024874446000000001 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565122+0000", 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9456999999999994e-05 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565213+0000", 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1174999999999994e-05 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1236 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 4177920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540226+0000", 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8885036710000005, 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025193242000000001, 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1236 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540226+0000", 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540226+0000", 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540228+0000", 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.353e-06 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540234+0000", 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1199999999999999e-06 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540253+0000", 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9697000000000001e-05 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540273+0000", 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.931e-05 2024-09-14T08:39:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565252+0000", 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024979632000000002 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565336+0000", 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3319000000000006e-05 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565419+0000", 2024-09-14T08:39:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3811000000000001e-05 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1241 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3203072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540297+0000", 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8884328279999991, 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025364491999999999, 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1241 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540297+0000", 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540297+0000", 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540299+0000", 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5030000000000001e-06 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540326+0000", 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7912999999999999e-05 2024-09-14T08:39:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540348+0000", 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1832999999999999e-05 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540374+0000", 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5394000000000001e-05 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565456+0000", 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025082528999999999 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565543+0000", 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6594999999999993e-05 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565662+0000", 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118725 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1247 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3334144~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540414+0000", 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8883161019999992, 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025491073, 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1247 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540414+0000", 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540414+0000", 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540415+0000", 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.426e-06 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540422+0000", 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.55e-06 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540441+0000", 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9412999999999999e-05 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540456+0000", 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4803e-05 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565699+0000", 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025242674 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565788+0000", 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9560000000000003e-05 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565905+0000", 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116647 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.452 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1249 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3268608~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540475+0000", 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8882544459999995, 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025701721, 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.453 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1249 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540475+0000", 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540475+0000", 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540477+0000", 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.223e-06 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540482+0000", 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6570000000000002e-06 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540501+0000", 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8689999999999999e-05 2024-09-14T08:39:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540516+0000", 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4516e-05 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.565943+0000", 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025427226000000001 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566041+0000", 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8627000000000003e-05 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566177+0000", 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013578200000000001 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1253 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3465216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.457 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540536+0000", 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8881940129999997, 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025878167000000001, 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1253 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540536+0000", 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540536+0000", 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540537+0000", 2024-09-14T08:39:37.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1829999999999999e-06 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540542+0000", 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540561+0000", 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8546000000000002e-05 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540609+0000", 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7695999999999999e-05 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566218+0000", 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025609123000000001 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566305+0000", 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7375999999999998e-05 2024-09-14T08:39:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566414+0000", 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108859 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1255 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3399680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540632+0000", 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8880981339999998, 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025984159, 2024-09-14T08:39:37.462 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1255 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540632+0000", 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540632+0000", 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540633+0000", 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.42e-06 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540639+0000", 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540658+0000", 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8787000000000002e-05 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540672+0000", 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4843e-05 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566449+0000", 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025776578000000001 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566546+0000", 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6809000000000001e-05 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566616+0000", 2024-09-14T08:39:37.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0009e-05 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1260 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3530752~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540732+0000", 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8879976840000001, 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026027419, 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.467 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1260 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540732+0000", 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540732+0000", 2024-09-14T08:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540734+0000", 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.553e-06 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540740+0000", 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.353e-06 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540759+0000", 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9026999999999999e-05 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540776+0000", 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6863000000000001e-05 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566637+0000", 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02586136 2024-09-14T08:39:37.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566684+0000", 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7039000000000001e-05 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566760+0000", 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5223999999999997e-05 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1262 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3661824~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540797+0000", 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8879329679999994, 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026162857000000001, 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1262 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540797+0000", 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540797+0000", 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540798+0000", 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5030000000000001e-06 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540804+0000", 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3870000000000003e-06 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540822+0000", 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8615999999999999e-05 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540854+0000", 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1989999999999997e-05 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566781+0000", 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025926293 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566849+0000", 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8563000000000001e-05 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566960+0000", 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110505 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.476 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1267 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3792896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540883+0000", 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8878467489999995, 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026283298, 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1267 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540883+0000", 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540883+0000", 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540884+0000", 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-06 2024-09-14T08:39:37.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540889+0000", 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1660000000000002e-06 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540912+0000", 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2563000000000001e-05 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540926+0000", 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3910000000000001e-05 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.566997+0000", 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026071061 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567081+0000", 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4046000000000001e-05 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567166+0000", 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5377999999999995e-05 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1274 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3596288~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.540953+0000", 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8877770560000009, 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026407103000000001, 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1274 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540953+0000", 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540953+0000", 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540954+0000", 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.127e-06 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540959+0000", 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5230000000000003e-06 2024-09-14T08:39:37.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.540980+0000", 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0270000000000001e-05 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541017+0000", 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7292999999999997e-05 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567203+0000", 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026185724 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567281+0000", 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8722999999999998e-05 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567360+0000", 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8442999999999994e-05 2024-09-14T08:39:37.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1278 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3727360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541040+0000", 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8876901129999997, 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026435001999999999, 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1278 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541040+0000", 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541040+0000", 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541041+0000", 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.277e-06 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541061+0000", 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9536000000000001e-05 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541088+0000", 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7013e-05 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541109+0000", 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1457000000000001e-05 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567381+0000", 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026272058000000001 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567428+0000", 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6578e-05 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567475+0000", 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7083000000000003e-05 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1281 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3858432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541135+0000", 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8875952569999992, 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026491632000000001, 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1281 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541135+0000", 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541135+0000", 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541136+0000", 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8500000000000001e-06 2024-09-14T08:39:37.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541143+0000", 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1029999999999998e-06 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541165+0000", 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2099999999999998e-05 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541201+0000", 2024-09-14T08:39:37.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6423e-05 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567498+0000", 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026296760999999998 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567555+0000", 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7067000000000001e-05 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567626+0000", 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1328000000000006e-05 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1287 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3989504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541225+0000", 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8875047580000004, 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026607223999999999, 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.495 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1287 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541225+0000", 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541225+0000", 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541226+0000", 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.31e-06 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541249+0000", 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2243e-05 2024-09-14T08:39:37.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541273+0000", 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3983999999999999e-05 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541288+0000", 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567661+0000", 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026373799999999999 2024-09-14T08:39:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567743+0000", 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1094999999999995e-05 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567832+0000", 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9782000000000002e-05 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1289 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 3923968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541311+0000", 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8874193350000006, 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026734557999999999, 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1289 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.500 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541311+0000", 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541311+0000", 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541313+0000", 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0870000000000001e-06 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541319+0000", 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1970000000000001e-06 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541338+0000", 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9213000000000001e-05 2024-09-14T08:39:37.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541358+0000", 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9666000000000001e-05 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567869+0000", 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026511585000000001 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.567957+0000", 2024-09-14T08:39:37.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7355000000000006e-05 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568045+0000", 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8455000000000006e-05 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1292 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 4120576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.504 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541382+0000", 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8873477019999996, 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026880907999999998, 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1292 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541382+0000", 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541382+0000", 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541383+0000", 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.24e-06 2024-09-14T08:39:37.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541389+0000", 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541407+0000", 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8476999999999999e-05 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541424+0000", 2024-09-14T08:39:37.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6719999999999999e-05 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568080+0000", 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026656497000000001 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568174+0000", 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3276000000000006e-05 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568263+0000", 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9435e-05 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1296 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 4055040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541444+0000", 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8872854819999993, 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027044634000000001, 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1296 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541444+0000", 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541444+0000", 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541446+0000", 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3599999999999999e-06 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541469+0000", 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2806000000000002e-05 2024-09-14T08:39:37.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541488+0000", 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9830000000000002e-05 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541505+0000", 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6773e-05 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568300+0000", 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026794552999999999 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568397+0000", 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7108000000000006e-05 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568489+0000", 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2204e-05 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.513 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:1300 3.15 3:ad49b4d9:::rbd_data.10f13f8886eb.000000000000000b:4 [read 4186112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.541546+0000", 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8871835370000003, 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027163320000000001, 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:37.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1300 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541546+0000", 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541546+0000", 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:37.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541548+0000", 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-06 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541553+0000", 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8629999999999996e-06 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:37.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541576+0000", 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.251e-05 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.541611+0000", 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5312999999999999e-05 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568525+0000", 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026913313000000001 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568611+0000", 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6549000000000001e-05 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.568710+0000", 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8578000000000004e-05 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:37.518 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:37.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:39:37.520 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:37.524+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:37.522 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:37.522 INFO:teuthology.orchestra.run.smithi188.stdout:647 write 0xcd8a400 thru 0xcd99793 (0xf394 bytes) 2024-09-14T08:39:37.522 INFO:teuthology.orchestra.run.smithi188.stdout:648 read 0xc0fd600 thru 0xc107022 (0x9a23 bytes) 2024-09-14T08:39:37.523 INFO:teuthology.orchestra.run.smithi188.stdout:649 punch from 0x2b9000 to 0x2be800, (0x5800 bytes) 2024-09-14T08:39:37.523 INFO:teuthology.orchestra.run.smithi188.stdout:650 write 0x6010800 thru 0x601b93e (0xb13f bytes) 2024-09-14T08:39:37.523 INFO:teuthology.orchestra.run.smithi188.stdout:651 read 0xb1a4a00 thru 0xb1a5018 (0x619 bytes) 2024-09-14T08:39:37.523 INFO:teuthology.orchestra.run.smithi188.stdout:657 write 0x1801800 thru 0x1806537 (0x4d38 bytes) 2024-09-14T08:39:37.523 INFO:teuthology.orchestra.run.smithi188.stdout:658 read 0x6ad5a00 thru 0x6ad8585 (0x2b86 bytes) 2024-09-14T08:39:37.523 INFO:teuthology.orchestra.run.smithi188.stdout:659 punch from 0x605b800 to 0x6069600, (0xde00 bytes) 2024-09-14T08:39:37.523 INFO:teuthology.orchestra.run.smithi188.stdout:662 write 0xe8e5e00 thru 0xe8ef7fe (0x99ff bytes) 2024-09-14T08:39:37.523 INFO:teuthology.orchestra.run.smithi188.stdout:663 trunc from 0xe8ef800 to 0xd677e00 2024-09-14T08:39:37.523 INFO:teuthology.orchestra.run.smithi188.stdout:665 clone 6 order 18 su 1024 sc 11 2024-09-14T08:39:37.621 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:37.624+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:37.691 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:39:37.692 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:37.705 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:37.721 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:37.724+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:37.822 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:37.827+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:37.825 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:37.825 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:37.825 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:37.825 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:37.825 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:37.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:37.927 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:37.935+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:38.008 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:7 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:19.374717+0000", 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.639531201, 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015894680000000001, 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 7 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374717+0000", 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374717+0000", 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374720+0000", 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2660000000000002e-06 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374737+0000", 2024-09-14T08:39:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7093999999999999e-05 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374778+0000", 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0389000000000002e-05 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374806+0000", 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8393000000000001e-05 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374965+0000", 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015911199999999999 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.374977+0000", 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1494e-05 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.385317+0000", 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010340177000000001 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.385615+0000", 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029807199999999997 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.385967+0000", 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035150399999999999 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.387780+0000", 2024-09-14T08:39:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001813495 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.390367+0000", 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025865520000000002 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.390495+0000", 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128639 2024-09-14T08:39:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:19.390612+0000", 2024-09-14T08:39:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116493 2024-09-14T08:39:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-14T08:39:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:20.387937+0000", 2024-09-14T08:39:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.626311536999999, 2024-09-14T08:39:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061851320000000003, 2024-09-14T08:39:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:39:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:39:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 9 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387937+0000", 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387937+0000", 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387939+0000", 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6000000000000001e-06 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387952+0000", 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2923e-05 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.387976+0000", 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3723e-05 2024-09-14T08:39:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388000+0000", 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4280000000000001e-05 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388492+0000", 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049212300000000002 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388638+0000", 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014579299999999999 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.388900+0000", 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184199999999998 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.390025+0000", 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011250050000000001 2024-09-14T08:39:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.393955+0000", 2024-09-14T08:39:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039300480000000002 2024-09-14T08:39:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.394048+0000", 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2563000000000001e-05 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:20.394122+0000", 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4232000000000003e-05 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4441.0:3030 3.1b e28/21 3:de0a10ea:::rbd_data.10f1c460e0d1.0000000000000039:head v 28'12, mlcod=28'10)", 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.937944+0000", 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.0763046270000007, 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010339281000000001, 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937944+0000", 2024-09-14T08:39:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937944+0000", 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937946+0000", 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0990000000000001e-06 2024-09-14T08:39:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.939082+0000", 2024-09-14T08:39:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011361959999999999 2024-09-14T08:39:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.939103+0000", 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1236000000000001e-05 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.939117+0000", 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.36e-05 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.939264+0000", 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000147439 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.939299+0000", 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4413999999999999e-05 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.948236+0000", 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0089377239999999993 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.948283+0000", 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6573000000000003e-05 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4441.0:3029 3.e e28/21 3:70e9fa61:::rbd_data.10f1c460e0d1.0000000000000045:head v 28'11, mlcod=27'9)", 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.937988+0000", 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.076259877, 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.009489417, 2024-09-14T08:39:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937988+0000", 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937988+0000", 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.937991+0000", 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.938685+0000", 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069423900000000003 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.938722+0000", 2024-09-14T08:39:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6832000000000002e-05 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.938737+0000", 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5512e-05 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.938874+0000", 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013735700000000001 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.938916+0000", 2024-09-14T08:39:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1341999999999998e-05 2024-09-14T08:39:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.947387+0000", 2024-09-14T08:39:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084711939999999996 2024-09-14T08:39:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.947478+0000", 2024-09-14T08:39:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0809000000000004e-05 2024-09-14T08:39:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3031 3.9 3:914ae794:::rbd_data.10f1c460e0d1.000000000000003a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 245760~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.940861+0000", 2024-09-14T08:39:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.0733875019999992, 2024-09-14T08:39:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0089889559999999993, 2024-09-14T08:39:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3031 2024-09-14T08:39:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.940861+0000", 2024-09-14T08:39:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.940861+0000", 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.940863+0000", 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4710000000000001e-06 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941935+0000", 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010721509999999999 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941956+0000", 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1086000000000001e-05 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941967+0000", 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0915e-05 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942064+0000", 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6566999999999999e-05 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942690+0000", 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062580600000000002 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943192+0000", 2024-09-14T08:39:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00050203499999999996 2024-09-14T08:39:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.948133+0000", 2024-09-14T08:39:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049407030000000003 2024-09-14T08:39:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.949657+0000", 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015247189999999999 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.949757+0000", 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100148 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.949850+0000", 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2355000000000006e-05 2024-09-14T08:39:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3033 3.9 3:95c18a6e:::rbd_data.10f1c460e0d1.0000000000000000:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.941990+0000", 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.0722584529999999, 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060635919999999996, 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3033 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941990+0000", 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941990+0000", 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941991+0000", 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0279999999999999e-06 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.941994+0000", 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.478e-06 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942001+0000", 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942006+0000", 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7709999999999997e-06 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.947828+0000", 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058221439999999996 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.947909+0000", 2024-09-14T08:39:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0390999999999997e-05 2024-09-14T08:39:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.948053+0000", 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144876 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3034 3.1a 3:591ca50c:::rbd_data.10f1c460e0d1.000000000000003c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 245760~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:28.942309+0000", 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.0719393739999994, 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077847960000000001, 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3034 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942309+0000", 2024-09-14T08:39:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942309+0000", 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.942310+0000", 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.514e-06 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943066+0000", 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075553800000000004 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943092+0000", 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5582999999999999e-05 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943105+0000", 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3258000000000001e-05 2024-09-14T08:39:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943233+0000", 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012818700000000001 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.943456+0000", 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022338100000000001 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.944279+0000", 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082216899999999998 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.948166+0000", 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038872669999999998 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.949829+0000", 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016634569999999999 2024-09-14T08:39:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.949976+0000", 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014712500000000001 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:28.950094+0000", 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117317 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:4051 3.1a 3:5b543f1c:::rbd_data.10f1c460e0d1.0000000000000120:head [set-alloc-hint object_size 524288 write_size 524288,write 417792~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.199513+0000", 2024-09-14T08:39:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8147352839999993, 2024-09-14T08:39:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0056900620000000001, 2024-09-14T08:39:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4051 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199513+0000", 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199513+0000", 2024-09-14T08:39:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199515+0000", 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.719e-06 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199522+0000", 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3599999999999998e-06 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199541+0000", 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9279e-05 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199552+0000", 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0919e-05 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199625+0000", 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2410999999999995e-05 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199743+0000", 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118387 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.199873+0000", 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012997599999999999 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.201149+0000", 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00127622 2024-09-14T08:39:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.205106+0000", 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039564780000000003 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.205161+0000", 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4832e-05 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.205203+0000", 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2481000000000002e-05 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:4290 3.9 3:901b84fe:::rbd_data.10f1c460e0d1.000000000000005c:head [stat,write 311296~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.229961+0000", 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.7842874000000002, 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071079389999999998, 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4290 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229961+0000", 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229961+0000", 2024-09-14T08:39:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229962+0000", 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.432e-06 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229979+0000", 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6922000000000002e-05 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229990+0000", 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0603e-05 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.229998+0000", 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1019999999999997e-06 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.230964+0000", 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00096597700000000002 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.231041+0000", 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7336999999999995e-05 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.231165+0000", 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012340800000000001 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.232655+0000", 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014907430000000001 2024-09-14T08:39:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.237000+0000", 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043442000000000003 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.237040+0000", 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0469000000000002e-05 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.237069+0000", 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8745999999999999e-05 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:4317 3.3 3:c1e541e7:::rbd_data.10f1c460e0d1.00000000000001db:head [set-alloc-hint object_size 524288 write_size 524288,write 188416~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.233505+0000", 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.7807434400000002, 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059797629999999999, 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4317 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233505+0000", 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233505+0000", 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233506+0000", 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.291e-06 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233522+0000", 2024-09-14T08:39:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6347000000000001e-05 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233535+0000", 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2364999999999999e-05 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233544+0000", 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2469999999999997e-06 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233612+0000", 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8145999999999994e-05 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233767+0000", 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015470699999999999 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.233923+0000", 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015633699999999999 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.234746+0000", 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082310399999999996 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.239376+0000", 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00462993 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.239437+0000", 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0817999999999999e-05 2024-09-14T08:39:38.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.239485+0000", 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7471e-05 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4441.0:4464 3.1c e28/21 3:3bae972c:::rbd_data.10f1c460e0d1.0000000000000113:head v 28'25, mlcod=28'23)", 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.277965+0000", 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.7362829079999997, 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062191520000000004, 2024-09-14T08:39:38.073 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277965+0000", 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277965+0000", 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277966+0000", 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8100000000000003e-07 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277970+0000", 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6540000000000001e-06 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277976+0000", 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6109999999999999e-06 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.277981+0000", 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8729999999999998e-06 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.278042+0000", 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0918999999999997e-05 2024-09-14T08:39:38.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.278063+0000", 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.284118+0000", 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060546849999999998 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.284185+0000", 2024-09-14T08:39:38.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6715000000000001e-05 2024-09-14T08:39:38.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.078 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.078 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:4592 3.3 3:c1e541e7:::rbd_data.10f1c460e0d1.00000000000001db:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.078 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.297265+0000", 2024-09-14T08:39:38.079 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.7169836830000005, 2024-09-14T08:39:38.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059672140000000002, 2024-09-14T08:39:38.079 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.079 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.079 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4592 2024-09-14T08:39:38.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.080 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297265+0000", 2024-09-14T08:39:38.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297265+0000", 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297265+0000", 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.78e-07 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297270+0000", 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2239999999999997e-06 2024-09-14T08:39:38.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297281+0000", 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790000000000001e-05 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297287+0000", 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4609999999999999e-06 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297333+0000", 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6227000000000003e-05 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297400+0000", 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7185000000000001e-05 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.297468+0000", 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7638000000000005e-05 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.301074+0000", 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036057440000000001 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.303164+0000", 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020902009999999999 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.303194+0000", 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0227e-05 2024-09-14T08:39:38.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.303232+0000", 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7639000000000003e-05 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:5858 3.1a 3:5987c70c:::rbd_data.10f1c460e0d1.000000000000002a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 270336~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.495200+0000", 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5190481069999997, 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0095000129999999999, 2024-09-14T08:39:38.085 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 5858 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.495200+0000", 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.495200+0000", 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.495201+0000", 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9100000000000002e-07 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496087+0000", 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00088577999999999997 2024-09-14T08:39:38.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496102+0000", 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5502000000000002e-05 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496112+0000", 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0152e-05 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496219+0000", 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106319 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496426+0000", 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000207467 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.496877+0000", 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00045093500000000002 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.499402+0000", 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025248710000000001 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.504575+0000", 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051732200000000001 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.504631+0000", 2024-09-14T08:39:38.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5980999999999998e-05 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.504700+0000", 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8894999999999997e-05 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:6654 3.3 3:c5c43db1:::rbd_data.10f1c460e0d1.0000000000000047:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.823327+0000", 2024-09-14T08:39:38.091 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.1909215240000002, 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069456800000000001, 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 6654 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823327+0000", 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823327+0000", 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823329+0000", 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.77e-06 2024-09-14T08:39:38.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823341+0000", 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.296e-05 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823364+0000", 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2963e-05 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.823382+0000", 2024-09-14T08:39:38.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7180000000000002e-05 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.824367+0000", 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098520500000000007 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.825047+0000", 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067997299999999995 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-14T08:39:38.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.825179+0000", 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013178699999999999 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.827817+0000", 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026386650000000001 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.830202+0000", 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023848239999999998 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.830244+0000", 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2045999999999997e-05 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.830272+0000", 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8306999999999999e-05 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.097 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:6704 3.9 3:914ae794:::rbd_data.10f1c460e0d1.000000000000003a:head [stat,truncate 73728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.834256+0000", 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.1799927399999994, 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073976650000000003, 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 6704 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.098 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834256+0000", 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834256+0000", 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834258+0000", 2024-09-14T08:39:38.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0499999999999999e-06 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834268+0000", 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0217000000000001e-05 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834300+0000", 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2053e-05 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834321+0000", 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1140000000000001e-05 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834488+0000", 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016654199999999999 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.834698+0000", 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021053200000000001 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.835247+0000", 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054885000000000003 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.838732+0000", 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034850969999999999 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.841435+0000", 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027033220000000002 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.841553+0000", 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117439 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.841653+0000", 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100423 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.103 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:6793 3.9 3:95c18a6e:::rbd_data.10f1c460e0d1.0000000000000000:head [read 3584~512] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.868722+0000", 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.1455260890000005, 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059062899999999998, 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 6793 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868722+0000", 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868722+0000", 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868723+0000", 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0300000000000001e-06 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868728+0000", 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0329999999999999e-06 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868751+0000", 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3082999999999999e-05 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.868768+0000", 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6433e-05 2024-09-14T08:39:38.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.874077+0000", 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053093910000000001 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.874271+0000", 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000193492 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.874628+0000", 2024-09-14T08:39:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035782799999999998 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:6800 3.9 3:95c18a6e:::rbd_data.10f1c460e0d1.0000000000000000:head [stat,write 300032~3072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.871176+0000", 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.1430719529999998, 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0068706740000000002, 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 6800 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871176+0000", 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871176+0000", 2024-09-14T08:39:38.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871179+0000", 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3039999999999999e-06 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871191+0000", 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2303000000000001e-05 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871240+0000", 2024-09-14T08:39:38.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8912999999999997e-05 2024-09-14T08:39:38.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.871255+0000", 2024-09-14T08:39:38.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5376999999999999e-05 2024-09-14T08:39:38.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.874712+0000", 2024-09-14T08:39:38.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034570730000000002 2024-09-14T08:39:38.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.874925+0000", 2024-09-14T08:39:38.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021293500000000001 2024-09-14T08:39:38.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.875152+0000", 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022652499999999999 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.877411+0000", 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022589089999999999 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.877733+0000", 2024-09-14T08:39:38.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032236400000000001 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.877807+0000", 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4456000000000007e-05 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.878047+0000", 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023951500000000001 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4477.0:855 3.1a 3:5a1187ee:::rbd_object_map.10f136b23724:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:32.808459+0000", 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.2057895780000001, 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057786540000000003, 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4477", 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2349213865", 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 855 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.115 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808459+0000", 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808459+0000", 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808461+0000", 2024-09-14T08:39:38.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808472+0000", 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.099e-05 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808502+0000", 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0306000000000001e-05 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808517+0000", 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.488e-05 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808640+0000", 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123199 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.808790+0000", 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014959899999999999 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:38.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.809332+0000", 2024-09-14T08:39:38.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054187300000000001 2024-09-14T08:39:38.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.813965+0000", 2024-09-14T08:39:38.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046331760000000001 2024-09-14T08:39:38.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.814092+0000", 2024-09-14T08:39:38.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012720200000000001 2024-09-14T08:39:38.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.814164+0000", 2024-09-14T08:39:38.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2303000000000002e-05 2024-09-14T08:39:38.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:32.814237+0000", 2024-09-14T08:39:38.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2939000000000001e-05 2024-09-14T08:39:38.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.122 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.122 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4477.0:1701 3.1a 3:5a1187ee:::rbd_object_map.10f136b23724:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T08:39:38.122 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:33.588528+0000", 2024-09-14T08:39:38.122 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.4257203819999997, 2024-09-14T08:39:38.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055173339999999996, 2024-09-14T08:39:38.123 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4477", 2024-09-14T08:39:38.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2349213865", 2024-09-14T08:39:38.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1701 2024-09-14T08:39:38.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.124 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588528+0000", 2024-09-14T08:39:38.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588528+0000", 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588538+0000", 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0414000000000001e-05 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588551+0000", 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2523e-05 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588593+0000", 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2262999999999998e-05 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.588611+0000", 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8162999999999999e-05 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.590501+0000", 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018895610000000001 2024-09-14T08:39:38.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.590761+0000", 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025974800000000002 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.591883+0000", 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00112246 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.593746+0000", 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018634509999999999 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.593901+0000", 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015500900000000001 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.593981+0000", 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9505999999999994e-05 2024-09-14T08:39:38.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.594045+0000", 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4236e-05 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4477.0:1754 3.1a 3:5a1187ee:::rbd_object_map.10f136b23724:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:33.625747+0000", 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3885016800000001, 2024-09-14T08:39:38.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057650590000000003, 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4477", 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/2349213865", 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1754 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625747+0000", 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625747+0000", 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625748+0000", 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.697e-06 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625756+0000", 2024-09-14T08:39:38.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9070000000000007e-06 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625774+0000", 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7703e-05 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.625784+0000", 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8660000000000001e-06 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.627982+0000", 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002198569 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.628218+0000", 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023595800000000001 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.628983+0000", 2024-09-14T08:39:38.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076440799999999995 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.630353+0000", 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013707509999999999 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.631370+0000", 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010160569999999999 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.631456+0000", 2024-09-14T08:39:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6805999999999995e-05 2024-09-14T08:39:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:33.631512+0000", 2024-09-14T08:39:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5337000000000002e-05 2024-09-14T08:39:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.136 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.136 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:38.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:38.138 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:38.140+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:38.238 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:38.243+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:38.305 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:38.305 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:38.306 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:39:38.306 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:38.319 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:38.367 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:38.371+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:38.440 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:38.444+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:38.483 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:39:38.494 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:38.494 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:38.494 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:38.494 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:38.494 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:38.509 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:38.564 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:38.568+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:38.635 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3603 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1884160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062224+0000", 2024-09-14T08:39:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5792958450000008, 2024-09-14T08:39:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051352372, 2024-09-14T08:39:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3603 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062224+0000", 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062224+0000", 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062225+0000", 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062228+0000", 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9969999999999999e-06 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062237+0000", 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2029999999999998e-06 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062245+0000", 2024-09-14T08:39:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7130000000000005e-06 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113465+0000", 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051219754999999999 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113515+0000", 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9721e-05 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113577+0000", 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2253000000000002e-05 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3604 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1818624~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062255+0000", 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.579265092, 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051508193000000001, 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3604 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062255+0000", 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062255+0000", 2024-09-14T08:39:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062256+0000", 2024-09-14T08:39:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:39:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062259+0000", 2024-09-14T08:39:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.41e-06 2024-09-14T08:39:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062269+0000", 2024-09-14T08:39:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1759999999999999e-06 2024-09-14T08:39:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062276+0000", 2024-09-14T08:39:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1269999999999997e-06 2024-09-14T08:39:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113612+0000", 2024-09-14T08:39:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051336423999999999 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113681+0000", 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8446000000000002e-05 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113763+0000", 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2843000000000006e-05 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3608 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1949696~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062335+0000", 2024-09-14T08:39:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5791855160000008, 2024-09-14T08:39:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051575085999999999, 2024-09-14T08:39:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3608 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062335+0000", 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062335+0000", 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062336+0000", 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062339+0000", 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4539999999999999e-06 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062349+0000", 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.73e-06 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062356+0000", 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2459999999999997e-06 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113799+0000", 2024-09-14T08:39:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051442838999999997 2024-09-14T08:39:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113848+0000", 2024-09-14T08:39:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9446000000000001e-05 2024-09-14T08:39:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113910+0000", 2024-09-14T08:39:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1561000000000002e-05 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3612 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1753088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062399+0000", 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5791216689999992, 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051703491999999997, 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3612 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062399+0000", 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062399+0000", 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062400+0000", 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.096e-06 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062403+0000", 2024-09-14T08:39:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.224e-06 2024-09-14T08:39:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062412+0000", 2024-09-14T08:39:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1889999999999996e-06 2024-09-14T08:39:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062421+0000", 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1069999999999994e-06 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113947+0000", 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051525656000000003 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114014+0000", 2024-09-14T08:39:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7552999999999995e-05 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114102+0000", 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7666999999999999e-05 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.657 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3616 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 2015232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062587+0000", 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5789329510000005, 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0516637, 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3616 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.658 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062587+0000", 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062587+0000", 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062588+0000", 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1069999999999999e-06 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062594+0000", 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1930000000000001e-06 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062612+0000", 2024-09-14T08:39:38.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8150000000000001e-05 2024-09-14T08:39:38.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062632+0000", 2024-09-14T08:39:38.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0360000000000002e-05 2024-09-14T08:39:38.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114138+0000", 2024-09-14T08:39:38.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051505894000000003 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114188+0000", 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9821000000000003e-05 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114251+0000", 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3175000000000004e-05 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.662 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3619 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 2080768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062707+0000", 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5788129220000009, 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051754645000000002, 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3619 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062707+0000", 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062707+0000", 2024-09-14T08:39:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062709+0000", 2024-09-14T08:39:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.364e-06 2024-09-14T08:39:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062714+0000", 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062731+0000", 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7016000000000001e-05 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062744+0000", 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3404000000000001e-05 2024-09-14T08:39:38.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114289+0000", 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051544278999999998 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114373+0000", 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4550999999999997e-05 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114462+0000", 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8768000000000001e-05 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3622 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1236992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062834+0000", 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5786861020000007, 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051775600999999997, 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.668 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3622 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062834+0000", 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062834+0000", 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062836+0000", 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6700000000000001e-06 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062841+0000", 2024-09-14T08:39:38.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.293e-06 2024-09-14T08:39:38.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062859+0000", 2024-09-14T08:39:38.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7825999999999998e-05 2024-09-14T08:39:38.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062872+0000", 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3234000000000001e-05 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114497+0000", 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051625153 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114549+0000", 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1607999999999998e-05 2024-09-14T08:39:38.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114610+0000", 2024-09-14T08:39:38.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0816999999999997e-05 2024-09-14T08:39:38.673 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.673 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.673 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.673 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3623 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1171456~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062924+0000", 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.57859616, 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051872598999999998, 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3623 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062924+0000", 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062924+0000", 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062925+0000", 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2839999999999999e-06 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062931+0000", 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7529999999999998e-06 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062963+0000", 2024-09-14T08:39:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2209999999999998e-05 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062980+0000", 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6433e-05 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114647+0000", 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051666800999999998 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114711+0000", 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4808999999999996e-05 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114797+0000", 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5309000000000006e-05 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3630 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1302528~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063163+0000", 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5783568349999992, 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051790645000000003, 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3630 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063163+0000", 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063163+0000", 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063165+0000", 2024-09-14T08:39:38.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.08e-06 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063168+0000", 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063177+0000", 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9930000000000001e-06 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063184+0000", 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4270000000000002e-06 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114833+0000", 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051649122999999998 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114876+0000", 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2456999999999997e-05 2024-09-14T08:39:38.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114954+0000", 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8547999999999994e-05 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3631 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1105920~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063216+0000", 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5783040279999998, 2024-09-14T08:39:38.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.05192517, 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3631 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063216+0000", 2024-09-14T08:39:38.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063216+0000", 2024-09-14T08:39:38.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063217+0000", 2024-09-14T08:39:38.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:39:38.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063221+0000", 2024-09-14T08:39:38.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4300000000000002e-06 2024-09-14T08:39:38.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063233+0000", 2024-09-14T08:39:38.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2303000000000001e-05 2024-09-14T08:39:38.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063243+0000", 2024-09-14T08:39:38.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.045e-05 2024-09-14T08:39:38.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114989+0000", 2024-09-14T08:39:38.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051745811000000003 2024-09-14T08:39:38.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115054+0000", 2024-09-14T08:39:38.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4968000000000005e-05 2024-09-14T08:39:38.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115141+0000", 2024-09-14T08:39:38.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7145000000000007e-05 2024-09-14T08:39:38.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.689 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.690 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3636 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1368064~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.690 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063328+0000", 2024-09-14T08:39:38.690 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5781917859999997, 2024-09-14T08:39:38.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051964857000000003, 2024-09-14T08:39:38.690 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.690 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.690 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.690 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.690 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.690 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.691 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3636 2024-09-14T08:39:38.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.691 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063328+0000", 2024-09-14T08:39:38.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063328+0000", 2024-09-14T08:39:38.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063329+0000", 2024-09-14T08:39:38.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0299999999999998e-07 2024-09-14T08:39:38.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063332+0000", 2024-09-14T08:39:38.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:39:38.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063345+0000", 2024-09-14T08:39:38.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2680000000000001e-05 2024-09-14T08:39:38.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063353+0000", 2024-09-14T08:39:38.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5669999999999997e-06 2024-09-14T08:39:38.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115178+0000", 2024-09-14T08:39:38.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051825524999999997 2024-09-14T08:39:38.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115222+0000", 2024-09-14T08:39:38.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3699000000000003e-05 2024-09-14T08:39:38.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115293+0000", 2024-09-14T08:39:38.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1612999999999994e-05 2024-09-14T08:39:38.696 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.696 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.697 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3638 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1695744~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.697 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063401+0000", 2024-09-14T08:39:38.697 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5781194460000005, 2024-09-14T08:39:38.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052102952000000001, 2024-09-14T08:39:38.697 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.697 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.697 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3638 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063401+0000", 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063401+0000", 2024-09-14T08:39:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063402+0000", 2024-09-14T08:39:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.569999999999999e-07 2024-09-14T08:39:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063405+0000", 2024-09-14T08:39:38.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5329999999999999e-06 2024-09-14T08:39:38.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063422+0000", 2024-09-14T08:39:38.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7090000000000001e-05 2024-09-14T08:39:38.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063437+0000", 2024-09-14T08:39:38.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4156e-05 2024-09-14T08:39:38.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115329+0000", 2024-09-14T08:39:38.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051892848999999998 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115416+0000", 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6818999999999997e-05 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115504+0000", 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7547999999999996e-05 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.702 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3640 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1499136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063455+0000", 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5780652269999997, 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052200589999999998, 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3640 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063455+0000", 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063455+0000", 2024-09-14T08:39:38.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063457+0000", 2024-09-14T08:39:38.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5770000000000001e-06 2024-09-14T08:39:38.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063462+0000", 2024-09-14T08:39:38.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8030000000000002e-06 2024-09-14T08:39:38.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063479+0000", 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6883000000000001e-05 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063492+0000", 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2284e-05 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115543+0000", 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052050946000000001 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115585+0000", 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2324999999999999e-05 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115656+0000", 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0772000000000006e-05 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.708 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3641 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1433600~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063510+0000", 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5780106969999999, 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052334907, 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3641 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063510+0000", 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063510+0000", 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063511+0000", 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.133e-06 2024-09-14T08:39:38.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063516+0000", 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2569999999999998e-06 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063534+0000", 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7713000000000001e-05 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063547+0000", 2024-09-14T08:39:38.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.347e-05 2024-09-14T08:39:38.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115689+0000", 2024-09-14T08:39:38.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052142257999999997 2024-09-14T08:39:38.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115756+0000", 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6363000000000001e-05 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115844+0000", 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8713000000000003e-05 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3644 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1630208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063651+0000", 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.577869068, 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052335391000000002, 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3644 2024-09-14T08:39:38.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063651+0000", 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063651+0000", 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063653+0000", 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.35e-06 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063659+0000", 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0329999999999997e-06 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063676+0000", 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.715e-05 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063689+0000", 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3494e-05 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115877+0000", 2024-09-14T08:39:38.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052188147999999997 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115925+0000", 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7827999999999997e-05 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115987+0000", 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1388000000000002e-05 2024-09-14T08:39:38.718 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3645 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1564672~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063708+0000", 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5778124350000002, 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052468437999999999, 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.719 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3645 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063708+0000", 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063708+0000", 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063709+0000", 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1400000000000001e-06 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063715+0000", 2024-09-14T08:39:38.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.524e-06 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063732+0000", 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7533e-05 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063745+0000", 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3229e-05 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116022+0000", 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052277219 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116090+0000", 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7463000000000001e-05 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116176+0000", 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6329999999999995e-05 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.723 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3649 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1892352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063825+0000", 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5776948659999999, 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052506030000000002, 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3649 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063825+0000", 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063825+0000", 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063827+0000", 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1769999999999999e-06 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063832+0000", 2024-09-14T08:39:38.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4029999999999998e-06 2024-09-14T08:39:38.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063849+0000", 2024-09-14T08:39:38.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7156999999999999e-05 2024-09-14T08:39:38.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063862+0000", 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3293e-05 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116211+0000", 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052348487999999999 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116257+0000", 2024-09-14T08:39:38.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.587e-05 2024-09-14T08:39:38.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116331+0000", 2024-09-14T08:39:38.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4641999999999994e-05 2024-09-14T08:39:38.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.729 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.730 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3652 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1826816~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.730 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.064032+0000", 2024-09-14T08:39:38.730 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5774886739999996, 2024-09-14T08:39:38.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052516463999999999, 2024-09-14T08:39:38.730 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.731 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.731 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.731 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3652 2024-09-14T08:39:38.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.732 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064032+0000", 2024-09-14T08:39:38.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064032+0000", 2024-09-14T08:39:38.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064033+0000", 2024-09-14T08:39:38.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:39:38.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064036+0000", 2024-09-14T08:39:38.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.32e-06 2024-09-14T08:39:38.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064045+0000", 2024-09-14T08:39:38.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4129999999999995e-06 2024-09-14T08:39:38.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064053+0000", 2024-09-14T08:39:38.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.503e-06 2024-09-14T08:39:38.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116369+0000", 2024-09-14T08:39:38.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052316568000000001 2024-09-14T08:39:38.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116443+0000", 2024-09-14T08:39:38.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3737000000000002e-05 2024-09-14T08:39:38.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116548+0000", 2024-09-14T08:39:38.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104916 2024-09-14T08:39:38.738 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.738 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.738 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.739 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3659 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1957888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.739 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.065149+0000", 2024-09-14T08:39:38.739 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5763712509999994, 2024-09-14T08:39:38.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051555029000000002, 2024-09-14T08:39:38.739 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.739 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.739 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3659 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065149+0000", 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065149+0000", 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065151+0000", 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7e-06 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065157+0000", 2024-09-14T08:39:38.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3729999999999998e-06 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065177+0000", 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0166999999999999e-05 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065190+0000", 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3125999999999999e-05 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116586+0000", 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051395925000000002 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116630+0000", 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3494000000000001e-05 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116704+0000", 2024-09-14T08:39:38.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4244000000000003e-05 2024-09-14T08:39:38.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.744 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.745 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3679 3.5 3:a7aceeae:::rbd_object_map.10f1c460e0d1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:38.745 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.068741+0000", 2024-09-14T08:39:38.745 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.5727788280000006, 2024-09-14T08:39:38.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.053761617999999997, 2024-09-14T08:39:38.745 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:38.745 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:38.745 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:38.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3679 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.068741+0000", 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:38.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.068741+0000", 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.075866+0000", 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071247059999999997 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.075875+0000", 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2890000000000003e-06 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.075893+0000", 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7798000000000001e-05 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.075905+0000", 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2208999999999999e-05 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.117744+0000", 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.04183825 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.117902+0000", 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000158159 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.118461+0000", 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055911600000000002 2024-09-14T08:39:38.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.119771+0000", 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013097 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.122444+0000", 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026734010000000002 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:38.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.122477+0000", 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2496000000000002e-05 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.122503+0000", 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6494000000000001e-05 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:38.751 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:38.752 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:38.754 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:38.759+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:38.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:38.854 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:38.860+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:38.888 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:38.889 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:38.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:38.955 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:38.963+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:39.056 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:39.060+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:39.079 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:39.079 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:39.079 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:39.079 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:39.079 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:39.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:39.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:39:39.182 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:39.188+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:39.257 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:39.260+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:39.277 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2390 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.820688+0000", 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.46297672, 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019638604, 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2390 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820688+0000", 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820688+0000", 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820689+0000", 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8800000000000003e-07 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820691+0000", 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3549999999999999e-06 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820697+0000", 2024-09-14T08:39:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.139e-06 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820702+0000", 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8099999999999997e-06 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.835619+0000", 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014917298000000001 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.835704+0000", 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4636999999999996e-05 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.840327+0000", 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046228770000000001 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2955 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7512064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836658+0000", 2024-09-14T08:39:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.447006711, 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018285289999999999, 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2955 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836658+0000", 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836658+0000", 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836659+0000", 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836662+0000", 2024-09-14T08:39:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7319999999999998e-06 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836668+0000", 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8619999999999997e-06 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836674+0000", 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3890000000000004e-06 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854792+0000", 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018118499 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854869+0000", 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6482000000000004e-05 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854944+0000", 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4745000000000003e-05 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2960 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7643136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.44693837, 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018428944999999999, 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2960 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8699999999999995e-07 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836730+0000", 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0809999999999998e-06 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836739+0000", 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9660000000000002e-06 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836746+0000", 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4019999999999999e-06 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854986+0000", 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018240648000000002 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855068+0000", 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2202999999999999e-05 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855156+0000", 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7058000000000006e-05 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2961 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7577600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446909454, 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018591317, 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2961 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3300000000000002e-07 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836758+0000", 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2060000000000001e-06 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836765+0000", 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8159999999999996e-06 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836770+0000", 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1560000000000003e-06 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855196+0000", 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018425862000000001 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855273+0000", 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6497999999999998e-05 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855347+0000", 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4245999999999994e-05 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2964 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7774208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446884430000001, 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018777391000000001, 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2964 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836783+0000", 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2050000000000001e-06 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836790+0000", 2024-09-14T08:39:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5459999999999997e-06 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836795+0000", 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1050000000000003e-06 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855391+0000", 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018595749000000002 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855473+0000", 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2539000000000004e-05 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855558+0000", 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4698999999999997e-05 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2966 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7708672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.44685424, 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018940373, 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2966 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4199999999999996e-07 2024-09-14T08:39:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836814+0000", 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6769999999999999e-06 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836821+0000", 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5399999999999998e-06 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836827+0000", 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855597+0000", 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018769969000000001 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855672+0000", 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4946999999999999e-05 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855751+0000", 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9052000000000001e-05 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2970 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7839744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837047+0000", 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446617974, 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018916101000000001, 2024-09-14T08:39:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2970 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837047+0000", 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837047+0000", 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837048+0000", 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5199999999999995e-07 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837051+0000", 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5319999999999998e-06 2024-09-14T08:39:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837062+0000", 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0506000000000001e-05 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837069+0000", 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.905e-06 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855794+0000", 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018725308 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855878+0000", 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4141000000000006e-05 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855963+0000", 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4857000000000004e-05 2024-09-14T08:39:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2971 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7970816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837079+0000", 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446585674, 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019075076999999999, 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2971 2024-09-14T08:39:39.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837079+0000", 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837079+0000", 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837080+0000", 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7199999999999999e-07 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837082+0000", 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2129999999999998e-06 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837089+0000", 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837093+0000", 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.95e-06 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856003+0000", 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018909281999999999 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856080+0000", 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6796000000000001e-05 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856154+0000", 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4844000000000004e-05 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2976 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8101888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446564942, 2024-09-14T08:39:39.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019265681999999999, 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2976 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4499999999999997e-07 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837102+0000", 2024-09-14T08:39:39.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837108+0000", 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0190000000000003e-06 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837113+0000", 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8890000000000001e-06 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856198+0000", 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019084455 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856282+0000", 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4143999999999999e-05 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856366+0000", 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3825999999999993e-05 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2980 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7905280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837123+0000", 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446541969, 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019431517999999998, 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2980 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.319 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837123+0000", 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837123+0000", 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837124+0000", 2024-09-14T08:39:39.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7000000000000005e-07 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837126+0000", 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1110000000000002e-06 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837132+0000", 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4829999999999996e-06 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837146+0000", 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3647e-05 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856403+0000", 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019256711999999999 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856480+0000", 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7355999999999996e-05 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856555+0000", 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4639000000000001e-05 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2984 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8036352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837196+0000", 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446468609, 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019573896, 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2984 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837196+0000", 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837196+0000", 2024-09-14T08:39:39.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837197+0000", 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5099999999999999e-07 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837200+0000", 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3009999999999998e-06 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837209+0000", 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9099999999999994e-06 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837215+0000", 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.767e-06 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856598+0000", 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019382771 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856685+0000", 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7480999999999998e-05 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856770+0000", 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5014999999999998e-05 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2985 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8167424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837224+0000", 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446440823, 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019738647000000002, 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.328 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2985 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837224+0000", 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837224+0000", 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837225+0000", 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3599999999999999e-07 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837234+0000", 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837240+0000", 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5860000000000001e-06 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837245+0000", 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.87e-06 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856810+0000", 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019564873999999999 2024-09-14T08:39:39.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856888+0000", 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8262000000000004e-05 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856963+0000", 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4516000000000003e-05 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2988 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8298496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837494+0000", 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446170840000001, 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019679070999999999, 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.333 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2988 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837494+0000", 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837494+0000", 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837495+0000", 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7700000000000003e-07 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837499+0000", 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9419999999999997e-06 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837509+0000", 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7499999999999998e-06 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837516+0000", 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1840000000000002e-06 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857004+0000", 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019488594000000001 2024-09-14T08:39:39.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857088+0000", 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3504999999999994e-05 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857173+0000", 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5218999999999998e-05 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2989 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8232960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837527+0000", 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446137627000001, 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019838205000000001, 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2989 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837527+0000", 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837527+0000", 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837528+0000", 2024-09-14T08:39:39.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-07 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837530+0000", 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5849999999999998e-06 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837537+0000", 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837542+0000", 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3920000000000002e-06 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857212+0000", 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019669902999999999 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857289+0000", 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000005e-05 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857366+0000", 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6172000000000002e-05 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2992 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8364032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.446114440000001, 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0200152, 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.342 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2992 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837561+0000", 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.679e-06 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837568+0000", 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8369999999999999e-06 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837575+0000", 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9879999999999998e-06 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857394+0000", 2024-09-14T08:39:39.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019819735000000002 2024-09-14T08:39:39.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857480+0000", 2024-09-14T08:39:39.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5414999999999995e-05 2024-09-14T08:39:39.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857566+0000", 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6050000000000005e-05 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3656 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 1892352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050004+0000", 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.233660811, 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018387283000000001, 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.347 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.348 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3656 2024-09-14T08:39:39.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.348 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050004+0000", 2024-09-14T08:39:39.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050004+0000", 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050005+0000", 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050006+0000", 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.858e-06 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050013+0000", 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9e-06 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050018+0000", 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7520000000000004e-06 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068297+0000", 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018278846000000001 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068336+0000", 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9428000000000003e-05 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068391+0000", 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5072999999999999e-05 2024-09-14T08:39:39.351 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3658 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 1826816~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.233640006, 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018527910000000002, 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.352 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3658 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8800000000000003e-07 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050028+0000", 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1500000000000002e-06 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050034+0000", 2024-09-14T08:39:39.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1489999999999999e-06 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050039+0000", 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7840000000000003e-06 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068425+0000", 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018386131 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068481+0000", 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6779e-05 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068553+0000", 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1428999999999997e-05 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3663 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 1957888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050045+0000", 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.233619805, 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018631442000000002, 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3663 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050045+0000", 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050045+0000", 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050046+0000", 2024-09-14T08:39:39.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000002e-07 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050047+0000", 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.776e-06 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050053+0000", 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8880000000000002e-06 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050059+0000", 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2789999999999998e-06 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068582+0000", 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018523054000000001 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068623+0000", 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1216e-05 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068677+0000", 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3770000000000002e-05 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3666 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 2088960~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050065+0000", 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.233599585, 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018806007999999999, 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.361 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3666 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050065+0000", 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050065+0000", 2024-09-14T08:39:39.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050066+0000", 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7199999999999998e-07 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050068+0000", 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9549999999999999e-06 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050074+0000", 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.93e-06 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050079+0000", 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1590000000000001e-06 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068709+0000", 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018630192 2024-09-14T08:39:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068763+0000", 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4064000000000003e-05 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068871+0000", 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010803599999999999 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3669 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 2023424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.233579345000001, 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018925582, 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3669 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.366 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4999999999999998e-07 2024-09-14T08:39:39.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050088+0000", 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.874e-06 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050094+0000", 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8529999999999997e-06 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050099+0000", 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7079999999999996e-06 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068907+0000", 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018808945000000001 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068951+0000", 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3649999999999997e-05 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.069011+0000", 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0102000000000002e-05 2024-09-14T08:39:39.369 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.370 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:39.370 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:39.370 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:39.370 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T08:39:39.370 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:39:39.370 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-14T08:39:39.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-14T08:39:39.371 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-14T08:39:39.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:39.373 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:39.373 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:39.373 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:39.374 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:39.374 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:39.374 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:39.375 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:39.379+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:39.379 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:39.379 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:39.400 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:39.402 INFO:teuthology.orchestra.run.smithi188.stdout:666 trunc from 0xd677e00 to 0x778de00 2024-09-14T08:39:39.424 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:39.425 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:39.497 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:39.504+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:39.515 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:39.515 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:39.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:39.551 INFO:teuthology.orchestra.run.smithi188.stdout:668 write 0x9a70a00 thru 0x9a7c954 (0xbf55 bytes) 2024-09-14T08:39:39.552 INFO:teuthology.orchestra.run.smithi188.stdout:672 read 0x1464200 thru 0x1465e9e (0x1c9f bytes) 2024-09-14T08:39:39.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-14T08:39:39.561 INFO:teuthology.orchestra.run.smithi188.stdout:674 clone 7 order 21 su 1048576 sc 2 2024-09-14T08:39:39.573 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:39.579+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:39.673 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:39.680+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:39.720 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:39.720 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:39.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:39.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-14T08:39:39.775 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:39.779+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:39.875 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:39.880+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:39.912 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:39.913 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:39.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:39.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-14T08:39:39.976 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:39.983+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:40.077 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:40.080+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:40.115 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:40.115 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:40.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:40.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-14T08:39:40.202 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:40.208+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:40.278 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:40.283+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:40.310 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:40.311 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:40.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:40.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-14T08:39:40.379 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:40.387+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:40.430 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:40.430 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:40.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:40.486 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:40.492+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:40.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:39:40.580 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:40.580 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:40.580 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:40.587+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:40.594 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:40.601 INFO:teuthology.orchestra.run.smithi188.stdout:leaving image image_client.0-clone6 intact 2024-09-14T08:39:40.683 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:40.691+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:40.765 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:40.765 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:40.781 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:40.782 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:40.788+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:40.883 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:40.891+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:40.942 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:40.942 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:40.956 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:40.999 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:41.007+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:41.085 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:41.088+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:41.133 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:41.133 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:41.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:41.178 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-14T08:39:41.195 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:41.203+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:41.275 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:41.275 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:41.287 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:41.295+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:41.288 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:41.388 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:41.392+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:41.454 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:39:41.455 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:41.455 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:41.470 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:41.491 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:39:41.519 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:41.527+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:41.590 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:41.596+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:41.599 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:41.600 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:41.614 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:41.614 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:41.615 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:41.631 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:41.631 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:41.649 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:41.649 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:41.667 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:41.689 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:41.689 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:41.706 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:41.707 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:41.707 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:41.715+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:41.791 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:41.796+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:41.791 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:41.791 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:41.791 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:41.791 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:41.791 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:41.806 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:41.895 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:41.903+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:41.982 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:41.982 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:41.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:41.982 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:41.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.982 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3603 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1884160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:41.982 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062224+0000", 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.925356602000001, 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051352372, 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3603 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062224+0000", 2024-09-14T08:39:41.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062224+0000", 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062225+0000", 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062228+0000", 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9969999999999999e-06 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062237+0000", 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2029999999999998e-06 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062245+0000", 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7130000000000005e-06 2024-09-14T08:39:41.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113465+0000", 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051219754999999999 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113515+0000", 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9721e-05 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:41.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113577+0000", 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2253000000000002e-05 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3604 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1818624~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062255+0000", 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.925325849, 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051508193000000001, 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:41.987 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3604 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062255+0000", 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062255+0000", 2024-09-14T08:39:41.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062256+0000", 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062259+0000", 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.41e-06 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062269+0000", 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1759999999999999e-06 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062276+0000", 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1269999999999997e-06 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113612+0000", 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051336423999999999 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113681+0000", 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8446000000000002e-05 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113763+0000", 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2843000000000006e-05 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.991 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3608 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1949696~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062335+0000", 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.925246272999999, 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051575085999999999, 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3608 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:41.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062335+0000", 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062335+0000", 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062336+0000", 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:39:41.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062339+0000", 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4539999999999999e-06 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062349+0000", 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.73e-06 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062356+0000", 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2459999999999997e-06 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113799+0000", 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051442838999999997 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113848+0000", 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9446000000000001e-05 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113910+0000", 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1561000000000002e-05 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3612 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1753088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062399+0000", 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.925182425999999, 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051703491999999997, 2024-09-14T08:39:41.996 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3612 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062399+0000", 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062399+0000", 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062400+0000", 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.096e-06 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062403+0000", 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.224e-06 2024-09-14T08:39:41.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062412+0000", 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1889999999999996e-06 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062421+0000", 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1069999999999994e-06 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.113947+0000", 2024-09-14T08:39:41.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051525656000000003 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114014+0000", 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7552999999999995e-05 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114102+0000", 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7666999999999999e-05 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.000 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3616 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 2015232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062587+0000", 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.924993708000001, 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0516637, 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3616 2024-09-14T08:39:42.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062587+0000", 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062587+0000", 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062588+0000", 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1069999999999999e-06 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062594+0000", 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1930000000000001e-06 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062612+0000", 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8150000000000001e-05 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062632+0000", 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0360000000000002e-05 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114138+0000", 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051505894000000003 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114188+0000", 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9821000000000003e-05 2024-09-14T08:39:42.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114251+0000", 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3175000000000004e-05 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3619 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 2080768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062707+0000", 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.924873678999999, 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051754645000000002, 2024-09-14T08:39:42.005 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3619 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062707+0000", 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062707+0000", 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062709+0000", 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.364e-06 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062714+0000", 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062731+0000", 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7016000000000001e-05 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062744+0000", 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3404000000000001e-05 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114289+0000", 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051544278999999998 2024-09-14T08:39:42.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114373+0000", 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4550999999999997e-05 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114462+0000", 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8768000000000001e-05 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3622 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1236992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062834+0000", 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.924746859000001, 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051775600999999997, 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3622 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062834+0000", 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062834+0000", 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062836+0000", 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6700000000000001e-06 2024-09-14T08:39:42.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062841+0000", 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.293e-06 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062859+0000", 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7825999999999998e-05 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062872+0000", 2024-09-14T08:39:42.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3234000000000001e-05 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114497+0000", 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051625153 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114549+0000", 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1607999999999998e-05 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114610+0000", 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0816999999999997e-05 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3623 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1171456~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.062924+0000", 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.924656917, 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051872598999999998, 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3623 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062924+0000", 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062924+0000", 2024-09-14T08:39:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062925+0000", 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2839999999999999e-06 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062931+0000", 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7529999999999998e-06 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062963+0000", 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2209999999999998e-05 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.062980+0000", 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6433e-05 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114647+0000", 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051666800999999998 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114711+0000", 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4808999999999996e-05 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114797+0000", 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5309000000000006e-05 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.018 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3630 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1302528~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063163+0000", 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.924417591999999, 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051790645000000003, 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3630 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063163+0000", 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063163+0000", 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063165+0000", 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.08e-06 2024-09-14T08:39:42.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063168+0000", 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063177+0000", 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9930000000000001e-06 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063184+0000", 2024-09-14T08:39:42.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4270000000000002e-06 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114833+0000", 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051649122999999998 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114876+0000", 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2456999999999997e-05 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114954+0000", 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8547999999999994e-05 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3631 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1105920~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063216+0000", 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.924364785, 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.05192517, 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.023 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3631 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063216+0000", 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063216+0000", 2024-09-14T08:39:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063217+0000", 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063221+0000", 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4300000000000002e-06 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063233+0000", 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2303000000000001e-05 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063243+0000", 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.045e-05 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.114989+0000", 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051745811000000003 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115054+0000", 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4968000000000005e-05 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115141+0000", 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7145000000000007e-05 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.027 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3636 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1368064~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063328+0000", 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.924252543, 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051964857000000003, 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3636 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063328+0000", 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063328+0000", 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063329+0000", 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0299999999999998e-07 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063332+0000", 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063345+0000", 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2680000000000001e-05 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063353+0000", 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5669999999999997e-06 2024-09-14T08:39:42.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115178+0000", 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051825524999999997 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115222+0000", 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3699000000000003e-05 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115293+0000", 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1612999999999994e-05 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3638 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1695744~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063401+0000", 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.924180203000001, 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052102952000000001, 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.032 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3638 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063401+0000", 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063401+0000", 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063402+0000", 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.569999999999999e-07 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063405+0000", 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5329999999999999e-06 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063422+0000", 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7090000000000001e-05 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063437+0000", 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4156e-05 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115329+0000", 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051892848999999998 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115416+0000", 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6818999999999997e-05 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115504+0000", 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7547999999999996e-05 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.036 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3640 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1499136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063455+0000", 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.924125984, 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052200589999999998, 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3640 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063455+0000", 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063455+0000", 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063457+0000", 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5770000000000001e-06 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063462+0000", 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8030000000000002e-06 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063479+0000", 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6883000000000001e-05 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063492+0000", 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2284e-05 2024-09-14T08:39:42.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115543+0000", 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052050946000000001 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115585+0000", 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2324999999999999e-05 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115656+0000", 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0772000000000006e-05 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3641 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1433600~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063510+0000", 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.924071454, 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052334907, 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.041 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3641 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063510+0000", 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063510+0000", 2024-09-14T08:39:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063511+0000", 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.133e-06 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063516+0000", 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2569999999999998e-06 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063534+0000", 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7713000000000001e-05 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063547+0000", 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.347e-05 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115689+0000", 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052142257999999997 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115756+0000", 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6363000000000001e-05 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115844+0000", 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8713000000000003e-05 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3644 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1630208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063651+0000", 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.923929825, 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052335391000000002, 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3644 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063651+0000", 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063651+0000", 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063653+0000", 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.35e-06 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063659+0000", 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0329999999999997e-06 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063676+0000", 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.715e-05 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063689+0000", 2024-09-14T08:39:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3494e-05 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115877+0000", 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052188147999999997 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115925+0000", 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7827999999999997e-05 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.115987+0000", 2024-09-14T08:39:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1388000000000002e-05 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3645 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1564672~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063708+0000", 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.923873192, 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052468437999999999, 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3645 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063708+0000", 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063708+0000", 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063709+0000", 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1400000000000001e-06 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063715+0000", 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.524e-06 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063732+0000", 2024-09-14T08:39:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7533e-05 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063745+0000", 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3229e-05 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116022+0000", 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052277219 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116090+0000", 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7463000000000001e-05 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116176+0000", 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6329999999999995e-05 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3649 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1892352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.063825+0000", 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.923755623, 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052506030000000002, 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3649 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063825+0000", 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063825+0000", 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063827+0000", 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1769999999999999e-06 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063832+0000", 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4029999999999998e-06 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063849+0000", 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7156999999999999e-05 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.063862+0000", 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3293e-05 2024-09-14T08:39:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116211+0000", 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052348487999999999 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116257+0000", 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.587e-05 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116331+0000", 2024-09-14T08:39:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4641999999999994e-05 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3652 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1826816~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.064032+0000", 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.923549431, 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052516463999999999, 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3652 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064032+0000", 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064032+0000", 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064033+0000", 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064036+0000", 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.32e-06 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064045+0000", 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4129999999999995e-06 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.064053+0000", 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.503e-06 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116369+0000", 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.052316568000000001 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116443+0000", 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3737000000000002e-05 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116548+0000", 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104916 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3659 3.1d 3:bd377295:::rbd_data.10f13f8886eb.0000000000000000:4 [read 1957888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.065149+0000", 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.922432007999999, 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051555029000000002, 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3659 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065149+0000", 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065149+0000", 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065151+0000", 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7e-06 2024-09-14T08:39:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065157+0000", 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3729999999999998e-06 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065177+0000", 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0166999999999999e-05 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.065190+0000", 2024-09-14T08:39:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3125999999999999e-05 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116586+0000", 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.051395925000000002 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116630+0000", 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3494000000000001e-05 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.116704+0000", 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4244000000000003e-05 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4441.0:3679 3.5 3:a7aceeae:::rbd_object_map.10f1c460e0d1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:29.068741+0000", 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.918839585000001, 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.053761617999999997, 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4441", 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 3679 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.068741+0000", 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.068741+0000", 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.075866+0000", 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071247059999999997 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.075875+0000", 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2890000000000003e-06 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.075893+0000", 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7798000000000001e-05 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.075905+0000", 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2208999999999999e-05 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.117744+0000", 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.04183825 2024-09-14T08:39:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.117902+0000", 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000158159 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.118461+0000", 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055911600000000002 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.119771+0000", 2024-09-14T08:39:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013097 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.122444+0000", 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026734010000000002 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.122477+0000", 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2496000000000002e-05 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:29.122503+0000", 2024-09-14T08:39:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6494000000000001e-05 2024-09-14T08:39:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:42.074 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:42.075 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:42.076 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:42.080+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:42.176 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:42.183+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:42.213 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:42.213 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:42.213 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:42.213 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:42.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:42.277 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:42.284+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:42.352 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:42.353 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:42.366 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:42.410 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:42.416+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:42.479 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:42.484+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:42.539 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:42.539 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:42.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:42.540 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:42.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.540 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2390 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.540 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.820688+0000", 2024-09-14T08:39:42.541 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.723847632, 2024-09-14T08:39:42.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019638604, 2024-09-14T08:39:42.541 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.541 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.541 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.541 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.542 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2390 2024-09-14T08:39:42.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.542 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820688+0000", 2024-09-14T08:39:42.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820688+0000", 2024-09-14T08:39:42.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820689+0000", 2024-09-14T08:39:42.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8800000000000003e-07 2024-09-14T08:39:42.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820691+0000", 2024-09-14T08:39:42.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3549999999999999e-06 2024-09-14T08:39:42.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820697+0000", 2024-09-14T08:39:42.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.139e-06 2024-09-14T08:39:42.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.820702+0000", 2024-09-14T08:39:42.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8099999999999997e-06 2024-09-14T08:39:42.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.835619+0000", 2024-09-14T08:39:42.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014917298000000001 2024-09-14T08:39:42.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.835704+0000", 2024-09-14T08:39:42.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4636999999999996e-05 2024-09-14T08:39:42.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.840327+0000", 2024-09-14T08:39:42.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046228770000000001 2024-09-14T08:39:42.551 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.551 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.551 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.552 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2955 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7512064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.552 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836658+0000", 2024-09-14T08:39:42.552 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707877623, 2024-09-14T08:39:42.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018285289999999999, 2024-09-14T08:39:42.552 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.553 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.553 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.554 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2955 2024-09-14T08:39:42.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.554 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836658+0000", 2024-09-14T08:39:42.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836658+0000", 2024-09-14T08:39:42.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836659+0000", 2024-09-14T08:39:42.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-14T08:39:42.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836662+0000", 2024-09-14T08:39:42.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7319999999999998e-06 2024-09-14T08:39:42.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836668+0000", 2024-09-14T08:39:42.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8619999999999997e-06 2024-09-14T08:39:42.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836674+0000", 2024-09-14T08:39:42.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3890000000000004e-06 2024-09-14T08:39:42.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854792+0000", 2024-09-14T08:39:42.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018118499 2024-09-14T08:39:42.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854869+0000", 2024-09-14T08:39:42.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6482000000000004e-05 2024-09-14T08:39:42.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854944+0000", 2024-09-14T08:39:42.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4745000000000003e-05 2024-09-14T08:39:42.564 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.564 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.564 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.565 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2960 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7643136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.565 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:42.565 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707809281999999, 2024-09-14T08:39:42.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018428944999999999, 2024-09-14T08:39:42.565 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.566 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.566 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.566 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2960 2024-09-14T08:39:42.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.567 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:42.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:42.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836727+0000", 2024-09-14T08:39:42.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8699999999999995e-07 2024-09-14T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836730+0000", 2024-09-14T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0809999999999998e-06 2024-09-14T08:39:42.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836739+0000", 2024-09-14T08:39:42.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9660000000000002e-06 2024-09-14T08:39:42.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836746+0000", 2024-09-14T08:39:42.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4019999999999999e-06 2024-09-14T08:39:42.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.854986+0000", 2024-09-14T08:39:42.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018240648000000002 2024-09-14T08:39:42.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855068+0000", 2024-09-14T08:39:42.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2202999999999999e-05 2024-09-14T08:39:42.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855156+0000", 2024-09-14T08:39:42.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7058000000000006e-05 2024-09-14T08:39:42.575 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.575 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.576 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.576 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2961 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7577600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.576 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:42.576 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707780366, 2024-09-14T08:39:42.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018591317, 2024-09-14T08:39:42.577 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.577 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.577 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.578 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2961 2024-09-14T08:39:42.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.578 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:42.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:42.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836756+0000", 2024-09-14T08:39:42.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3300000000000002e-07 2024-09-14T08:39:42.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836758+0000", 2024-09-14T08:39:42.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2060000000000001e-06 2024-09-14T08:39:42.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836765+0000", 2024-09-14T08:39:42.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8159999999999996e-06 2024-09-14T08:39:42.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836770+0000", 2024-09-14T08:39:42.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1560000000000003e-06 2024-09-14T08:39:42.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855196+0000", 2024-09-14T08:39:42.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018425862000000001 2024-09-14T08:39:42.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855273+0000", 2024-09-14T08:39:42.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6497999999999998e-05 2024-09-14T08:39:42.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855347+0000", 2024-09-14T08:39:42.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4245999999999994e-05 2024-09-14T08:39:42.587 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.587 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.587 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.588 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2964 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7774208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.588 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:42.588 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707755342, 2024-09-14T08:39:42.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018777391000000001, 2024-09-14T08:39:42.588 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.589 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.589 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.590 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2964 2024-09-14T08:39:42.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.590 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:42.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:42.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836781+0000", 2024-09-14T08:39:42.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:39:42.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836783+0000", 2024-09-14T08:39:42.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2050000000000001e-06 2024-09-14T08:39:42.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836790+0000", 2024-09-14T08:39:42.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5459999999999997e-06 2024-09-14T08:39:42.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836795+0000", 2024-09-14T08:39:42.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1050000000000003e-06 2024-09-14T08:39:42.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855391+0000", 2024-09-14T08:39:42.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018595749000000002 2024-09-14T08:39:42.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855473+0000", 2024-09-14T08:39:42.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2539000000000004e-05 2024-09-14T08:39:42.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855558+0000", 2024-09-14T08:39:42.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4698999999999997e-05 2024-09-14T08:39:42.598 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.599 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.599 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2966 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7708672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.599 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:42.600 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707725152, 2024-09-14T08:39:42.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018940373, 2024-09-14T08:39:42.600 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.600 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.600 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.601 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2966 2024-09-14T08:39:42.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.601 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:42.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:42.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836811+0000", 2024-09-14T08:39:42.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4199999999999996e-07 2024-09-14T08:39:42.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836814+0000", 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6769999999999999e-06 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836821+0000", 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5399999999999998e-06 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.836827+0000", 2024-09-14T08:39:42.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855597+0000", 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018769969000000001 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855672+0000", 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4946999999999999e-05 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855751+0000", 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9052000000000001e-05 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2970 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7839744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837047+0000", 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707488886, 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018916101000000001, 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.606 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2970 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837047+0000", 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837047+0000", 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837048+0000", 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5199999999999995e-07 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837051+0000", 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5319999999999998e-06 2024-09-14T08:39:42.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837062+0000", 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0506000000000001e-05 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837069+0000", 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.905e-06 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855794+0000", 2024-09-14T08:39:42.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018725308 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855878+0000", 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4141000000000006e-05 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.855963+0000", 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4857000000000004e-05 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2971 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7970816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837079+0000", 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707456585999999, 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019075076999999999, 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2971 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.611 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837079+0000", 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837079+0000", 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837080+0000", 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7199999999999999e-07 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837082+0000", 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2129999999999998e-06 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837089+0000", 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837093+0000", 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.95e-06 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856003+0000", 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018909281999999999 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856080+0000", 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6796000000000001e-05 2024-09-14T08:39:42.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856154+0000", 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4844000000000004e-05 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2976 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8101888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707435854, 2024-09-14T08:39:42.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019265681999999999, 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2976 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:42.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837100+0000", 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4499999999999997e-07 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837102+0000", 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837108+0000", 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0190000000000003e-06 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837113+0000", 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8890000000000001e-06 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856198+0000", 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019084455 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856282+0000", 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4143999999999999e-05 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856366+0000", 2024-09-14T08:39:42.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3825999999999993e-05 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2980 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 7905280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837123+0000", 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707412881, 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019431517999999998, 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2980 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837123+0000", 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837123+0000", 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837124+0000", 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7000000000000005e-07 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837126+0000", 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1110000000000002e-06 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837132+0000", 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4829999999999996e-06 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837146+0000", 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3647e-05 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856403+0000", 2024-09-14T08:39:42.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019256711999999999 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856480+0000", 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7355999999999996e-05 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856555+0000", 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4639000000000001e-05 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2984 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8036352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837196+0000", 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707339521, 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019573896, 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2984 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837196+0000", 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837196+0000", 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837197+0000", 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5099999999999999e-07 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837200+0000", 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3009999999999998e-06 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837209+0000", 2024-09-14T08:39:42.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9099999999999994e-06 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837215+0000", 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.767e-06 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856598+0000", 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019382771 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856685+0000", 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7480999999999998e-05 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856770+0000", 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5014999999999998e-05 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2985 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8167424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.629 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837224+0000", 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707311734999999, 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019738647000000002, 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2985 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837224+0000", 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837224+0000", 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837225+0000", 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3599999999999999e-07 2024-09-14T08:39:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837234+0000", 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837240+0000", 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5860000000000001e-06 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837245+0000", 2024-09-14T08:39:42.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.87e-06 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856810+0000", 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019564873999999999 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856888+0000", 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8262000000000004e-05 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.856963+0000", 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4516000000000003e-05 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2988 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8298496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837494+0000", 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707041752, 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019679070999999999, 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2988 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837494+0000", 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837494+0000", 2024-09-14T08:39:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837495+0000", 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7700000000000003e-07 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837499+0000", 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9419999999999997e-06 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837509+0000", 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7499999999999998e-06 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837516+0000", 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1840000000000002e-06 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857004+0000", 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019488594000000001 2024-09-14T08:39:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857088+0000", 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3504999999999994e-05 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857173+0000", 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5218999999999998e-05 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2989 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8232960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837527+0000", 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.707008539, 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019838205000000001, 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2989 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837527+0000", 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837527+0000", 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837528+0000", 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-07 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837530+0000", 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5849999999999998e-06 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837537+0000", 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837542+0000", 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3920000000000002e-06 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857212+0000", 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019669902999999999 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857289+0000", 2024-09-14T08:39:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000005e-05 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857366+0000", 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6172000000000002e-05 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:2992 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 8364032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.706985352, 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0200152, 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2992 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837551+0000", 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837561+0000", 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.679e-06 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837568+0000", 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8369999999999999e-06 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.837575+0000", 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9879999999999998e-06 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857394+0000", 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019819735000000002 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857480+0000", 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5414999999999995e-05 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:28.857566+0000", 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6050000000000005e-05 2024-09-14T08:39:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3656 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 1892352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050004+0000", 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.494531723, 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018387283000000001, 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3656 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050004+0000", 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050004+0000", 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050005+0000", 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050006+0000", 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.858e-06 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050013+0000", 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9e-06 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050018+0000", 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7520000000000004e-06 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068297+0000", 2024-09-14T08:39:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018278846000000001 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068336+0000", 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9428000000000003e-05 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068391+0000", 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5072999999999999e-05 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3658 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 1826816~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.494510918, 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018527910000000002, 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3658 2024-09-14T08:39:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050025+0000", 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8800000000000003e-07 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050028+0000", 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1500000000000002e-06 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050034+0000", 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1489999999999999e-06 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050039+0000", 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7840000000000003e-06 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068425+0000", 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018386131 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068481+0000", 2024-09-14T08:39:42.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6779e-05 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068553+0000", 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1428999999999997e-05 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3663 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 1957888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050045+0000", 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.494490717, 2024-09-14T08:39:42.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018631442000000002, 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3663 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050045+0000", 2024-09-14T08:39:42.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050045+0000", 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050046+0000", 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000002e-07 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050047+0000", 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.776e-06 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050053+0000", 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8880000000000002e-06 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050059+0000", 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2789999999999998e-06 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068582+0000", 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018523054000000001 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068623+0000", 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1216e-05 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068677+0000", 2024-09-14T08:39:42.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3770000000000002e-05 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3666 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 2088960~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050065+0000", 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.494470497, 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018806007999999999, 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3666 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050065+0000", 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050065+0000", 2024-09-14T08:39:42.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050066+0000", 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7199999999999998e-07 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050068+0000", 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9549999999999999e-06 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050074+0000", 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.93e-06 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050079+0000", 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1590000000000001e-06 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068709+0000", 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018630192 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068763+0000", 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4064000000000003e-05 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068871+0000", 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010803599999999999 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4441.0:3669 3.17 3:ed3501c1:::rbd_data.10f13f8886eb.0000000000000003:4 [read 2023424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.494450257, 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018925582, 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4441", 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/4192496260", 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3669 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050086+0000", 2024-09-14T08:39:42.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4999999999999998e-07 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050088+0000", 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.874e-06 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050094+0000", 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8529999999999997e-06 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.050099+0000", 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7079999999999996e-06 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068907+0000", 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018808945000000001 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.068951+0000", 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3649999999999997e-05 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:42.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:29.069011+0000", 2024-09-14T08:39:42.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0102000000000002e-05 2024-09-14T08:39:42.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.671 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.671 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.671 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:42.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:42.673 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:42.680+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:42.774 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:42.778+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:42.776 INFO:teuthology.orchestra.run.smithi188.stdout:681 write 0xcf9e000 thru 0xcfa3070 (0x5071 bytes) 2024-09-14T08:39:42.782 INFO:teuthology.orchestra.run.smithi188.stdout:685 trunc from 0xcfa3200 to 0xadffa00 2024-09-14T08:39:42.818 INFO:teuthology.orchestra.run.smithi188.stdout:687 write 0x3ac200 thru 0x3accf6 (0xaf7 bytes) 2024-09-14T08:39:42.820 INFO:teuthology.orchestra.run.smithi188.stdout:688 write 0x8953c00 thru 0x895ec9e (0xb09f bytes) 2024-09-14T08:39:42.820 INFO:teuthology.orchestra.run.smithi188.stdout:690 punch from 0x82c6200 to 0x82cf000, (0x8e00 bytes) 2024-09-14T08:39:42.875 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:42.878+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:42.889 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:42.889 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:42.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.889 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1839 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.889 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.848847+0000", 2024-09-14T08:39:42.889 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.035423433999999997, 2024-09-14T08:39:42.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035440322000000003, 2024-09-14T08:39:42.889 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.889 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1839 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848847+0000", 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848847+0000", 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848849+0000", 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3969999999999999e-06 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848878+0000", 2024-09-14T08:39:42.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9473000000000001e-05 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848898+0000", 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.95e-05 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848923+0000", 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5193000000000001e-05 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.892 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2011 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853694+0000", 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030577283, 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030640014, 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.893 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2011 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853694+0000", 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853694+0000", 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853694+0000", 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5599999999999995e-07 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853697+0000", 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.01e-06 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853705+0000", 2024-09-14T08:39:42.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2859999999999999e-06 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853712+0000", 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3770000000000001e-06 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.896 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2172 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864241+0000", 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020029990000000001, 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020157899999999999, 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2172 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864241+0000", 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864241+0000", 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864242+0000", 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3200000000000003e-07 2024-09-14T08:39:42.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864247+0000", 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8019999999999999e-06 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864257+0000", 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0356e-05 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864264+0000", 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3309999999999998e-06 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2268 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.866633+0000", 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017638190000000002, 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017818054, 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.900 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2268 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866633+0000", 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866633+0000", 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866633+0000", 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866635+0000", 2024-09-14T08:39:42.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9580000000000001e-06 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866640+0000", 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2839999999999997e-06 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866652+0000", 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2196e-05 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2392 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882703+0000", 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001567466, 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0017968039999999999, 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.904 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2392 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882703+0000", 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882703+0000", 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882704+0000", 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882711+0000", 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.968e-06 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882718+0000", 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7959999999999996e-06 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882723+0000", 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7840000000000003e-06 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1841 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.848945+0000", 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.035325724000000003, 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035607439999999997, 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.907 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1841 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848945+0000", 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848945+0000", 2024-09-14T08:39:42.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848947+0000", 2024-09-14T08:39:42.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:39:42.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848952+0000", 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.383e-06 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848971+0000", 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9230000000000001e-05 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.848985+0000", 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3322999999999999e-05 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2013 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853721+0000", 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030549724, 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030880956000000001, 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.911 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2013 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853721+0000", 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853721+0000", 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853722+0000", 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7100000000000002e-07 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853748+0000", 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6135e-05 2024-09-14T08:39:42.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853757+0000", 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1090000000000004e-06 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853769+0000", 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2534000000000001e-05 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2174 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864278+0000", 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019992929, 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020373677999999999, 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2174 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.915 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864278+0000", 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864278+0000", 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864278+0000", 2024-09-14T08:39:42.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1699999999999998e-07 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864281+0000", 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.525e-06 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864288+0000", 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0609999999999998e-06 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864293+0000", 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.237e-06 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2270 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.866662+0000", 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017608803999999999, 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018038775999999999, 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.918 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2270 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866662+0000", 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866662+0000", 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866663+0000", 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9100000000000004e-07 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866664+0000", 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7349999999999999e-06 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866669+0000", 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7520000000000004e-06 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866674+0000", 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.091e-06 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2427 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882730+0000", 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001541235, 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020232000000000002, 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2427 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882730+0000", 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882730+0000", 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882730+0000", 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2500000000000001e-07 2024-09-14T08:39:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882732+0000", 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7880000000000001e-06 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882738+0000", 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0059999999999998e-06 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882742+0000", 2024-09-14T08:39:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1843 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849004+0000", 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.035267105, 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035799152000000001, 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1843 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849004+0000", 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849004+0000", 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849005+0000", 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3799999999999999e-06 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849010+0000", 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.023e-06 2024-09-14T08:39:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849028+0000", 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8037e-05 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849042+0000", 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3463e-05 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2015 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853781+0000", 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030489799000000001, 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031071528000000001, 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2015 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853781+0000", 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853781+0000", 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853782+0000", 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9999999999999997e-07 2024-09-14T08:39:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853784+0000", 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853793+0000", 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8789999999999992e-06 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853801+0000", 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5820000000000004e-06 2024-09-14T08:39:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2178 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864303+0000", 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019967525, 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020598198000000002, 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2178 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864303+0000", 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864303+0000", 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864304+0000", 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9200000000000002e-07 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864314+0000", 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0675e-05 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864321+0000", 2024-09-14T08:39:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.905e-06 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864326+0000", 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1780000000000002e-06 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2272 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.866682+0000", 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017588882, 2024-09-14T08:39:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018269053, 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2272 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866682+0000", 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866682+0000", 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866682+0000", 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2500000000000001e-07 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866684+0000", 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.513e-06 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866688+0000", 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8449999999999996e-06 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866690+0000", 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7389999999999999e-06 2024-09-14T08:39:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2429 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882748+0000", 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0015224450000000001, 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022520719999999999, 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2429 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882748+0000", 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882748+0000", 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882749+0000", 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5100000000000001e-07 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882750+0000", 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.632e-06 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882758+0000", 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2740000000000002e-06 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882762+0000", 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7559999999999999e-06 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1844 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849078+0000", 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.035192579000000002, 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035971450000000002, 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1844 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849078+0000", 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849078+0000", 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849080+0000", 2024-09-14T08:39:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4270000000000001e-06 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849085+0000", 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3730000000000001e-06 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849104+0000", 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8992999999999999e-05 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849118+0000", 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3773e-05 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2016 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853811+0000", 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030460096999999998, 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.03128852, 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2016 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853811+0000", 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853811+0000", 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853811+0000", 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2600000000000002e-07 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853814+0000", 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7489999999999999e-06 2024-09-14T08:39:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853822+0000", 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7100000000000007e-06 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853828+0000", 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5250000000000002e-06 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2180 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864335+0000", 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019935695, 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020829409, 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2180 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864335+0000", 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864335+0000", 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864336+0000", 2024-09-14T08:39:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6400000000000003e-07 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864338+0000", 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2740000000000002e-06 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864344+0000", 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1619999999999996e-06 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864349+0000", 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9230000000000001e-06 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2274 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.866825+0000", 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017446089000000001, 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018399934999999999, 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2274 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866825+0000", 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866825+0000", 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866826+0000", 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.569999999999999e-07 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866854+0000", 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7846000000000001e-05 2024-09-14T08:39:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866867+0000", 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3492000000000001e-05 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866876+0000", 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5969999999999992e-06 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2431 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882769+0000", 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001501385, 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002505097, 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2431 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882769+0000", 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882769+0000", 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882770+0000", 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7800000000000002e-07 2024-09-14T08:39:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882772+0000", 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882778+0000", 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4189999999999999e-06 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882783+0000", 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8919999999999999e-06 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1846 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849139+0000", 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.035131476000000002, 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036183536000000002, 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1846 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849139+0000", 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849139+0000", 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849141+0000", 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.283e-06 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849146+0000", 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849165+0000", 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9559999999999999e-05 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849179+0000", 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3543000000000001e-05 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2055 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853838+0000", 2024-09-14T08:39:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030433030999999999, 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031534765999999999, 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2055 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853838+0000", 2024-09-14T08:39:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853838+0000", 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853838+0000", 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9999999999999998e-07 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853841+0000", 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7410000000000001e-06 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853850+0000", 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0799999999999995e-06 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853864+0000", 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3862999999999999e-05 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2182 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864356+0000", 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019915044, 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021066536, 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2182 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864356+0000", 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864356+0000", 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864356+0000", 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9299999999999999e-07 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864370+0000", 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4161e-05 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864378+0000", 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7610000000000007e-06 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864384+0000", 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2276 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.866902+0000", 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.01736857, 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018569770999999999, 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2276 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866902+0000", 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866902+0000", 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866903+0000", 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2200000000000003e-07 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866906+0000", 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.208e-06 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866915+0000", 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9290000000000004e-06 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866921+0000", 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0419999999999999e-06 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2433 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882790+0000", 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001480697, 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027409840000000001, 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2433 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882790+0000", 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882790+0000", 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882791+0000", 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.89e-07 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882793+0000", 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9810000000000002e-06 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882800+0000", 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9039999999999992e-06 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882817+0000", 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6376999999999999e-05 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1847 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849197+0000", 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.035073675999999998, 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036389348000000002, 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1847 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.978 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849197+0000", 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849197+0000", 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849198+0000", 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.33e-06 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849204+0000", 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1259999999999997e-06 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849222+0000", 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8317000000000001e-05 2024-09-14T08:39:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849236+0000", 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4403000000000001e-05 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2057 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853874+0000", 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030396998000000001, 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031762830999999998, 2024-09-14T08:39:42.981 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2057 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853874+0000", 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853874+0000", 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853874+0000", 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6100000000000001e-07 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853876+0000", 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.846e-06 2024-09-14T08:39:42.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853881+0000", 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1970000000000004e-06 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853885+0000", 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4680000000000001e-06 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.985 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2183 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.985 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864393+0000", 2024-09-14T08:39:42.985 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019877933, 2024-09-14T08:39:42.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021293299000000002, 2024-09-14T08:39:42.985 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.985 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.985 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.985 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.985 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2183 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864393+0000", 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864393+0000", 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864393+0000", 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864395+0000", 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9420000000000002e-06 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864402+0000", 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2230000000000004e-06 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864413+0000", 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1807999999999999e-05 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2278 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.866935+0000", 2024-09-14T08:39:42.988 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017335836, 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018804563, 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2278 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866935+0000", 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866935+0000", 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866936+0000", 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8699999999999995e-07 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866938+0000", 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5009999999999999e-06 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866945+0000", 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0119999999999999e-06 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866951+0000", 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7400000000000001e-06 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.991 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2435 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882825+0000", 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001445794, 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029640510000000001, 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.992 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2435 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882825+0000", 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882825+0000", 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882826+0000", 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3200000000000005e-07 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882833+0000", 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0620000000000003e-06 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882841+0000", 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4449999999999996e-06 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882846+0000", 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8389999999999997e-06 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1849 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849256+0000", 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.035014924000000003, 2024-09-14T08:39:42.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036588373, 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1849 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849256+0000", 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:42.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849256+0000", 2024-09-14T08:39:42.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:42.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:42.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849257+0000", 2024-09-14T08:39:42.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.144e-06 2024-09-14T08:39:42.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849262+0000", 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2900000000000002e-06 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849281+0000", 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8658999999999999e-05 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:42.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849316+0000", 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4576999999999998e-05 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2059 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853908+0000", 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030363082999999999, 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031987569, 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:42.999 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2059 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853908+0000", 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853908+0000", 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853908+0000", 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.46e-07 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853910+0000", 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5400000000000001e-06 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853918+0000", 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4020000000000002e-06 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853924+0000", 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3080000000000004e-06 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2185 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.002 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864421+0000", 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019849604, 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021536553999999999, 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2185 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864421+0000", 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864421+0000", 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864422+0000", 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3300000000000003e-07 2024-09-14T08:39:43.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864424+0000", 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2790000000000001e-06 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864430+0000", 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4919999999999998e-06 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864435+0000", 2024-09-14T08:39:43.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.882e-06 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2280 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.867175+0000", 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017095934, 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018835119000000001, 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2280 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867175+0000", 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867175+0000", 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867176+0000", 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5000000000000001e-07 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867181+0000", 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0270000000000003e-06 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867193+0000", 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2551999999999999e-05 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867200+0000", 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1970000000000001e-06 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2437 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.009 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882853+0000", 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001418271, 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00320653, 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2437 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882853+0000", 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882853+0000", 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882853+0000", 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2399999999999999e-07 2024-09-14T08:39:43.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882855+0000", 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9439999999999999e-06 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882861+0000", 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882866+0000", 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5700000000000003e-06 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1851 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849335+0000", 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034935831000000001, 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036816852999999997, 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1851 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849335+0000", 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849335+0000", 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849336+0000", 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3069999999999999e-06 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849341+0000", 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0629999999999996e-06 2024-09-14T08:39:43.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849362+0000", 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.016e-05 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849375+0000", 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3336000000000001e-05 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2061 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853936+0000", 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030335289000000001, 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032266436000000003, 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2061 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853936+0000", 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853936+0000", 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853936+0000", 2024-09-14T08:39:43.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853939+0000", 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6960000000000001e-06 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853947+0000", 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4970000000000001e-06 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853953+0000", 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8629999999999996e-06 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2187 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864442+0000", 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019828552999999999, 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021812647000000001, 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.020 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2187 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864442+0000", 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864442+0000", 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864443+0000", 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.34e-07 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864446+0000", 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7860000000000001e-06 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864452+0000", 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1909999999999997e-06 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864456+0000", 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5759999999999999e-06 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2282 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.023 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.867286+0000", 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.016985024000000001, 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019029292999999999, 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2282 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867286+0000", 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867286+0000", 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867287+0000", 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5600000000000004e-07 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867291+0000", 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6349999999999997e-06 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867300+0000", 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6449999999999994e-06 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867306+0000", 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-14T08:39:43.026 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2439 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882871+0000", 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0013994299999999999, 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0035148670000000001, 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2439 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882871+0000", 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882871+0000", 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882872+0000", 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4400000000000001e-07 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882874+0000", 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7969999999999999e-06 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882879+0000", 2024-09-14T08:39:43.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6579999999999999e-06 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882883+0000", 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1529999999999999e-06 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1853 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849393+0000", 2024-09-14T08:39:43.030 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034877755000000003, 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037043782999999997, 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1853 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849393+0000", 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849393+0000", 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849394+0000", 2024-09-14T08:39:43.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2729999999999999e-06 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849399+0000", 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6369999999999998e-06 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849417+0000", 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7770000000000001e-05 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849430+0000", 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3413e-05 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2063 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853962+0000", 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030308405, 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032527564000000002, 2024-09-14T08:39:43.034 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2063 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853962+0000", 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853962+0000", 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853963+0000", 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9399999999999995e-07 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853966+0000", 2024-09-14T08:39:43.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8059999999999999e-06 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853974+0000", 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2109999999999998e-06 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853979+0000", 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.536e-06 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.037 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2189 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864463+0000", 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019807703999999999, 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022076252000000001, 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2189 2024-09-14T08:39:43.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864463+0000", 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864463+0000", 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864464+0000", 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8200000000000001e-07 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864465+0000", 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.889e-06 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864472+0000", 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3010000000000003e-06 2024-09-14T08:39:43.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864483+0000", 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0872e-05 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2284 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.867423+0000", 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.016848018999999999, 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019170382999999999, 2024-09-14T08:39:43.041 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2284 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867423+0000", 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867423+0000", 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867424+0000", 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.093e-06 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867429+0000", 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0080000000000002e-06 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867443+0000", 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3657e-05 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.867452+0000", 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2420000000000006e-06 2024-09-14T08:39:43.044 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2440 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882890+0000", 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0013806409999999999, 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037695519999999998, 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2440 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882890+0000", 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882890+0000", 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882891+0000", 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5100000000000001e-07 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882892+0000", 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9520000000000001e-06 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882899+0000", 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.596e-06 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882904+0000", 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5850000000000001e-06 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.048 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1855 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849448+0000", 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034822418000000001, 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037266234000000002, 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1855 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.049 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849448+0000", 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849448+0000", 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849450+0000", 2024-09-14T08:39:43.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.373e-06 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849455+0000", 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0529999999999997e-06 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849473+0000", 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7917000000000001e-05 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849486+0000", 2024-09-14T08:39:43.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3499999999999999e-05 2024-09-14T08:39:43.052 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.052 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.052 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.052 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2064 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.052 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030282992000000002, 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032776317999999999, 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2064 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853991+0000", 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6560000000000001e-06 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853999+0000", 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9559999999999997e-06 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854003+0000", 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.155e-06 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.055 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2191 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864490+0000", 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019780544000000001, 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022327240000000002, 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.056 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2191 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864490+0000", 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864490+0000", 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864491+0000", 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7999999999999996e-07 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864493+0000", 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1440000000000001e-06 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864499+0000", 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9750000000000004e-06 2024-09-14T08:39:43.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864503+0000", 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3869999999999997e-06 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2346 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874366+0000", 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0099044030000000009, 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012500809, 2024-09-14T08:39:43.059 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2346 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874366+0000", 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874366+0000", 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874368+0000", 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1000000000000001e-06 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874372+0000", 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9359999999999998e-06 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874385+0000", 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2537999999999999e-05 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874401+0000", 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6314e-05 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.062 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2441 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882910+0000", 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001360757, 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.004008663, 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.063 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2441 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882910+0000", 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882910+0000", 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882910+0000", 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8599999999999999e-07 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882913+0000", 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1859999999999999e-06 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882919+0000", 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5660000000000003e-06 2024-09-14T08:39:43.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882924+0000", 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6399999999999996e-06 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1857 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849505+0000", 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034766105999999998, 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037470468999999999, 2024-09-14T08:39:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1857 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849505+0000", 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849505+0000", 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849506+0000", 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.327e-06 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849544+0000", 2024-09-14T08:39:43.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7710000000000003e-05 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849563+0000", 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9519999999999999e-05 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849578+0000", 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4273e-05 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2065 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854011+0000", 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030259567000000001, 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033014234000000003, 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2065 2024-09-14T08:39:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854011+0000", 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854011+0000", 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854012+0000", 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7599999999999997e-07 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854014+0000", 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5100000000000001e-06 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854024+0000", 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854041+0000", 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6609e-05 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2192 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864510+0000", 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019760745999999999, 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022568468000000001, 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.073 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2192 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864510+0000", 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864510+0000", 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864511+0000", 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2e-07 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864512+0000", 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8959999999999999e-06 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864519+0000", 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2920000000000001e-06 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864523+0000", 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5770000000000004e-06 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.076 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2348 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874415+0000", 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0098553600000000005, 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012711892000000001, 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2348 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874415+0000", 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874415+0000", 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874416+0000", 2024-09-14T08:39:43.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8599999999999998e-07 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874419+0000", 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874427+0000", 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7999999999999999e-06 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874432+0000", 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4110000000000004e-06 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2443 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882931+0000", 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0013397870000000001, 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.004248145, 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.080 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2443 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882931+0000", 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882931+0000", 2024-09-14T08:39:43.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882931+0000", 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7899999999999999e-07 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882934+0000", 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2050000000000001e-06 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882940+0000", 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6139999999999997e-06 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882945+0000", 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7840000000000003e-06 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.083 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1859 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849599+0000", 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034672162999999999, 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037631168999999999, 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1859 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849599+0000", 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849599+0000", 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849600+0000", 2024-09-14T08:39:43.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4670000000000001e-06 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849621+0000", 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0599999999999999e-05 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849640+0000", 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8848999999999999e-05 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849654+0000", 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4287000000000001e-05 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2066 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.03021826, 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033229001000000001, 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.087 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2066 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2300000000000001e-07 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854056+0000", 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1130000000000001e-06 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854065+0000", 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7010000000000002e-06 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854071+0000", 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0669999999999997e-06 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.090 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2194 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864540+0000", 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019730577999999999, 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022802012, 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2194 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864540+0000", 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864540+0000", 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864541+0000", 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:39:43.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864543+0000", 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.491e-06 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864550+0000", 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4160000000000001e-06 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864554+0000", 2024-09-14T08:39:43.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5820000000000003e-06 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2350 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874441+0000", 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0098293949999999995, 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012955115, 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.094 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2350 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874441+0000", 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874441+0000", 2024-09-14T08:39:43.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874442+0000", 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7299999999999996e-07 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874445+0000", 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5900000000000002e-06 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874452+0000", 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874457+0000", 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4190000000000001e-06 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2445 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.097 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882951+0000", 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0013193510000000001, 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044952769999999998, 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2445 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882951+0000", 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882951+0000", 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882952+0000", 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.72e-07 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882954+0000", 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882964+0000", 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0134e-05 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882969+0000", 2024-09-14T08:39:43.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0980000000000001e-06 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1972 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849674+0000", 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034596410000000001, 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037832744000000001, 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1972 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849674+0000", 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849674+0000", 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849676+0000", 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4130000000000001e-06 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849681+0000", 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.22e-06 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849700+0000", 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.863e-05 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849713+0000", 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3723000000000001e-05 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2068 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854080+0000", 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030190886, 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033488873000000002, 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2068 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854080+0000", 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854080+0000", 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854081+0000", 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7700000000000004e-07 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854090+0000", 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8020000000000003e-06 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854099+0000", 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8000000000000004e-06 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854104+0000", 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0849999999999996e-06 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2195 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864728+0000", 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019542721999999998, 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.02289565, 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.108 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2195 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864728+0000", 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864728+0000", 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864729+0000", 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7199999999999998e-07 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864732+0000", 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.174e-06 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864739+0000", 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.498e-06 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864745+0000", 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7760000000000003e-06 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2351 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.111 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874465+0000", 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0098062459999999994, 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013207481, 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2351 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874465+0000", 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874465+0000", 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874465+0000", 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3799999999999998e-07 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874467+0000", 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2510000000000001e-06 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874474+0000", 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6340000000000003e-06 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874486+0000", 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1950000000000001e-05 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.114 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2446 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882977+0000", 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0012933479999999999, 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047563980000000002, 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.115 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2446 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882977+0000", 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882977+0000", 2024-09-14T08:39:43.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882978+0000", 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2399999999999999e-07 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882987+0000", 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6109999999999994e-06 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882996+0000", 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6819999999999998e-06 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883001+0000", 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1429999999999997e-06 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1974 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.118 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849734+0000", 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034536667, 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038050564000000002, 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1974 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849734+0000", 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849734+0000", 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849735+0000", 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.333e-06 2024-09-14T08:39:43.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849741+0000", 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3369999999999999e-06 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849759+0000", 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7856e-05 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849773+0000", 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.416e-05 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2070 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854110+0000", 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030160615000000002, 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033723101999999998, 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2070 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854110+0000", 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854110+0000", 2024-09-14T08:39:43.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854111+0000", 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.53e-07 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854117+0000", 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6229999999999999e-06 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854126+0000", 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.337e-06 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854132+0000", 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0469999999999999e-06 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.125 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2197 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864812+0000", 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019459104000000001, 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023082886, 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2197 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864812+0000", 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864812+0000", 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864812+0000", 2024-09-14T08:39:43.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3499999999999996e-07 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864822+0000", 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0198e-05 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864832+0000", 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7340000000000003e-06 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864838+0000", 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8610000000000003e-06 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2353 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874494+0000", 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0097768890000000004, 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013452554, 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2353 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874494+0000", 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874494+0000", 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874494+0000", 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.13e-07 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874497+0000", 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4880000000000001e-06 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874504+0000", 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7309999999999996e-06 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874509+0000", 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.977e-06 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2448 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883009+0000", 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0012617380000000001, 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050854999999999997, 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2448 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883009+0000", 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883009+0000", 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883010+0000", 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9100000000000004e-07 2024-09-14T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883012+0000", 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.199e-06 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883018+0000", 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4200000000000004e-06 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883031+0000", 2024-09-14T08:39:43.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2994e-05 2024-09-14T08:39:43.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.136 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1976 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849794+0000", 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034477288000000002, 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038352025999999997, 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1976 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849794+0000", 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849794+0000", 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849795+0000", 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1969999999999999e-06 2024-09-14T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849800+0000", 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2460000000000003e-06 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849818+0000", 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849831+0000", 2024-09-14T08:39:43.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2072 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855459+0000", 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028811363999999999, 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032747507000000002, 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2072 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855459+0000", 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855459+0000", 2024-09-14T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855461+0000", 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1990000000000001e-06 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855466+0000", 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3730000000000001e-06 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855481+0000", 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4684e-05 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855490+0000", 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1160000000000005e-06 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2199 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864849+0000", 2024-09-14T08:39:43.143 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019422317000000001, 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023408760000000001, 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2199 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864849+0000", 2024-09-14T08:39:43.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864849+0000", 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864849+0000", 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2900000000000004e-07 2024-09-14T08:39:43.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864851+0000", 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.238e-06 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864858+0000", 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3350000000000003e-06 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864870+0000", 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2578999999999999e-05 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2356 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874516+0000", 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0097546400000000002, 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013803536, 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.147 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2356 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874516+0000", 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874516+0000", 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874517+0000", 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874524+0000", 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7910000000000005e-06 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874531+0000", 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9079999999999998e-06 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874536+0000", 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.074e-06 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2450 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.150 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883038+0000", 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0012327359999999999, 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0053316520000000001, 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2450 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883038+0000", 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883038+0000", 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883039+0000", 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1199999999999998e-07 2024-09-14T08:39:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883041+0000", 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9999999999999999e-06 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883047+0000", 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2029999999999997e-06 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883051+0000", 2024-09-14T08:39:43.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1978 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849850+0000", 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034421061000000003, 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038571793, 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1978 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849850+0000", 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849850+0000", 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849851+0000", 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3659999999999999e-06 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849856+0000", 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849879+0000", 2024-09-14T08:39:43.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3229000000000001e-05 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849907+0000", 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7617e-05 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2073 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855519+0000", 2024-09-14T08:39:43.157 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028752181000000002, 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032961736999999998, 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2073 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855519+0000", 2024-09-14T08:39:43.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855519+0000", 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855520+0000", 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7300000000000005e-07 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855525+0000", 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.254e-06 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855534+0000", 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5370000000000003e-06 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855541+0000", 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9290000000000001e-06 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2201 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864880+0000", 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019391202, 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023661686000000001, 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.161 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2201 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864880+0000", 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864880+0000", 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864880+0000", 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5199999999999997e-07 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864883+0000", 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.317e-06 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864889+0000", 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3060000000000003e-06 2024-09-14T08:39:43.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864895+0000", 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2269999999999998e-06 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2358 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874543+0000", 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0097275799999999996, 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014047980999999999, 2024-09-14T08:39:43.164 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2358 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874543+0000", 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874543+0000", 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874544+0000", 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.34e-07 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874546+0000", 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9180000000000001e-06 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874552+0000", 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1539999999999999e-06 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874556+0000", 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6609999999999999e-06 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2452 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883057+0000", 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0012136200000000001, 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0055864260000000002, 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2452 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883057+0000", 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883057+0000", 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883058+0000", 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7599999999999998e-07 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883059+0000", 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7829999999999999e-06 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883067+0000", 2024-09-14T08:39:43.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883071+0000", 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5050000000000001e-06 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1980 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.171 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849927+0000", 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034343756000000003, 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038775614, 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1980 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849927+0000", 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849927+0000", 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849929+0000", 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.454e-06 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849934+0000", 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5999999999999997e-06 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849953+0000", 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8372999999999998e-05 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849966+0000", 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3443e-05 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.174 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2075 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855552+0000", 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028719224000000002, 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033201115000000003, 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.175 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2075 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855552+0000", 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855552+0000", 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855553+0000", 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2299999999999999e-07 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855555+0000", 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6510000000000001e-06 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855563+0000", 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3059999999999998e-06 2024-09-14T08:39:43.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855570+0000", 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1879999999999999e-06 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2203 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864902+0000", 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019368614999999999, 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023903243000000001, 2024-09-14T08:39:43.178 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2203 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864902+0000", 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864902+0000", 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864903+0000", 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8000000000000001e-07 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864904+0000", 2024-09-14T08:39:43.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.858e-06 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864911+0000", 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864915+0000", 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2360 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874563+0000", 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0097082890000000002, 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014303056, 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2360 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.182 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874563+0000", 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874563+0000", 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874563+0000", 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.08e-07 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874565+0000", 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.796e-06 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874571+0000", 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874575+0000", 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5340000000000001e-06 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2454 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883077+0000", 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001193513, 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0058403960000000003, 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2454 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883077+0000", 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883077+0000", 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883078+0000", 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7399999999999999e-07 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883085+0000", 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4800000000000004e-06 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883093+0000", 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.242e-06 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883103+0000", 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9150000000000008e-06 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1982 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.849985+0000", 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034285878999999998, 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038990858000000003, 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1982 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849985+0000", 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849985+0000", 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849986+0000", 2024-09-14T08:39:43.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.313e-06 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.849991+0000", 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9339999999999997e-06 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850009+0000", 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7612999999999999e-05 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850023+0000", 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4503e-05 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2077 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855579+0000", 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028691753, 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033458462000000001, 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.192 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2077 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855579+0000", 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855579+0000", 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855580+0000", 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3799999999999997e-07 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855582+0000", 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8090000000000001e-06 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855591+0000", 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1640000000000001e-06 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855597+0000", 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5590000000000002e-06 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.195 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2205 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864924+0000", 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019347303999999999, 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024164005999999998, 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2205 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864924+0000", 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864924+0000", 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864924+0000", 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864926+0000", 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864933+0000", 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864937+0000", 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6129999999999997e-06 2024-09-14T08:39:43.198 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2362 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874581+0000", 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0096895999999999996, 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014560808999999999, 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.199 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2362 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874581+0000", 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874581+0000", 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874582+0000", 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8200000000000001e-07 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874583+0000", 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8029999999999999e-06 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874590+0000", 2024-09-14T08:39:43.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874594+0000", 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8919999999999999e-06 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2456 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883112+0000", 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001159092, 2024-09-14T08:39:43.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0060881440000000002, 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2456 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883112+0000", 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883112+0000", 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883112+0000", 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883115+0000", 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3910000000000001e-06 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883122+0000", 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0369999999999997e-06 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883127+0000", 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0159999999999999e-06 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.205 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1984 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850042+0000", 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034228412999999999, 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039211836, 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.206 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1984 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850042+0000", 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850042+0000", 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850044+0000", 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2559999999999999e-06 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850049+0000", 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2000000000000002e-06 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850068+0000", 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8627e-05 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850095+0000", 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7990000000000001e-05 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2079 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855606+0000", 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028664802999999999, 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033697501999999997, 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.209 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2079 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855606+0000", 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855606+0000", 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855607+0000", 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9399999999999995e-07 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855609+0000", 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:39:43.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855616+0000", 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3679999999999996e-06 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855623+0000", 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6039999999999998e-06 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2240 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.865106+0000", 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019164934000000002, 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024251957000000001, 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2240 2024-09-14T08:39:43.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.214 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865106+0000", 2024-09-14T08:39:43.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865106+0000", 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865107+0000", 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3030000000000001e-06 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865112+0000", 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2000000000000002e-06 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865126+0000", 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3325e-05 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865135+0000", 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9250000000000001e-06 2024-09-14T08:39:43.216 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2364 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874605+0000", 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0096657970000000003, 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014811886999999999, 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.217 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2364 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874605+0000", 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874605+0000", 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874605+0000", 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874608+0000", 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4040000000000002e-06 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874615+0000", 2024-09-14T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.759e-06 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874626+0000", 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1375e-05 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2458 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883134+0000", 2024-09-14T08:39:43.220 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001137267, 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0063443299999999996, 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2458 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883134+0000", 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883134+0000", 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883134+0000", 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6399999999999998e-07 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883136+0000", 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9199999999999998e-06 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883144+0000", 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5699999999999993e-06 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883150+0000", 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6350000000000003e-06 2024-09-14T08:39:43.223 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1986 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850116+0000", 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034154776999999997, 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039411031999999999, 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1986 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850116+0000", 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850116+0000", 2024-09-14T08:39:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850117+0000", 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.387e-06 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850123+0000", 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1030000000000001e-06 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850141+0000", 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8173e-05 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850155+0000", 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4063000000000001e-05 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2081 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855632+0000", 2024-09-14T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028639003, 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033949200999999998, 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2081 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855632+0000", 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855632+0000", 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855633+0000", 2024-09-14T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3499999999999995e-07 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855635+0000", 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2989999999999999e-06 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855643+0000", 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2530000000000004e-06 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855661+0000", 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7779e-05 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2242 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.865150+0000", 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019120508000000001, 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024480871000000001, 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2242 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865150+0000", 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865150+0000", 2024-09-14T08:39:43.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865151+0000", 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3099999999999997e-07 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865154+0000", 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.072e-06 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865164+0000", 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9429999999999995e-06 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865170+0000", 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3230000000000003e-06 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2366 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.874645+0000", 2024-09-14T08:39:43.234 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0096263129999999992, 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015035649, 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2366 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874645+0000", 2024-09-14T08:39:43.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874645+0000", 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874645+0000", 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7199999999999998e-07 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874648+0000", 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.022e-06 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874658+0000", 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0210999999999999e-05 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.874664+0000", 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.665e-06 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.237 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2460 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883158+0000", 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001113211, 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0065854770000000002, 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.238 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2460 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883158+0000", 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883158+0000", 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883158+0000", 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7300000000000001e-07 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883160+0000", 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1849999999999998e-06 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883169+0000", 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5380000000000002e-06 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883174+0000", 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9819999999999999e-06 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1988 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850177+0000", 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034094223999999999, 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039623980000000003, 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1988 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.242 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850177+0000", 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850177+0000", 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850178+0000", 2024-09-14T08:39:43.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3e-06 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850183+0000", 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3159999999999996e-06 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850206+0000", 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2929999999999999e-05 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850220+0000", 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3536999999999999e-05 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2083 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028600169000000002, 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034183312, 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.245 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2083 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.75e-07 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855674+0000", 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9189999999999999e-06 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855683+0000", 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7169999999999997e-06 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855689+0000", 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1709999999999999e-06 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.248 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2244 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.865180+0000", 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019090833000000001, 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024723696999999999, 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2244 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865180+0000", 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865180+0000", 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865181+0000", 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0100000000000005e-07 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865183+0000", 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7190000000000001e-06 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865191+0000", 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1790000000000008e-06 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865197+0000", 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9109999999999998e-06 2024-09-14T08:39:43.251 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "pg_update_log_missing(3.8 epoch 36/21 rep_tid 205 entries 36'82 (0'0) error 3:101bd32b:::rbd_header.10f1663ce16c:head by client.4612.0:2050 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 36'80)", 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882350+0000", 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0019205660000000001, 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0076293999999999997, 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882350+0000", 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882350+0000", 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882351+0000", 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0299999999999998e-07 2024-09-14T08:39:43.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882361+0000", 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0224000000000001e-05 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882384+0000", 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2364000000000001e-05 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882399+0000", 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5028000000000001e-05 2024-09-14T08:39:43.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883939+0000", 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001540081 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2462 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883181+0000", 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001089778, 2024-09-14T08:39:43.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0068467099999999998, 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2462 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883181+0000", 2024-09-14T08:39:43.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883181+0000", 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883181+0000", 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.89e-07 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883183+0000", 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9719999999999999e-06 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883191+0000", 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0250000000000002e-06 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883196+0000", 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8790000000000002e-06 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.258 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1990 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850240+0000", 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034030928000000002, 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039840959000000002, 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1990 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850240+0000", 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850240+0000", 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850241+0000", 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3769999999999999e-06 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850247+0000", 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5600000000000001e-06 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850267+0000", 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9663000000000001e-05 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850280+0000", 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3883000000000001e-05 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2085 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.262 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855697+0000", 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028573457, 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034433273, 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2085 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855697+0000", 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855697+0000", 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855698+0000", 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.82e-07 2024-09-14T08:39:43.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855700+0000", 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.604e-06 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855708+0000", 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9079999999999995e-06 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855714+0000", 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0449999999999997e-06 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2246 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.865332+0000", 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018939137000000002, 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024850918, 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.266 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2246 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865332+0000", 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865332+0000", 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865333+0000", 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865337+0000", 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3950000000000003e-06 2024-09-14T08:39:43.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865349+0000", 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2422999999999999e-05 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865358+0000", 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0709999999999995e-06 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2368 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882432+0000", 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001838707, 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0077989929999999997, 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2368 2024-09-14T08:39:43.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882432+0000", 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882432+0000", 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882433+0000", 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6000000000000002e-07 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882437+0000", 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8290000000000001e-06 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882448+0000", 2024-09-14T08:39:43.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1437000000000001e-05 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882455+0000", 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6449999999999999e-06 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2464 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883203+0000", 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0010674359999999999, 2024-09-14T08:39:43.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0070795930000000003, 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2464 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883203+0000", 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883203+0000", 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883204+0000", 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7300000000000002e-07 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883206+0000", 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.046e-06 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883212+0000", 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4620000000000001e-06 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883217+0000", 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-14T08:39:43.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1992 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850300+0000", 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033970861999999998, 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.040038681999999999, 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1992 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850300+0000", 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850300+0000", 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850302+0000", 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.73e-06 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850347+0000", 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5602999999999997e-05 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850368+0000", 2024-09-14T08:39:43.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0656999999999999e-05 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850383+0000", 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5457000000000001e-05 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2087 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855723+0000", 2024-09-14T08:39:43.280 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028547916, 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034668996000000001, 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2087 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855723+0000", 2024-09-14T08:39:43.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855723+0000", 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855724+0000", 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5000000000000002e-07 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855726+0000", 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5770000000000001e-06 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855735+0000", 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.918e-06 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855749+0000", 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3828999999999999e-05 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.283 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2248 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.865371+0000", 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018899556000000001, 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025069939999999999, 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.284 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2248 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865371+0000", 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865371+0000", 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865372+0000", 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865375+0000", 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865383+0000", 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2300000000000008e-06 2024-09-14T08:39:43.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865389+0000", 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999998e-06 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2370 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882467+0000", 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001804017, 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0080326119999999997, 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.287 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2370 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882467+0000", 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882467+0000", 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882467+0000", 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0399999999999996e-07 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882470+0000", 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:39:43.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882479+0000", 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6170000000000007e-06 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882484+0000", 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3279999999999996e-06 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2466 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883224+0000", 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0010472179999999999, 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0073263249999999999, 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2466 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883224+0000", 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883224+0000", 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883224+0000", 2024-09-14T08:39:43.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.77e-07 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883226+0000", 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.875e-06 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883234+0000", 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0029999999999994e-06 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883247+0000", 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2795e-05 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1994 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850406+0000", 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033864568999999997, 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.040192903000000002, 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.294 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1994 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850406+0000", 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850406+0000", 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850408+0000", 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.313e-06 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850415+0000", 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3429999999999998e-06 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850433+0000", 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8309999999999999e-05 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850447+0000", 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3743e-05 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2089 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028512056000000001, 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034893230999999997, 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2089 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5599999999999995e-07 2024-09-14T08:39:43.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855768+0000", 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9069999999999996e-06 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855777+0000", 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9069999999999996e-06 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855783+0000", 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1059999999999996e-06 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2250 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.865398+0000", 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018872478000000002, 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025292331000000001, 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2250 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865398+0000", 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865398+0000", 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865399+0000", 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865402+0000", 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6180000000000002e-06 2024-09-14T08:39:43.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865409+0000", 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2869999999999999e-06 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865427+0000", 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8397999999999999e-05 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2372 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882492+0000", 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001778551, 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0082532539999999998, 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.305 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2372 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882492+0000", 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882492+0000", 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882493+0000", 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7599999999999997e-07 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882495+0000", 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882503+0000", 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1300000000000001e-06 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882508+0000", 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2349999999999999e-06 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2468 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.883255+0000", 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001016236, 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075289969999999999, 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.308 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2468 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883255+0000", 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883255+0000", 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883255+0000", 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4700000000000002e-07 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883257+0000", 2024-09-14T08:39:43.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2309999999999999e-06 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883266+0000", 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9039999999999998e-06 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.883271+0000", 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9860000000000002e-06 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1996 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850466+0000", 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033805146000000001, 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.040347718999999997, 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1996 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.312 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850466+0000", 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850466+0000", 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850467+0000", 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.336e-06 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850472+0000", 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.87e-06 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850490+0000", 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7934000000000001e-05 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850517+0000", 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7623e-05 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2091 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.856231+0000", 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028039962000000002, 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034606851000000001, 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.315 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2091 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856231+0000", 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856231+0000", 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856232+0000", 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2869999999999999e-06 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856236+0000", 2024-09-14T08:39:43.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0829999999999997e-06 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856249+0000", 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2914e-05 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856257+0000", 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4540000000000001e-06 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2252 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.865486+0000", 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018784637999999999, 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025379677, 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.319 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2252 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865486+0000", 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865486+0000", 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865487+0000", 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1800000000000004e-07 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865499+0000", 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1994000000000001e-05 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865510+0000", 2024-09-14T08:39:43.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.075e-05 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865518+0000", 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2374 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882516+0000", 2024-09-14T08:39:43.322 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0017549709999999999, 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083878070000000006, 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2374 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882516+0000", 2024-09-14T08:39:43.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882516+0000", 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882516+0000", 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882518+0000", 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.165e-06 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882525+0000", 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5819999999999998e-06 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882530+0000", 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6469999999999997e-06 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.325 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2537 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.890444+0000", 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9938269, 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00048781300000000003, 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2537 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890444+0000", 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890444+0000", 2024-09-14T08:39:43.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890445+0000", 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890450+0000", 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7469999999999996e-06 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890460+0000", 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0305999999999999e-05 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890467+0000", 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6869999999999997e-06 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1998 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.329 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850538+0000", 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033733247000000001, 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.040418691, 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1998 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850538+0000", 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850538+0000", 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850539+0000", 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2869999999999999e-06 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850544+0000", 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.446e-06 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850563+0000", 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.836e-05 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850576+0000", 2024-09-14T08:39:43.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2093 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028001291000000001, 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034712841000000001, 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.333 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2093 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9100000000000003e-07 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856273+0000", 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856281+0000", 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3999999999999992e-06 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856288+0000", 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2559999999999999e-06 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.336 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2255 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.865666+0000", 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018604562000000002, 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025340418, 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2255 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865666+0000", 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865666+0000", 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865667+0000", 2024-09-14T08:39:43.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7600000000000006e-07 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865672+0000", 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3970000000000004e-06 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865683+0000", 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.184e-05 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865691+0000", 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7929999999999998e-06 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2377 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882537+0000", 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00173394, 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0084950200000000007, 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.340 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2377 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882537+0000", 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882537+0000", 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882537+0000", 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3300000000000003e-07 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882543+0000", 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689999999999999e-06 2024-09-14T08:39:43.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882551+0000", 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2660000000000001e-06 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882556+0000", 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2209999999999996e-06 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.343 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2539 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.890490+0000", 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9937806, 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00057459600000000003, 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2539 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.344 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890490+0000", 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890490+0000", 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890491+0000", 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0100000000000004e-07 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890495+0000", 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4259999999999996e-06 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890503+0000", 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0840000000000003e-06 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890508+0000", 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4179999999999996e-06 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2000 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850595+0000", 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033675677000000001, 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.040504566999999998, 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.347 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2000 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850595+0000", 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850595+0000", 2024-09-14T08:39:43.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850596+0000", 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.243e-06 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850602+0000", 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1399999999999999e-06 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850619+0000", 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7880000000000002e-05 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850633+0000", 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3297e-05 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2096 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.350 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.856297+0000", 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027973807, 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034827335000000001, 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2096 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856297+0000", 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856297+0000", 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856298+0000", 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5799999999999999e-07 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856300+0000", 2024-09-14T08:39:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4719999999999998e-06 2024-09-14T08:39:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856308+0000", 2024-09-14T08:39:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1750000000000005e-06 2024-09-14T08:39:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856314+0000", 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1249999999999998e-06 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2257 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.865761+0000", 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018510313, 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025387922, 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2257 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865761+0000", 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865761+0000", 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865761+0000", 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865765+0000", 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9589999999999997e-06 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865776+0000", 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0682e-05 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865793+0000", 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6762e-05 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2379 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882563+0000", 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0017083070000000001, 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0086131620000000006, 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2379 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882563+0000", 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882563+0000", 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882563+0000", 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8200000000000001e-07 2024-09-14T08:39:43.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882566+0000", 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6769999999999999e-06 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882572+0000", 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0249999999999999e-06 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882576+0000", 2024-09-14T08:39:43.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7060000000000003e-06 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2540 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.890520+0000", 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.993751, 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00069154399999999999, 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2540 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890520+0000", 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890520+0000", 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890520+0000", 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2300000000000001e-07 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890522+0000", 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2670000000000001e-06 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890529+0000", 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5910000000000001e-06 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890534+0000", 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9860000000000002e-06 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.364 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2002 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850651+0000", 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033619688000000002, 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.040592975000000003, 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2002 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850651+0000", 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850651+0000", 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850652+0000", 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2470000000000001e-06 2024-09-14T08:39:43.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850657+0000", 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8600000000000001e-06 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850692+0000", 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5243000000000001e-05 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850707+0000", 2024-09-14T08:39:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4229999999999999e-05 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2162 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.862607+0000", 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.021663389000000002, 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.028661571, 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2162 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862607+0000", 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862607+0000", 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862610+0000", 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.277e-06 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862620+0000", 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0066e-05 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862649+0000", 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8827999999999999e-05 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862667+0000", 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8546000000000002e-05 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2259 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.865921+0000", 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018350088000000001, 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025545647000000001, 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2259 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865921+0000", 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865921+0000", 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865922+0000", 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1900000000000001e-07 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865926+0000", 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5850000000000001e-06 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865938+0000", 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1276e-05 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.865946+0000", 2024-09-14T08:39:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9990000000000008e-06 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2381 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882582+0000", 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0016883969999999999, 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0089306009999999998, 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2381 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882582+0000", 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882582+0000", 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882583+0000", 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2300000000000002e-07 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882585+0000", 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7129999999999999e-06 2024-09-14T08:39:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882591+0000", 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0000000000000002e-06 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882596+0000", 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1159999999999998e-06 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2541 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.890540+0000", 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9937305, 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010094769999999999, 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2541 2024-09-14T08:39:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890540+0000", 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890540+0000", 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890541+0000", 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7500000000000001e-07 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890544+0000", 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6639999999999998e-06 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890549+0000", 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.993e-06 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890554+0000", 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2004 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850770+0000", 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033500757999999999, 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.040807432999999997, 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2004 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850770+0000", 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850770+0000", 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850771+0000", 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0869999999999999e-06 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850776+0000", 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8099999999999997e-06 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850789+0000", 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3511e-05 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850798+0000", 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2930000000000001e-06 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2164 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.862809+0000", 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.021462038999999999, 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.028801627999999999, 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2164 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862809+0000", 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862809+0000", 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862811+0000", 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.091e-06 2024-09-14T08:39:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862818+0000", 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.109e-06 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862840+0000", 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1739e-05 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.862898+0000", 2024-09-14T08:39:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8291000000000001e-05 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2261 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.866187+0000", 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018083399999999999, 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025475820999999999, 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2261 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866187+0000", 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866187+0000", 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866188+0000", 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7399999999999991e-07 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866193+0000", 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2610000000000004e-06 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866205+0000", 2024-09-14T08:39:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1919999999999999e-05 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866213+0000", 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0960000000000001e-06 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2383 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882601+0000", 2024-09-14T08:39:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0016693630000000001, 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0091142800000000006, 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2383 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882601+0000", 2024-09-14T08:39:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882601+0000", 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882602+0000", 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5400000000000002e-07 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882604+0000", 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.779e-06 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882611+0000", 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4569999999999999e-06 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882616+0000", 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0529999999999997e-06 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2542 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.890562+0000", 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9937091, 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011810379999999999, 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2542 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890562+0000", 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890562+0000", 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890562+0000", 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2500000000000001e-07 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890564+0000", 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7880000000000001e-06 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890570+0000", 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1870000000000002e-06 2024-09-14T08:39:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890575+0000", 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6460000000000001e-06 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2006 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853585+0000", 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030686148, 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038205522999999998, 2024-09-14T08:39:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2006 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853585+0000", 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853585+0000", 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853586+0000", 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0449999999999999e-06 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853591+0000", 2024-09-14T08:39:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4670000000000003e-06 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853605+0000", 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3991e-05 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853617+0000", 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1516e-05 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2166 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863272+0000", 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.02099844, 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.028548297, 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2166 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863272+0000", 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863272+0000", 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863274+0000", 2024-09-14T08:39:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9400000000000001e-06 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863283+0000", 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6170000000000007e-06 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863323+0000", 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9864999999999999e-05 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863339+0000", 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6674999999999999e-05 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2263 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.866284+0000", 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017987026999999999, 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025587854, 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2263 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866284+0000", 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866284+0000", 2024-09-14T08:39:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866285+0000", 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.85e-07 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866289+0000", 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9369999999999997e-06 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866299+0000", 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0739e-05 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866307+0000", 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6680000000000001e-06 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2385 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882623+0000", 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00164784, 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0092917599999999996, 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2385 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882623+0000", 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882623+0000", 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882623+0000", 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9499999999999998e-07 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882626+0000", 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882634+0000", 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2660000000000001e-06 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882640+0000", 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.823e-06 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2544 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.890581+0000", 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9936895, 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013659830000000001, 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2544 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890581+0000", 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890581+0000", 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890582+0000", 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8200000000000001e-07 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890583+0000", 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.81e-06 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890589+0000", 2024-09-14T08:39:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8839999999999999e-06 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890594+0000", 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7060000000000003e-06 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2008 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853633+0000", 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030638255, 2024-09-14T08:39:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038372593000000003, 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2008 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853633+0000", 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853633+0000", 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853633+0000", 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3300000000000001e-07 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853637+0000", 2024-09-14T08:39:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4520000000000002e-06 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853646+0000", 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1120000000000002e-06 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853653+0000", 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0650000000000001e-06 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2168 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863366+0000", 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020905164, 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.028674506999999998, 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2168 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863366+0000", 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863366+0000", 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863367+0000", 2024-09-14T08:39:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3459999999999999e-06 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863372+0000", 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3890000000000004e-06 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863389+0000", 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7088e-05 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863404+0000", 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4243000000000001e-05 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2265 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.866509+0000", 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017762005000000001, 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025583825000000001, 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2265 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866509+0000", 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866509+0000", 2024-09-14T08:39:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866510+0000", 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7400000000000002e-07 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866514+0000", 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7729999999999999e-06 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866524+0000", 2024-09-14T08:39:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.166e-06 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866531+0000", 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0260000000000002e-06 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2387 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882647+0000", 2024-09-14T08:39:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0016238699999999999, 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0094748049999999993, 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2387 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882647+0000", 2024-09-14T08:39:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882647+0000", 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882647+0000", 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8700000000000001e-07 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882649+0000", 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1009999999999999e-06 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882657+0000", 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882673+0000", 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5619000000000001e-05 2024-09-14T08:39:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2547 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.890600+0000", 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9936709, 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015656190000000001, 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2547 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890600+0000", 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890600+0000", 2024-09-14T08:39:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890600+0000", 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1899999999999998e-07 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890602+0000", 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.685e-06 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890608+0000", 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2550000000000003e-06 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890613+0000", 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8420000000000004e-06 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2009 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853664+0000", 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030606570999999999, 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038541315, 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2009 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853664+0000", 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853664+0000", 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853665+0000", 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9400000000000005e-07 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853668+0000", 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.066e-06 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853677+0000", 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0599999999999997e-06 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853684+0000", 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4439999999999996e-06 2024-09-14T08:39:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2170 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863427+0000", 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.02084397, 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.028832538000000001, 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2170 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863427+0000", 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863427+0000", 2024-09-14T08:39:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863428+0000", 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1459999999999999e-06 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863433+0000", 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7740000000000004e-06 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863449+0000", 2024-09-14T08:39:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6123000000000001e-05 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863460+0000", 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1182999999999999e-05 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2267 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.866587+0000", 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017684142999999999, 2024-09-14T08:39:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025704945999999999, 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2267 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866587+0000", 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866587+0000", 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866588+0000", 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9000000000000005e-07 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866591+0000", 2024-09-14T08:39:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8120000000000001e-06 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866597+0000", 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8860000000000001e-06 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.866601+0000", 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9330000000000003e-06 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2390 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.882682+0000", 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0015892429999999999, 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096500030000000007, 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2390 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882682+0000", 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882682+0000", 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882682+0000", 2024-09-14T08:39:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4499999999999997e-07 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882684+0000", 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4210000000000002e-06 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882692+0000", 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.109e-06 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.882697+0000", 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0069999999999997e-06 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2549 3.0 3.3cac0060 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.890620+0000", 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9936509, 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001764035, 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2549 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890620+0000", 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890620+0000", 2024-09-14T08:39:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890620+0000", 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2399999999999999e-07 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890622+0000", 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9889999999999999e-06 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890628+0000", 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9769999999999997e-06 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.890633+0000", 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2240000000000003e-06 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 160 2024-09-14T08:39:43.450 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:43.452 INFO:teuthology.orchestra.run.smithi188.stdout:692 read 0x931bc00 thru 0x931bce0 (0xe1 bytes) 2024-09-14T08:39:43.452 INFO:teuthology.orchestra.run.smithi188.stdout:694 clone 8 order 25 su 1048576 sc 2 2024-09-14T08:39:43.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:43.453 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:43.458+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:43.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:39:43.553 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:43.558+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:43.592 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:43.592 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:43.592 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:43.592 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:43.593 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:43.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:43.654 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:43.660+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:43.676 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone7 from 0xadffa00 (overlap 0x9a7ca00) to 0x1ee5a00 2024-09-14T08:39:43.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:39:43.762 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1996 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 399360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850466+0000", 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91751617500000004, 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044993527999999998, 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1996 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850466+0000", 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850466+0000", 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850467+0000", 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.336e-06 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850472+0000", 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.87e-06 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850490+0000", 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7934000000000001e-05 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850517+0000", 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7623e-05 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895301+0000", 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044783666 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895373+0000", 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1655000000000004e-05 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895459+0000", 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6444000000000001e-05 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1998 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850538+0000", 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.917444276, 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045143779000000002, 2024-09-14T08:39:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1998 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850538+0000", 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850538+0000", 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850539+0000", 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2869999999999999e-06 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850544+0000", 2024-09-14T08:39:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.446e-06 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850563+0000", 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.836e-05 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850576+0000", 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895504+0000", 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044927151999999998 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895587+0000", 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3053999999999995e-05 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895681+0000", 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4673000000000006e-05 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2000 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850595+0000", 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91738670600000005, 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045298011999999999, 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2000 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850595+0000", 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850595+0000", 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850596+0000", 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.243e-06 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850602+0000", 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1399999999999999e-06 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850619+0000", 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7880000000000002e-05 2024-09-14T08:39:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850633+0000", 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3297e-05 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895714+0000", 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045081430999999998 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895792+0000", 2024-09-14T08:39:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8171999999999996e-05 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895893+0000", 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100849 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2002 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 433152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850651+0000", 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91733071700000002, 2024-09-14T08:39:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045457744000000001, 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2002 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850651+0000", 2024-09-14T08:39:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850651+0000", 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850652+0000", 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2470000000000001e-06 2024-09-14T08:39:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850657+0000", 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8600000000000001e-06 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850692+0000", 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5243000000000001e-05 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850707+0000", 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4229999999999999e-05 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895930+0000", 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045223197 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.896018+0000", 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8001e-05 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.896109+0000", 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0965999999999996e-05 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2004 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 444416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850770+0000", 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91721178699999995, 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045553048999999998, 2024-09-14T08:39:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2004 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850770+0000", 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850770+0000", 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850771+0000", 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0869999999999999e-06 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850776+0000", 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8099999999999997e-06 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850789+0000", 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3511e-05 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850798+0000", 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2930000000000001e-06 2024-09-14T08:39:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.896153+0000", 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045355064 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.896238+0000", 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4713e-05 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.896323+0000", 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5570999999999998e-05 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2064 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 321536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91399402100000005, 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044963624000000001, 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2064 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853991+0000", 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6560000000000001e-06 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853999+0000", 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9559999999999997e-06 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854003+0000", 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.155e-06 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.898769+0000", 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044766154000000002 2024-09-14T08:39:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.898850+0000", 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1071999999999999e-05 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.898951+0000", 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101183 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2065 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 332800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854011+0000", 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91397059599999997, 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045156427999999998, 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2065 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854011+0000", 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854011+0000", 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854012+0000", 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7599999999999997e-07 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854014+0000", 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5100000000000001e-06 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854024+0000", 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854041+0000", 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6609e-05 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.898992+0000", 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044951446999999999 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899073+0000", 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0149999999999997e-05 2024-09-14T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899168+0000", 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5138999999999998e-05 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2066 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 344064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91392928900000003, 2024-09-14T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045293112000000003, 2024-09-14T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2066 2024-09-14T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2300000000000001e-07 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854056+0000", 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1130000000000001e-06 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854065+0000", 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7010000000000002e-06 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854071+0000", 2024-09-14T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0669999999999997e-06 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899215+0000", 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045144285999999999 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899282+0000", 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6711999999999994e-05 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899346+0000", 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3709999999999998e-05 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2068 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 355328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854080+0000", 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91390191499999995, 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045486561000000002, 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2068 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854080+0000", 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854080+0000", 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854081+0000", 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7700000000000004e-07 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854090+0000", 2024-09-14T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8020000000000003e-06 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854099+0000", 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8000000000000004e-06 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854104+0000", 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0849999999999996e-06 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899391+0000", 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045286828000000001 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899470+0000", 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8485000000000005e-05 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899567+0000", 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6984000000000005e-05 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2070 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 366592~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854110+0000", 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91387164399999998, 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045613338000000003, 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2070 2024-09-14T08:39:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854110+0000", 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854110+0000", 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854111+0000", 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.53e-07 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854117+0000", 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6229999999999999e-06 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854126+0000", 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.337e-06 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854132+0000", 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0469999999999999e-06 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899614+0000", 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045482498000000003 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899663+0000", 2024-09-14T08:39:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8605e-05 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899724+0000", 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0875000000000002e-05 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2077 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855579+0000", 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91240278200000002, 2024-09-14T08:39:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045105335000000003, 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2077 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855579+0000", 2024-09-14T08:39:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855579+0000", 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855580+0000", 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3799999999999997e-07 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855582+0000", 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8090000000000001e-06 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855591+0000", 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1640000000000001e-06 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855597+0000", 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5590000000000002e-06 2024-09-14T08:39:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900499+0000", 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044902027999999997 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900584+0000", 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4676e-05 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900684+0000", 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100561 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2079 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 422912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855606+0000", 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91237583200000005, 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045285474999999999, 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2079 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855606+0000", 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855606+0000", 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855607+0000", 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9399999999999995e-07 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855609+0000", 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:39:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855616+0000", 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3679999999999996e-06 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855623+0000", 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6039999999999998e-06 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900722+0000", 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045098790999999999 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900801+0000", 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9475999999999996e-05 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900892+0000", 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0303000000000006e-05 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2081 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855632+0000", 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91235003199999998, 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045473883999999999, 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2081 2024-09-14T08:39:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855632+0000", 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855632+0000", 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855633+0000", 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3499999999999995e-07 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855635+0000", 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2989999999999999e-06 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855643+0000", 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2530000000000004e-06 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855661+0000", 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7779e-05 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900932+0000", 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045270831999999997 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901008+0000", 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6440000000000007e-05 2024-09-14T08:39:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901106+0000", 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7546000000000004e-05 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2083 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 445440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91231119800000005, 2024-09-14T08:39:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045552845000000002, 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2083 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.75e-07 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855674+0000", 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9189999999999999e-06 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855683+0000", 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7169999999999997e-06 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855689+0000", 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1709999999999999e-06 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901129+0000", 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045440005999999998 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901171+0000", 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1504000000000001e-05 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901224+0000", 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2952999999999999e-05 2024-09-14T08:39:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2085 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855697+0000", 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91228448600000001, 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045719844000000003, 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2085 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855697+0000", 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855697+0000", 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855698+0000", 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.82e-07 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855700+0000", 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.604e-06 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855708+0000", 2024-09-14T08:39:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9079999999999995e-06 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855714+0000", 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0449999999999997e-06 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901258+0000", 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045543383999999999 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901325+0000", 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7228000000000001e-05 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901417+0000", 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2193000000000003e-05 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2087 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 467968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855723+0000", 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91225894500000004, 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045971751999999998, 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2087 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855723+0000", 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855723+0000", 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855724+0000", 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5000000000000002e-07 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855726+0000", 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5770000000000001e-06 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855735+0000", 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.918e-06 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855749+0000", 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3828999999999999e-05 2024-09-14T08:39:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901473+0000", 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045723838000000003 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901573+0000", 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9999000000000003e-05 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901695+0000", 2024-09-14T08:39:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121841 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2089 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 479232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91222308500000004, 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.046170994999999999, 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2089 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5599999999999995e-07 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855768+0000", 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9069999999999996e-06 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855777+0000", 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9069999999999996e-06 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855783+0000", 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1059999999999996e-06 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901728+0000", 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045944355999999999 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901811+0000", 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3608000000000003e-05 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901930+0000", 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011855500000000001 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2091 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 490496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.856231+0000", 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91175099100000001, 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045931681000000002, 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2091 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856231+0000", 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856231+0000", 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856232+0000", 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2869999999999999e-06 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856236+0000", 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0829999999999997e-06 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856249+0000", 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2914e-05 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856257+0000", 2024-09-14T08:39:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4540000000000001e-06 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901974+0000", 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045717773000000003 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902056+0000", 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1379999999999997e-05 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902163+0000", 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010679 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2093 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 501760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91171232000000002, 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.046143385000000002, 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2093 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9100000000000003e-07 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856273+0000", 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856281+0000", 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3999999999999992e-06 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856288+0000", 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2559999999999999e-06 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902194+0000", 2024-09-14T08:39:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045906453 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902274+0000", 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9908999999999997e-05 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902413+0000", 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013881599999999999 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2096 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 513024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.856297+0000", 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.91168483600000005, 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.046369066, 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2096 2024-09-14T08:39:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856297+0000", 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856297+0000", 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856298+0000", 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5799999999999999e-07 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856300+0000", 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4719999999999998e-06 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856308+0000", 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1750000000000005e-06 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856314+0000", 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1249999999999998e-06 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902473+0000", 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.046158662000000003 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902558+0000", 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4730999999999999e-05 2024-09-14T08:39:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902666+0000", 2024-09-14T08:39:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108343 2024-09-14T08:39:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:43.855 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:43.856 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:43.768+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:43.856 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:43.858 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:43.862+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:43.961 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:43.964+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:43.963 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:43.963 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:43.997 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:43.997 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:44.028 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:44.028 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:44.062 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:44.066+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:44.064 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:44.065 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:44.095 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:44.095 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:44.101 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:44.102 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:44.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:44.133 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:44.134 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:44.202 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:44.208+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:44.263 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:44.268+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:44.305 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:44.305 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:44.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:44.370 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:44.376+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:44.466 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:44.472+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:39:44.542 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:44.542 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:44.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:44.612 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:44.618+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:44.667 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:44.672+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:44.736 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:44.736 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:44.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:44.767 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:44.772+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:44.868 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:44.874+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:44.941 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:44.941 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:44.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:44.969 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:44.971+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:45.070 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:45.075+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:45.145 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:45.146 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:45.163 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:45.212 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:45.218+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:45.272 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:45.275+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:45.292 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:45.292 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:45.309 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:45.400 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:45.406+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:45.476 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:45.479+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:45.507 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:45.507 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:45.521 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:45.561 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T08:39:45.561 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:39:45.561 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-14T08:39:45.561 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T08:39:45.562 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T08:39:45.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-14T08:39:45.610 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:45.615+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:45.676 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:45.682+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:45.697 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:45.697 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:45.714 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:45.732 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:45.732 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T08:39:45.732 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:45.790 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:45.795+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:45.877 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:45.879+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:45.886 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:45.887 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:45.900 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:45.978 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:45.979+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:46.018 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:46.018 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:46.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:46.079 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:46.082+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:46.142 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:46.142 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:46.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:46.158 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:39:46.198 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:46.203+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:46.281 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:46.286+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:46.318 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:46.318 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:46.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:46.382 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:46.383+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:46.383 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:46.383 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:46.409 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:46.409 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:46.433 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:46.433 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:46.456 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:46.456 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:46.465 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:46.465 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:46.465 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:46.465 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:46.465 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:46.476 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:46.477 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:46.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:46.483 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:46.486+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:46.503 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:46.503 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:46.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:39:46.622 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:46.627+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:46.632 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2017 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 324608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.860759+0000", 2024-09-14T08:39:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7771692859999999, 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.057637257999999997, 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2017 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.860759+0000", 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.860759+0000", 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.860760+0000", 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.860765+0000", 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0429999999999998e-06 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.860780+0000", 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4814000000000001e-05 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.860791+0000", 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0837e-05 2024-09-14T08:39:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.911080+0000", 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.050289320999999998 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.911151+0000", 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0438000000000006e-05 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.918397+0000", 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0072458619999999996 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2117 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 291840~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863379+0000", 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7745499379999998, 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051733079000000001, 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2117 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863379+0000", 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863379+0000", 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863379+0000", 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3799999999999997e-07 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863388+0000", 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6119999999999999e-06 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863396+0000", 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1519999999999992e-06 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863402+0000", 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5949999999999998e-06 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.914946+0000", 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051543888000000003 2024-09-14T08:39:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915021+0000", 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5135999999999993e-05 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915112+0000", 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1157999999999997e-05 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2119 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 303104~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863411+0000", 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7745180469999999, 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051892078000000001, 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2119 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863411+0000", 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863411+0000", 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863411+0000", 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7999999999999995e-07 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863414+0000", 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3810000000000002e-06 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863420+0000", 2024-09-14T08:39:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6150000000000002e-06 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863425+0000", 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8330000000000001e-06 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915140+0000", 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051714495999999999 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915211+0000", 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1750999999999998e-05 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915303+0000", 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1422000000000007e-05 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2121 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 314368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.646 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863433+0000", 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7744961469999998, 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052057476999999998, 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2121 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863433+0000", 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863433+0000", 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863433+0000", 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6199999999999998e-07 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863435+0000", 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2000000000000001e-06 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863442+0000", 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7309999999999996e-06 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863447+0000", 2024-09-14T08:39:46.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8269999999999997e-06 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915328+0000", 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051881251000000003 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915401+0000", 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3256000000000005e-05 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915490+0000", 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8750000000000002e-05 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2123 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 325632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863454+0000", 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7744747670000001, 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052226343000000001, 2024-09-14T08:39:46.651 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2123 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863454+0000", 2024-09-14T08:39:46.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863454+0000", 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863454+0000", 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9699999999999996e-07 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863457+0000", 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2790000000000001e-06 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863463+0000", 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5320000000000003e-06 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863468+0000", 2024-09-14T08:39:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9919999999999998e-06 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915517+0000", 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052048378999999999 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915589+0000", 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2675000000000005e-05 2024-09-14T08:39:46.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915680+0000", 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0989000000000006e-05 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2125 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 336896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863475+0000", 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7744532710000001, 2024-09-14T08:39:46.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052392088000000003, 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2125 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863475+0000", 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863475+0000", 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863476+0000", 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:39:46.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863478+0000", 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2019999999999998e-06 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863485+0000", 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.55e-06 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863490+0000", 2024-09-14T08:39:46.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000001e-06 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915708+0000", 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052218360999999998 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915783+0000", 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5260999999999997e-05 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915868+0000", 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4448000000000002e-05 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2127 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 348160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863497+0000", 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7744316360000001, 2024-09-14T08:39:46.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052557554999999999, 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2127 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863497+0000", 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863497+0000", 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863498+0000", 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1200000000000003e-07 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863500+0000", 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0609999999999998e-06 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863506+0000", 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5239999999999997e-06 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863511+0000", 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-06 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915895+0000", 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052383454000000003 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.915965+0000", 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0889000000000005e-05 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916055+0000", 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9215000000000006e-05 2024-09-14T08:39:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2129 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 359424~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863518+0000", 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7744106529999999, 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052723438999999997, 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2129 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863518+0000", 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863518+0000", 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863519+0000", 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9900000000000001e-07 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863521+0000", 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.215e-06 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863527+0000", 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3029999999999996e-06 2024-09-14T08:39:46.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863531+0000", 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3050000000000003e-06 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916080+0000", 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052548693 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916153+0000", 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3053999999999995e-05 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916242+0000", 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8369999999999996e-05 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2131 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 370688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.670 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863538+0000", 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7743903200000002, 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052897580999999999, 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2131 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863538+0000", 2024-09-14T08:39:46.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863538+0000", 2024-09-14T08:39:46.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863539+0000", 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863541+0000", 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0499999999999999e-06 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863548+0000", 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5479999999999998e-06 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863552+0000", 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6149999999999999e-06 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916267+0000", 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052715259 2024-09-14T08:39:46.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916343+0000", 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5842999999999999e-05 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916436+0000", 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2788999999999995e-05 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2135 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 381952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863559+0000", 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7743694039999998, 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.053069506000000002, 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2135 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.676 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863559+0000", 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863559+0000", 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863560+0000", 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.75e-07 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863562+0000", 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2029999999999999e-06 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863569+0000", 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4969999999999998e-06 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863580+0000", 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1677e-05 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916463+0000", 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052883271000000003 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916538+0000", 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4054999999999995e-05 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916629+0000", 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1328000000000004e-05 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2138 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 393216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.863588+0000", 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7743407590000002, 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.053234056000000002, 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.680 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2138 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863588+0000", 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.863588+0000", 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864144+0000", 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00055615799999999996 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864148+0000", 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8739999999999997e-06 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864159+0000", 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1087000000000001e-05 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864166+0000", 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0090000000000001e-06 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916655+0000", 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052488505999999997 2024-09-14T08:39:46.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916727+0000", 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2383000000000001e-05 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916822+0000", 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5038999999999996e-05 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.684 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2141 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 404480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864179+0000", 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7737501199999999, 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052832154999999999, 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.685 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2141 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864179+0000", 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864179+0000", 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864179+0000", 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2900000000000004e-07 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864182+0000", 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5050000000000002e-06 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864189+0000", 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4410000000000004e-06 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864195+0000", 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7100000000000004e-06 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916847+0000", 2024-09-14T08:39:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052652593999999997 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.916918+0000", 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0718999999999998e-05 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917011+0000", 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2657000000000004e-05 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2142 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 415744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864203+0000", 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7737253900000001, 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052994898999999998, 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2142 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.690 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864203+0000", 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864203+0000", 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864514+0000", 2024-09-14T08:39:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00031094400000000001 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864531+0000", 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6739e-05 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864542+0000", 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0832999999999999e-05 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864549+0000", 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3119999999999996e-06 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917035+0000", 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052485955000000001 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917105+0000", 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9500999999999997e-05 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917198+0000", 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3615000000000004e-05 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2144 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864562+0000", 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7733671370000001, 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052825379999999998, 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.694 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2144 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864562+0000", 2024-09-14T08:39:46.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864562+0000", 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864562+0000", 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6599999999999996e-07 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864565+0000", 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864572+0000", 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9260000000000003e-06 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864577+0000", 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2769999999999996e-06 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917223+0000", 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052646317999999998 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917297+0000", 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3714999999999995e-05 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917387+0000", 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9853999999999997e-05 2024-09-14T08:39:46.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2146 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864586+0000", 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.773343219, 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052996722000000003, 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2146 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864586+0000", 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864586+0000", 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864756+0000", 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017014999999999999 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864759+0000", 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.771e-06 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864769+0000", 2024-09-14T08:39:46.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864775+0000", 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8349999999999998e-06 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917414+0000", 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052638755000000002 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917488+0000", 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4165000000000006e-05 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917582+0000", 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3956999999999995e-05 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2148 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 449536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.864787+0000", 2024-09-14T08:39:46.703 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7731413090000001, 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.052978446999999998, 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2148 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864787+0000", 2024-09-14T08:39:46.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.864787+0000", 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.868595+0000", 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038074799999999998 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.868601+0000", 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9340000000000003e-06 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.868621+0000", 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9758999999999998e-05 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.868649+0000", 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8153999999999998e-05 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917609+0000", 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.048960572000000001 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917681+0000", 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1573000000000001e-05 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.917766+0000", 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4975000000000005e-05 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2214 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 394240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.869157+0000", 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7687714140000002, 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051752342999999999, 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.708 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2214 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869157+0000", 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869157+0000", 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869158+0000", 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3099999999999998e-07 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869160+0000", 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.849e-06 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869166+0000", 2024-09-14T08:39:46.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2049999999999999e-06 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869177+0000", 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1337e-05 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.920814+0000", 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051637284999999998 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.920855+0000", 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0920999999999997e-05 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.920910+0000", 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4314999999999998e-05 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2216 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 405504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.712 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.869185+0000", 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7687435210000002, 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051845862, 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2216 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869185+0000", 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869185+0000", 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869247+0000", 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1946999999999995e-05 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869259+0000", 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1586000000000001e-05 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869268+0000", 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0950000000000002e-06 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869272+0000", 2024-09-14T08:39:46.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3719999999999998e-06 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.920938+0000", 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051665376999999998 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.920977+0000", 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9320999999999998e-05 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.921031+0000", 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4163999999999998e-05 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2217 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 416768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.869280+0000", 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7686483829999999, 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051871061000000003, 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.717 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2217 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869280+0000", 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869280+0000", 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869562+0000", 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00028183100000000002 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869568+0000", 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.818e-06 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869578+0000", 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8879999999999992e-06 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869587+0000", 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4539999999999996e-06 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.921059+0000", 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051471797 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.921098+0000", 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9082999999999998e-05 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.921151+0000", 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3189999999999997e-05 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.722 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2219 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 428032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:46.722 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.869606+0000", 2024-09-14T08:39:46.722 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7683227719999999, 2024-09-14T08:39:46.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051665137, 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2219 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:46.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869606+0000", 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869606+0000", 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869731+0000", 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012476300000000001 2024-09-14T08:39:46.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869741+0000", 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0414000000000001e-05 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869753+0000", 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1494e-05 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.869769+0000", 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6242000000000001e-05 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.921177+0000", 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051408184000000003 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.921218+0000", 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1100000000000003e-05 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:46.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:46.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:46.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.921271+0000", 2024-09-14T08:39:46.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2939999999999998e-05 2024-09-14T08:39:46.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.728 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:46.728 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:46.728 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:46.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:46.730 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:46.731+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:46.830 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:46.835+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:46.911 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:46.911 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:46.911 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:46.911 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:46.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:46.931 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:46.934+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:47.033 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:47.035+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:47.083 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:47.083 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:47.083 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:47.083 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:47.083 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:47.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:47.139 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:47.143+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:47.235 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:47.238+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:47.317 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:47.317 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:47.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1996 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 399360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850466+0000", 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4724574119999998, 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044993527999999998, 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1996 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850466+0000", 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850466+0000", 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850467+0000", 2024-09-14T08:39:47.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.336e-06 2024-09-14T08:39:47.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850472+0000", 2024-09-14T08:39:47.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.87e-06 2024-09-14T08:39:47.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850490+0000", 2024-09-14T08:39:47.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7934000000000001e-05 2024-09-14T08:39:47.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850517+0000", 2024-09-14T08:39:47.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7623e-05 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895301+0000", 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044783666 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895373+0000", 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1655000000000004e-05 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895459+0000", 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6444000000000001e-05 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:1998 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850538+0000", 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4723855129999999, 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045143779000000002, 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.323 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1998 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850538+0000", 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850538+0000", 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850539+0000", 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2869999999999999e-06 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850544+0000", 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.446e-06 2024-09-14T08:39:47.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850563+0000", 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.836e-05 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850576+0000", 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895504+0000", 2024-09-14T08:39:47.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044927151999999998 2024-09-14T08:39:47.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895587+0000", 2024-09-14T08:39:47.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3053999999999995e-05 2024-09-14T08:39:47.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895681+0000", 2024-09-14T08:39:47.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4673000000000006e-05 2024-09-14T08:39:47.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.329 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.329 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2000 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.330 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850595+0000", 2024-09-14T08:39:47.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4723279429999998, 2024-09-14T08:39:47.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045298011999999999, 2024-09-14T08:39:47.330 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.330 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.330 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.330 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2000 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850595+0000", 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850595+0000", 2024-09-14T08:39:47.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850596+0000", 2024-09-14T08:39:47.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.243e-06 2024-09-14T08:39:47.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850602+0000", 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1399999999999999e-06 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850619+0000", 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7880000000000002e-05 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850633+0000", 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3297e-05 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895714+0000", 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045081430999999998 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895792+0000", 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8171999999999996e-05 2024-09-14T08:39:47.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895893+0000", 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100849 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2002 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 433152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850651+0000", 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.472271954, 2024-09-14T08:39:47.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045457744000000001, 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2002 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850651+0000", 2024-09-14T08:39:47.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850651+0000", 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850652+0000", 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2470000000000001e-06 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850657+0000", 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8600000000000001e-06 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850692+0000", 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5243000000000001e-05 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850707+0000", 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4229999999999999e-05 2024-09-14T08:39:47.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.895930+0000", 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045223197 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.896018+0000", 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8001e-05 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.896109+0000", 2024-09-14T08:39:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0965999999999996e-05 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2004 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 444416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.850770+0000", 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4721530239999998, 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045553048999999998, 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2004 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850770+0000", 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850770+0000", 2024-09-14T08:39:47.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850771+0000", 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0869999999999999e-06 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850776+0000", 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8099999999999997e-06 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850789+0000", 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3511e-05 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.850798+0000", 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2930000000000001e-06 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.896153+0000", 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045355064 2024-09-14T08:39:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.896238+0000", 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4713e-05 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.896323+0000", 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5570999999999998e-05 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2064 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 321536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4689352580000001, 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044963624000000001, 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2064 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:47.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:47.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853988+0000", 2024-09-14T08:39:47.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:39:47.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853991+0000", 2024-09-14T08:39:47.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6560000000000001e-06 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.853999+0000", 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9559999999999997e-06 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854003+0000", 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.155e-06 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.898769+0000", 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044766154000000002 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.898850+0000", 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1071999999999999e-05 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.898951+0000", 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101183 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2065 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 332800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854011+0000", 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4689118329999999, 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045156427999999998, 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2065 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.350 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854011+0000", 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854011+0000", 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854012+0000", 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7599999999999997e-07 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854014+0000", 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5100000000000001e-06 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854024+0000", 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:39:47.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854041+0000", 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6609e-05 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.898992+0000", 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044951446999999999 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899073+0000", 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0149999999999997e-05 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899168+0000", 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5138999999999998e-05 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2066 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 344064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4688705259999999, 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045293112000000003, 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2066 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854053+0000", 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2300000000000001e-07 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854056+0000", 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1130000000000001e-06 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854065+0000", 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7010000000000002e-06 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854071+0000", 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0669999999999997e-06 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899215+0000", 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045144285999999999 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899282+0000", 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6711999999999994e-05 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899346+0000", 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3709999999999998e-05 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.358 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2068 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 355328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854080+0000", 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4688431519999998, 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045486561000000002, 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2068 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854080+0000", 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854080+0000", 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854081+0000", 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7700000000000004e-07 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854090+0000", 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8020000000000003e-06 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854099+0000", 2024-09-14T08:39:47.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8000000000000004e-06 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854104+0000", 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0849999999999996e-06 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899391+0000", 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045286828000000001 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899470+0000", 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8485000000000005e-05 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899567+0000", 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6984000000000005e-05 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2070 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 366592~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.363 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.854110+0000", 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4688128809999998, 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045613338000000003, 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2070 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854110+0000", 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854110+0000", 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854111+0000", 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.53e-07 2024-09-14T08:39:47.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854117+0000", 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6229999999999999e-06 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854126+0000", 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.337e-06 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.854132+0000", 2024-09-14T08:39:47.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0469999999999999e-06 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899614+0000", 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045482498000000003 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899663+0000", 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8605e-05 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.899724+0000", 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0875000000000002e-05 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2077 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855579+0000", 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4673440190000004, 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045105335000000003, 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2077 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855579+0000", 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855579+0000", 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855580+0000", 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3799999999999997e-07 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855582+0000", 2024-09-14T08:39:47.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8090000000000001e-06 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855591+0000", 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1640000000000001e-06 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855597+0000", 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5590000000000002e-06 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900499+0000", 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.044902027999999997 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900584+0000", 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4676e-05 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900684+0000", 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100561 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.372 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2079 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 422912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855606+0000", 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4673170689999999, 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045285474999999999, 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.373 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2079 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855606+0000", 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855606+0000", 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855607+0000", 2024-09-14T08:39:47.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9399999999999995e-07 2024-09-14T08:39:47.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855609+0000", 2024-09-14T08:39:47.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855616+0000", 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3679999999999996e-06 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855623+0000", 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6039999999999998e-06 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900722+0000", 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045098790999999999 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900801+0000", 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9475999999999996e-05 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900892+0000", 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0303000000000006e-05 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2081 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855632+0000", 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4672912690000004, 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045473883999999999, 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2081 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855632+0000", 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855632+0000", 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855633+0000", 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3499999999999995e-07 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855635+0000", 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2989999999999999e-06 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855643+0000", 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2530000000000004e-06 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855661+0000", 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7779e-05 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.900932+0000", 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045270831999999997 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901008+0000", 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6440000000000007e-05 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901106+0000", 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7546000000000004e-05 2024-09-14T08:39:47.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2083 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 445440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4672524349999998, 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045552845000000002, 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.383 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2083 2024-09-14T08:39:47.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.384 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:47.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:47.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855671+0000", 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.75e-07 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855674+0000", 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9189999999999999e-06 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855683+0000", 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7169999999999997e-06 2024-09-14T08:39:47.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855689+0000", 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1709999999999999e-06 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901129+0000", 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045440005999999998 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901171+0000", 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1504000000000001e-05 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901224+0000", 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2952999999999999e-05 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2085 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.388 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855697+0000", 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4672257230000003, 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045719844000000003, 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2085 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855697+0000", 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855697+0000", 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855698+0000", 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.82e-07 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855700+0000", 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.604e-06 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855708+0000", 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9079999999999995e-06 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855714+0000", 2024-09-14T08:39:47.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0449999999999997e-06 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901258+0000", 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045543383999999999 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901325+0000", 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7228000000000001e-05 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901417+0000", 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2193000000000003e-05 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2087 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 467968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855723+0000", 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.467200182, 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045971751999999998, 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.393 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2087 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855723+0000", 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855723+0000", 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855724+0000", 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5000000000000002e-07 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855726+0000", 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5770000000000001e-06 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855735+0000", 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.918e-06 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855749+0000", 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3828999999999999e-05 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901473+0000", 2024-09-14T08:39:47.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045723838000000003 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901573+0000", 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9999000000000003e-05 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901695+0000", 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121841 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.398 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2089 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 479232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.398 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:47.398 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4671643220000004, 2024-09-14T08:39:47.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.046170994999999999, 2024-09-14T08:39:47.398 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.398 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.398 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.398 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.398 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2089 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855759+0000", 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5599999999999995e-07 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855768+0000", 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9069999999999996e-06 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855777+0000", 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9069999999999996e-06 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.855783+0000", 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1059999999999996e-06 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901728+0000", 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045944355999999999 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901811+0000", 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3608000000000003e-05 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901930+0000", 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011855500000000001 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2091 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 490496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.856231+0000", 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4666922280000003, 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045931681000000002, 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.403 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2091 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856231+0000", 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856231+0000", 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856232+0000", 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2869999999999999e-06 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856236+0000", 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0829999999999997e-06 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856249+0000", 2024-09-14T08:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2914e-05 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856257+0000", 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4540000000000001e-06 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.901974+0000", 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045717773000000003 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902056+0000", 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1379999999999997e-05 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902163+0000", 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010679 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.407 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2093 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 501760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4666535569999999, 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.046143385000000002, 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2093 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.408 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856270+0000", 2024-09-14T08:39:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9100000000000003e-07 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856273+0000", 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856281+0000", 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3999999999999992e-06 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856288+0000", 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2559999999999999e-06 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902194+0000", 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045906453 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902274+0000", 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9908999999999997e-05 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902413+0000", 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013881599999999999 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:2096 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 513024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:42.856297+0000", 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4666260729999996, 2024-09-14T08:39:47.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.046369066, 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 2096 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856297+0000", 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856297+0000", 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856298+0000", 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5799999999999999e-07 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856300+0000", 2024-09-14T08:39:47.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4719999999999998e-06 2024-09-14T08:39:47.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856308+0000", 2024-09-14T08:39:47.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1750000000000005e-06 2024-09-14T08:39:47.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.856314+0000", 2024-09-14T08:39:47.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1249999999999998e-06 2024-09-14T08:39:47.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902473+0000", 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.046158662000000003 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902558+0000", 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4730999999999999e-05 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:42.902666+0000", 2024-09-14T08:39:47.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108343 2024-09-14T08:39:47.418 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.418 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.418 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.418 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.418 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.418 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:47.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:47.420 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:47.422+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:47.519 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:39:47.520 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:47.523+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:47.530 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:47.530 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:47.531 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:39:47.531 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:47.544 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:47.621 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:47.626+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:47.698 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:47.698 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:47.698 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:47.698 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:47.698 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:47.710 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:47.758 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:47.763+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:47.822 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:47.823+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:47.837 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:47.837 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:39:47.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:39:47.837 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:47.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.837 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:7989 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3877888~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.837 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.969328+0000", 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.872634278, 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059656278, 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 7989 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969328+0000", 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969328+0000", 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969705+0000", 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00037718099999999998 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969710+0000", 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0599999999999998e-06 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969722+0000", 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1776e-05 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969729+0000", 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7170000000000008e-06 2024-09-14T08:39:47.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.028834+0000", 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059104911000000003 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.028887+0000", 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2441000000000002e-05 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.028984+0000", 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7192000000000001e-05 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:7991 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3889152~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.969770+0000", 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8721916410000001, 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059582952000000002, 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 7991 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969770+0000", 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969770+0000", 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969815+0000", 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4829000000000001e-05 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969819+0000", 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9899999999999999e-06 2024-09-14T08:39:47.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969827+0000", 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3310000000000004e-06 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969834+0000", 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1629999999999999e-06 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029215+0000", 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059380545999999999 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029257+0000", 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1854999999999998e-05 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029353+0000", 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6237999999999996e-05 2024-09-14T08:39:47.846 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:7992 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3921920~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.969848+0000", 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.872113428, 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059601538000000003, 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 7992 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969848+0000", 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969848+0000", 2024-09-14T08:39:47.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969907+0000", 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9021000000000003e-05 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969911+0000", 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0849999999999999e-06 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969921+0000", 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6120000000000005e-06 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969933+0000", 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2047e-05 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029370+0000", 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059437065999999997 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029407+0000", 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6619000000000003e-05 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029450+0000", 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3087999999999998e-05 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.851 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:7993 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3900416~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.969958+0000", 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.872004295, 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059603663000000001, 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 7993 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969958+0000", 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.969958+0000", 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970093+0000", 2024-09-14T08:39:47.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013540399999999999 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970098+0000", 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8520000000000003e-06 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970111+0000", 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2872e-05 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970121+0000", 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0376e-05 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029465+0000", 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059343783999999997 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029498+0000", 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3395999999999997e-05 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029561+0000", 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2978999999999995e-05 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:7996 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3922944~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.970177+0000", 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8717848830000001, 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059595845000000001, 2024-09-14T08:39:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 7996 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970177+0000", 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970177+0000", 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970265+0000", 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7898000000000004e-05 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970269+0000", 2024-09-14T08:39:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4569999999999998e-06 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970279+0000", 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6430000000000007e-06 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970287+0000", 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000005e-06 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029675+0000", 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059387672000000002 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029718+0000", 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3810999999999998e-05 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029773+0000", 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4453999999999997e-05 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8145 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3677184~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.970299+0000", 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8716624610000001, 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059568376999999999, 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8145 2024-09-14T08:39:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970299+0000", 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970299+0000", 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970379+0000", 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9276999999999993e-05 2024-09-14T08:39:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970383+0000", 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8749999999999999e-06 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970394+0000", 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.066e-05 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970402+0000", 2024-09-14T08:39:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8150000000000006e-06 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029789+0000", 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059387222000000003 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029826+0000", 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6579000000000003e-05 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029868+0000", 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949000000000001e-05 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8146 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3688448~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.970418+0000", 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8715435309999999, 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059562572000000001, 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8146 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970418+0000", 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970418+0000", 2024-09-14T08:39:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970527+0000", 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108663 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970540+0000", 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2604e-05 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970551+0000", 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1197e-05 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970558+0000", 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3259999999999998e-06 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029882+0000", 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059324399999999999 2024-09-14T08:39:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029935+0000", 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2649999999999999e-05 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.029981+0000", 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5732000000000002e-05 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8148 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3699712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.970657+0000", 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.871305161, 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059532844000000001, 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8148 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970657+0000", 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970657+0000", 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970740+0000", 2024-09-14T08:39:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3027000000000003e-05 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970747+0000", 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8959999999999997e-06 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970758+0000", 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1379000000000001e-05 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970766+0000", 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5830000000000001e-06 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030098+0000", 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059332068000000002 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030145+0000", 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7191999999999998e-05 2024-09-14T08:39:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030189+0000", 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4699e-05 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8150 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3687424~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.970892+0000", 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8710701959999998, 2024-09-14T08:39:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059610145000000003, 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8150 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970892+0000", 2024-09-14T08:39:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970892+0000", 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970892+0000", 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6199999999999997e-07 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970895+0000", 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970903+0000", 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4800000000000004e-06 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970909+0000", 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5320000000000003e-06 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030313+0000", 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059403281000000002 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030414+0000", 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101038 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030502+0000", 2024-09-14T08:39:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8141999999999997e-05 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8151 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3722240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.970919+0000", 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8710430389999999, 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059708899000000003, 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8151 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970919+0000", 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.970919+0000", 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971112+0000", 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019294000000000001 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971117+0000", 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9570000000000001e-06 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971128+0000", 2024-09-14T08:39:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1240000000000001e-05 2024-09-14T08:39:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971135+0000", 2024-09-14T08:39:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5449999999999998e-06 2024-09-14T08:39:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030536+0000", 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059400239000000001 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030582+0000", 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030628+0000", 2024-09-14T08:39:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5692999999999998e-05 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8152 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3698688~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.971151+0000", 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8708109259999999, 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059594240999999999, 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8152 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971151+0000", 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971151+0000", 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971152+0000", 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.44e-07 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971155+0000", 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1860000000000001e-06 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971162+0000", 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6559999999999992e-06 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971169+0000", 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1410000000000002e-06 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030645+0000", 2024-09-14T08:39:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059476717999999998 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030680+0000", 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4712000000000002e-05 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030745+0000", 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5184000000000005e-05 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8153 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3733504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.971188+0000", 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8707737099999999, 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059655867000000001, 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8153 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971188+0000", 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971188+0000", 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971236+0000", 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8195000000000002e-05 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971240+0000", 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9500000000000003e-06 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971249+0000", 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1840000000000005e-06 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971257+0000", 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0960000000000003e-06 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030762+0000", 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059505898000000002 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030800+0000", 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7271000000000003e-05 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030844+0000", 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4273000000000001e-05 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8154 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3744768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.971270+0000", 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8706918290000001, 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059688574000000001, 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8154 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971270+0000", 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971270+0000", 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971357+0000", 2024-09-14T08:39:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7081000000000002e-05 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971361+0000", 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1080000000000003e-06 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971373+0000", 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1982e-05 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971380+0000", 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9199999999999998e-06 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030859+0000", 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059479032000000001 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030894+0000", 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5006999999999999e-05 2024-09-14T08:39:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030959+0000", 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4443999999999995e-05 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8155 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3709952~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.971392+0000", 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8705694500000001, 2024-09-14T08:39:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059661701999999997, 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8155 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971392+0000", 2024-09-14T08:39:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971392+0000", 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971486+0000", 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3655999999999999e-05 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971491+0000", 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6310000000000002e-06 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971512+0000", 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1359e-05 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971528+0000", 2024-09-14T08:39:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6047000000000001e-05 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.030975+0000", 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059447302 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031011+0000", 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5834000000000003e-05 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031054+0000", 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2873000000000001e-05 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8156 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3756032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.971542+0000", 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.87042018, 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059624149000000001, 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8156 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971542+0000", 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971542+0000", 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971751+0000", 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020895199999999999 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971755+0000", 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7269999999999998e-06 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971773+0000", 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7974000000000001e-05 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971782+0000", 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7700000000000007e-06 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031069+0000", 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059286876000000002 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031105+0000", 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6430000000000002e-05 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031166+0000", 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0420000000000001e-05 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8158 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3767296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.971839+0000", 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8701231090000001, 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059671670000000003, 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8158 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971839+0000", 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971839+0000", 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971839+0000", 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2200000000000003e-07 2024-09-14T08:39:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971842+0000", 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9340000000000002e-06 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971851+0000", 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2579999999999995e-06 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971857+0000", 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.993e-06 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031276+0000", 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059419268999999997 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031310+0000", 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4595000000000003e-05 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031510+0000", 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019989899999999999 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8159 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3732480~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.971865+0000", 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8700971200000001, 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059825649000000002, 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8159 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971865+0000", 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.971865+0000", 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972081+0000", 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000216505 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972092+0000", 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380999999999999e-05 2024-09-14T08:39:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972103+0000", 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.152e-05 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972111+0000", 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5719999999999997e-06 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031538+0000", 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059427527000000001 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031608+0000", 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9911000000000002e-05 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031690+0000", 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2232999999999997e-05 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.917 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8160 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3778560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.972124+0000", 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8698373940000002, 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059772171999999998, 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.918 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8160 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972124+0000", 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972124+0000", 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972188+0000", 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3639999999999994e-05 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972192+0000", 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3220000000000003e-06 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972202+0000", 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6909999999999992e-06 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972209+0000", 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8800000000000002e-06 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031723+0000", 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059513976000000003 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031798+0000", 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4913000000000006e-05 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031897+0000", 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8750000000000002e-05 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8161 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3789824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.922 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.972234+0000", 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8697273160000001, 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059848661999999997, 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8161 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972234+0000", 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972234+0000", 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972349+0000", 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114363 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972354+0000", 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1739999999999999e-06 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972368+0000", 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3779e-05 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972375+0000", 2024-09-14T08:39:47.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4710000000000001e-06 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031925+0000", 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059549684999999998 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.031999+0000", 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4136999999999998e-05 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.032083+0000", 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4053000000000003e-05 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4612.0:8162 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 3743744~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:43.972388+0000", 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.869573516, 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.060158670999999997, 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:47.927 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4612", 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8162 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972388+0000", 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972388+0000", 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972585+0000", 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000196493 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972589+0000", 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3229999999999999e-06 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972600+0000", 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0682999999999999e-05 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:43.972607+0000", 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1930000000000004e-06 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.032365+0000", 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.059757617999999998 2024-09-14T08:39:47.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.032443+0000", 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8411999999999994e-05 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:44.032547+0000", 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103949 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:47.932 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:47.932 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:47.933 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:47.934 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:47.935+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:47.984 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-14T08:39:48.034 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:48.035+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:48.080 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:277 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.070751+0000", 2024-09-14T08:39:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0078265269999999998, 2024-09-14T08:39:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0078673349999999996, 2024-09-14T08:39:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 277 2024-09-14T08:39:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070751+0000", 2024-09-14T08:39:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070751+0000", 2024-09-14T08:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070752+0000", 2024-09-14T08:39:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.204e-06 2024-09-14T08:39:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070768+0000", 2024-09-14T08:39:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6494000000000002e-05 2024-09-14T08:39:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070786+0000", 2024-09-14T08:39:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7686999999999999e-05 2024-09-14T08:39:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070799+0000", 2024-09-14T08:39:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:39:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:310 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072560+0000", 2024-09-14T08:39:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0060167650000000003, 2024-09-14T08:39:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061811399999999999, 2024-09-14T08:39:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 310 2024-09-14T08:39:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072560+0000", 2024-09-14T08:39:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072560+0000", 2024-09-14T08:39:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072562+0000", 2024-09-14T08:39:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769999999999999e-06 2024-09-14T08:39:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072567+0000", 2024-09-14T08:39:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:39:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072586+0000", 2024-09-14T08:39:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8902999999999998e-05 2024-09-14T08:39:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072599+0000", 2024-09-14T08:39:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3195e-05 2024-09-14T08:39:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:279 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.070817+0000", 2024-09-14T08:39:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0077601329999999998, 2024-09-14T08:39:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0080349710000000001, 2024-09-14T08:39:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 279 2024-09-14T08:39:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070817+0000", 2024-09-14T08:39:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070817+0000", 2024-09-14T08:39:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070818+0000", 2024-09-14T08:39:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.176e-06 2024-09-14T08:39:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070823+0000", 2024-09-14T08:39:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9060000000000001e-06 2024-09-14T08:39:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070839+0000", 2024-09-14T08:39:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5914999999999999e-05 2024-09-14T08:39:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070854+0000", 2024-09-14T08:39:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4714e-05 2024-09-14T08:39:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:311 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072616+0000", 2024-09-14T08:39:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0059612600000000003, 2024-09-14T08:39:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0063245640000000004, 2024-09-14T08:39:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 311 2024-09-14T08:39:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072616+0000", 2024-09-14T08:39:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072616+0000", 2024-09-14T08:39:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072617+0000", 2024-09-14T08:39:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.15e-06 2024-09-14T08:39:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072622+0000", 2024-09-14T08:39:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9699999999999998e-06 2024-09-14T08:39:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072639+0000", 2024-09-14T08:39:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6957e-05 2024-09-14T08:39:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072652+0000", 2024-09-14T08:39:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2707999999999999e-05 2024-09-14T08:39:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:280 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.070870+0000", 2024-09-14T08:39:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0077072549999999997, 2024-09-14T08:39:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0081821659999999994, 2024-09-14T08:39:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 280 2024-09-14T08:39:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070870+0000", 2024-09-14T08:39:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070870+0000", 2024-09-14T08:39:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070871+0000", 2024-09-14T08:39:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1069999999999999e-06 2024-09-14T08:39:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070876+0000", 2024-09-14T08:39:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8790000000000002e-06 2024-09-14T08:39:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070892+0000", 2024-09-14T08:39:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5940999999999999e-05 2024-09-14T08:39:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070905+0000", 2024-09-14T08:39:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2788e-05 2024-09-14T08:39:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:312 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072668+0000", 2024-09-14T08:39:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.005909404, 2024-09-14T08:39:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064830499999999998, 2024-09-14T08:39:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 312 2024-09-14T08:39:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072668+0000", 2024-09-14T08:39:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072668+0000", 2024-09-14T08:39:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072669+0000", 2024-09-14T08:39:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.006e-06 2024-09-14T08:39:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072674+0000", 2024-09-14T08:39:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7160000000000002e-06 2024-09-14T08:39:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072690+0000", 2024-09-14T08:39:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6347000000000001e-05 2024-09-14T08:39:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072705+0000", 2024-09-14T08:39:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5508000000000001e-05 2024-09-14T08:39:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:281 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.070936+0000", 2024-09-14T08:39:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.007641508, 2024-09-14T08:39:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0083162310000000003, 2024-09-14T08:39:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 281 2024-09-14T08:39:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070936+0000", 2024-09-14T08:39:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070936+0000", 2024-09-14T08:39:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070937+0000", 2024-09-14T08:39:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1659999999999999e-06 2024-09-14T08:39:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070942+0000", 2024-09-14T08:39:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9899999999999997e-06 2024-09-14T08:39:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070958+0000", 2024-09-14T08:39:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6079999999999999e-05 2024-09-14T08:39:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070972+0000", 2024-09-14T08:39:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3818000000000001e-05 2024-09-14T08:39:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:315 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073365+0000", 2024-09-14T08:39:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0052124850000000002, 2024-09-14T08:39:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059827939999999996, 2024-09-14T08:39:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 315 2024-09-14T08:39:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073365+0000", 2024-09-14T08:39:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073365+0000", 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073366+0000", 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6300000000000001e-06 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073374+0000", 2024-09-14T08:39:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8290000000000008e-06 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073400+0000", 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5772e-05 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073416+0000", 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6328e-05 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:282 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.070990+0000", 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00758714, 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084582330000000008, 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 282 2024-09-14T08:39:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070990+0000", 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070990+0000", 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070991+0000", 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1459999999999999e-06 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.070997+0000", 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2830000000000001e-06 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071014+0000", 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7651000000000001e-05 2024-09-14T08:39:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071027+0000", 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3288000000000001e-05 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:316 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073440+0000", 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0051368059999999998, 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061152899999999998, 2024-09-14T08:39:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 316 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073440+0000", 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073440+0000", 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073442+0000", 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1289999999999999e-06 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073447+0000", 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1830000000000002e-06 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073464+0000", 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6917000000000001e-05 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073477+0000", 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3108000000000001e-05 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:283 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071044+0000", 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0075328349999999999, 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0086031679999999996, 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 283 2024-09-14T08:39:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071044+0000", 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071044+0000", 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071046+0000", 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.11e-06 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071051+0000", 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0819999999999998e-06 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071067+0000", 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6418000000000001e-05 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071080+0000", 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2845e-05 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.079640+0000", 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085605469999999999 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:317 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073522+0000", 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0050552030000000003, 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062237270000000001, 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 317 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073522+0000", 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073522+0000", 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073523+0000", 2024-09-14T08:39:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073529+0000", 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7119999999999997e-06 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073547+0000", 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7974000000000001e-05 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073561+0000", 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3587999999999999e-05 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:284 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071112+0000", 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0074650020000000001, 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0087553040000000002, 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 284 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071112+0000", 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071112+0000", 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071113+0000", 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1799999999999999e-06 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071118+0000", 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0159999999999999e-06 2024-09-14T08:39:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071136+0000", 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7173999999999999e-05 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071149+0000", 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3050999999999999e-05 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.079854+0000", 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0087053089999999996 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:318 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073579+0000", 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0049983010000000001, 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064526180000000002, 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 318 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073579+0000", 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073579+0000", 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073580+0000", 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.223e-06 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073585+0000", 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1159999999999998e-06 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073602+0000", 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6217000000000001e-05 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073614+0000", 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2908000000000001e-05 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:285 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071165+0000", 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0074117669999999997, 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0090186799999999994, 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 285 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071165+0000", 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071165+0000", 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071167+0000", 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.153e-06 2024-09-14T08:39:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071171+0000", 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.763e-06 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071187+0000", 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6033999999999999e-05 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071200+0000", 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2707999999999999e-05 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:319 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073631+0000", 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0049466420000000002, 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067041189999999997, 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 319 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073631+0000", 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073631+0000", 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073632+0000", 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.083e-06 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073637+0000", 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9620000000000001e-06 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073653+0000", 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6067999999999999e-05 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073666+0000", 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2831e-05 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:286 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071216+0000", 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0073610680000000001, 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092601530000000001, 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 286 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071216+0000", 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071216+0000", 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071217+0000", 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1200000000000001e-06 2024-09-14T08:39:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071222+0000", 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8230000000000002e-06 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071239+0000", 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.649e-05 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071251+0000", 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2695e-05 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:320 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073682+0000", 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0048954130000000004, 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069134299999999999, 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 320 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073682+0000", 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073682+0000", 2024-09-14T08:39:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073683+0000", 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9900000000000009e-07 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073688+0000", 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7160000000000002e-06 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073705+0000", 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7027000000000001e-05 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073717+0000", 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2232000000000001e-05 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:287 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071269+0000", 2024-09-14T08:39:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0073084329999999996, 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0094115099999999997, 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 287 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071269+0000", 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071269+0000", 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071270+0000", 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2300000000000001e-06 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071275+0000", 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5959999999999997e-06 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071291+0000", 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6396999999999999e-05 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071304+0000", 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2867999999999999e-05 2024-09-14T08:39:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.080681+0000", 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0093775430000000003 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:321 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073735+0000", 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.004842135, 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070425039999999998, 2024-09-14T08:39:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 321 2024-09-14T08:39:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073735+0000", 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073735+0000", 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073736+0000", 2024-09-14T08:39:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2589999999999999e-06 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073742+0000", 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.993e-06 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073760+0000", 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7747000000000001e-05 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073773+0000", 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3345e-05 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:288 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071320+0000", 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0072569770000000004, 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0095963009999999998, 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 288 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071320+0000", 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071320+0000", 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071321+0000", 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046e-06 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071326+0000", 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7099999999999998e-06 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071342+0000", 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6183000000000001e-05 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071355+0000", 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2785e-05 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.080880+0000", 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0095254490000000001 2024-09-14T08:39:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:322 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073791+0000", 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0047863239999999998, 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072898759999999998, 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 322 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073791+0000", 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073791+0000", 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073792+0000", 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.294e-06 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073797+0000", 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6949999999999999e-06 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073813+0000", 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6174000000000001e-05 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073826+0000", 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2815e-05 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:289 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071371+0000", 2024-09-14T08:39:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0072061679999999998, 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0098603040000000003, 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 289 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071371+0000", 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071371+0000", 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071372+0000", 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0130000000000001e-06 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071377+0000", 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6890000000000003e-06 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071393+0000", 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6133999999999998e-05 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071406+0000", 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2872e-05 2024-09-14T08:39:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:323 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073844+0000", 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0047328179999999997, 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.007536081, 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 323 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073844+0000", 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073844+0000", 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073845+0000", 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0359999999999999e-06 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073850+0000", 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7230000000000004e-06 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073866+0000", 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6220000000000001e-05 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073879+0000", 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2635e-05 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:290 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071422+0000", 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.007155186, 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010066152, 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 290 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071422+0000", 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071422+0000", 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071423+0000", 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0529999999999999e-06 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071438+0000", 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4647999999999999e-05 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071456+0000", 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8213999999999999e-05 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071469+0000", 2024-09-14T08:39:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3494e-05 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:324 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073896+0000", 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.004681686, 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076976029999999999, 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 324 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073896+0000", 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073896+0000", 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073897+0000", 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9900000000000009e-07 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073901+0000", 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6859999999999997e-06 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073918+0000", 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6687000000000001e-05 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073932+0000", 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3628000000000001e-05 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:291 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071488+0000", 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0070892459999999996, 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010187297, 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 291 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071488+0000", 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071488+0000", 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071489+0000", 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3e-06 2024-09-14T08:39:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071494+0000", 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0849999999999996e-06 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071511+0000", 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6891000000000001e-05 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071525+0000", 2024-09-14T08:39:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3514e-05 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.081681+0000", 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010156480000000001 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:325 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.073950+0000", 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0046275120000000003, 2024-09-14T08:39:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0078176719999999995, 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 325 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073950+0000", 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073950+0000", 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073951+0000", 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.11e-06 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073956+0000", 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1490000000000002e-06 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073973+0000", 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6611000000000001e-05 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.073986+0000", 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3672000000000001e-05 2024-09-14T08:39:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:292 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071543+0000", 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.007034022, 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010338610999999999, 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 292 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071543+0000", 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071543+0000", 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071544+0000", 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0729999999999999e-06 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071549+0000", 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9429999999999999e-06 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071566+0000", 2024-09-14T08:39:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6473999999999998e-05 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071579+0000", 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2845e-05 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.081893+0000", 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010314088000000001 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:326 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.074003+0000", 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0045744799999999997, 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0080448340000000007, 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 326 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074003+0000", 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074003+0000", 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074004+0000", 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04e-06 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074018+0000", 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4538e-05 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074036+0000", 2024-09-14T08:39:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7387000000000001e-05 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074049+0000", 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2945000000000001e-05 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:293 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071595+0000", 2024-09-14T08:39:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0069826489999999996, 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010616651, 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 293 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071595+0000", 2024-09-14T08:39:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071595+0000", 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071596+0000", 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7600000000000006e-07 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071600+0000", 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.853e-06 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071617+0000", 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6169999999999999e-05 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071629+0000", 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2892e-05 2024-09-14T08:39:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:327 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.074066+0000", 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0045116660000000001, 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0082965609999999992, 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 327 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074066+0000", 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074066+0000", 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074067+0000", 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1400000000000001e-06 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074072+0000", 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2290000000000002e-06 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074088+0000", 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6401000000000001e-05 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074101+0000", 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2628e-05 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:294 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071646+0000", 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0069314870000000001, 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010824551999999999, 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 294 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071646+0000", 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071646+0000", 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071647+0000", 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1629999999999999e-06 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071652+0000", 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.809e-06 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071668+0000", 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6061000000000001e-05 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071680+0000", 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2658e-05 2024-09-14T08:39:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:328 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.074118+0000", 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0044588309999999999, 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084512770000000001, 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 328 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074118+0000", 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074118+0000", 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074120+0000", 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2300000000000001e-06 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074125+0000", 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1259999999999997e-06 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074142+0000", 2024-09-14T08:39:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7637000000000001e-05 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074156+0000", 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3185e-05 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:295 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 43008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071697+0000", 2024-09-14T08:39:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0068806620000000001, 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011117138, 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 295 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071697+0000", 2024-09-14T08:39:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071697+0000", 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071698+0000", 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071703+0000", 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071719+0000", 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6223999999999999e-05 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071732+0000", 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2690999999999999e-05 2024-09-14T08:39:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.082708+0000", 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010976479000000001 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:329 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.074177+0000", 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0044007200000000003, 2024-09-14T08:39:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0088057670000000008, 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 329 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074177+0000", 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074177+0000", 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074178+0000", 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1799999999999999e-06 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074183+0000", 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0490000000000003e-06 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074199+0000", 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6418000000000001e-05 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074212+0000", 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3141e-05 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:296 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071748+0000", 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0068294360000000004, 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011394071, 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 296 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071748+0000", 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071748+0000", 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071749+0000", 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0330000000000001e-06 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071754+0000", 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6959999999999996e-06 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071769+0000", 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5940999999999999e-05 2024-09-14T08:39:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071782+0000", 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2651e-05 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:330 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.074228+0000", 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0043487739999999997, 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0090601339999999992, 2024-09-14T08:39:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 330 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074228+0000", 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074228+0000", 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074229+0000", 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.003e-06 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074234+0000", 2024-09-14T08:39:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8790000000000002e-06 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074250+0000", 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6056999999999999e-05 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074263+0000", 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2788e-05 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:297 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071818+0000", 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0067589169999999997, 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011574920000000001, 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 297 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071818+0000", 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071818+0000", 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071820+0000", 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.263e-06 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071825+0000", 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0590000000000002e-06 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071843+0000", 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8804000000000002e-05 2024-09-14T08:39:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071857+0000", 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3484e-05 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:331 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.074279+0000", 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0042981449999999997, 2024-09-14T08:39:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092052910000000009, 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 331 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074279+0000", 2024-09-14T08:39:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074279+0000", 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074280+0000", 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2389999999999999e-06 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074285+0000", 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.87e-06 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074301+0000", 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6067e-05 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074314+0000", 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2374999999999999e-05 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:298 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071876+0000", 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0067016929999999999, 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011694459000000001, 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 298 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071876+0000", 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071876+0000", 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071877+0000", 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071881+0000", 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.69e-06 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071897+0000", 2024-09-14T08:39:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6124e-05 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071910+0000", 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2798e-05 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.083582+0000", 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011671531000000001 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:332 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.074331+0000", 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0042459530000000002, 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0093438059999999996, 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 332 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074331+0000", 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074331+0000", 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074332+0000", 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0589999999999999e-06 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074338+0000", 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1599999999999997e-06 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074356+0000", 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8099999999999999e-05 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074369+0000", 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3568e-05 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:299 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.071928+0000", 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0066488340000000002, 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011872608, 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071928+0000", 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071928+0000", 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071930+0000", 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1200000000000001e-06 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071935+0000", 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:39:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071954+0000", 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9803e-05 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.071968+0000", 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3331e-05 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.083791+0000", 2024-09-14T08:39:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011823026 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:333 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.074387+0000", 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0041904389999999998, 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0095789570000000008, 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 333 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074387+0000", 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074387+0000", 2024-09-14T08:39:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074388+0000", 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.06e-06 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074393+0000", 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0819999999999998e-06 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074409+0000", 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6475000000000001e-05 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074422+0000", 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2835e-05 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:300 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072003+0000", 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0065744790000000003, 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012123096, 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 300 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072003+0000", 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072003+0000", 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072004+0000", 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2500000000000001e-06 2024-09-14T08:39:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072010+0000", 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6829999999999996e-06 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072028+0000", 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7819999999999999e-05 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072041+0000", 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3551e-05 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:334 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.074438+0000", 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0041388270000000003, 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0098377480000000003, 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 334 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074438+0000", 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074438+0000", 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074440+0000", 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.127e-06 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074445+0000", 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2220000000000001e-06 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074461+0000", 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6028e-05 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074474+0000", 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2801e-05 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:301 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072058+0000", 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0065190939999999996, 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012347042000000001, 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 301 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072058+0000", 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072058+0000", 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072059+0000", 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1030000000000001e-06 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072064+0000", 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7829999999999998e-06 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072080+0000", 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6004000000000001e-05 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072093+0000", 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2585000000000001e-05 2024-09-14T08:39:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:338 3.14 3.be714b54 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.074490+0000", 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0040870719999999998, 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010007726, 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 338 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074490+0000", 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074490+0000", 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074491+0000", 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.08e-06 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074496+0000", 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7260000000000002e-06 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074512+0000", 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6314999999999999e-05 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.074526+0000", 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3648e-05 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:302 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072109+0000", 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.006468428, 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01246474, 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 302 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072109+0000", 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072109+0000", 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072110+0000", 2024-09-14T08:39:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0389999999999999e-06 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072126+0000", 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6158e-05 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072143+0000", 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6977e-05 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072156+0000", 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2695e-05 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:303 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072173+0000", 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.006404201, 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012524184000000001, 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 303 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072173+0000", 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072173+0000", 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072174+0000", 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-06 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072179+0000", 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8319999999999996e-06 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072195+0000", 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072208+0000", 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2738000000000001e-05 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:304 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072224+0000", 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0063529329999999998, 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012623583000000001, 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 304 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072224+0000", 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072224+0000", 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072225+0000", 2024-09-14T08:39:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0869999999999999e-06 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072230+0000", 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7219999999999999e-06 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072246+0000", 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5770999999999999e-05 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072259+0000", 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2755000000000001e-05 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:305 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072275+0000", 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0063025269999999996, 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012732322000000001, 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 305 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072275+0000", 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072275+0000", 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072276+0000", 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046e-06 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072280+0000", 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.583e-06 2024-09-14T08:39:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072297+0000", 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6433999999999999e-05 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072309+0000", 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2695e-05 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:306 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072325+0000", 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0062520520000000001, 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012831317, 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 306 2024-09-14T08:39:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072325+0000", 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072325+0000", 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072326+0000", 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2699999999999999e-06 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072331+0000", 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4490000000000001e-06 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072347+0000", 2024-09-14T08:39:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6098000000000001e-05 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072360+0000", 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2880999999999999e-05 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:307 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072395+0000", 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0061819020000000004, 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012903125999999999, 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 307 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072395+0000", 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072395+0000", 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072397+0000", 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.189e-06 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072402+0000", 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4399999999999996e-06 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072420+0000", 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7626999999999999e-05 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072436+0000", 2024-09-14T08:39:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6736999999999999e-05 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:308 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072454+0000", 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0061231050000000002, 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01294726, 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 308 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072454+0000", 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072454+0000", 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072455+0000", 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04e-06 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072460+0000", 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8060000000000002e-06 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072477+0000", 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6560999999999999e-05 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072489+0000", 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2368000000000001e-05 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:309 3.14 3.68aff754 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:48.072506+0000", 2024-09-14T08:39:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0060717330000000002, 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013004081000000001, 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 309 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072506+0000", 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072506+0000", 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072507+0000", 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2699999999999999e-06 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072512+0000", 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2159999999999997e-06 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072530+0000", 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7561e-05 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:48.072543+0000", 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3563999999999999e-05 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:39:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 56 2024-09-14T08:39:48.316 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:48.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:48.318 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:48.321+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:48.418 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:48.419+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:48.497 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:48.497 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:48.511 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:48.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:39:48.556 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:48.561+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:48.620 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:48.621+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4281 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4622336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.707950+0000", 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9589779250000001, 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089297110999999998, 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4281 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.707950+0000", 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.707950+0000", 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.707951+0000", 2024-09-14T08:39:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6599999999999996e-07 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.707954+0000", 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.039e-06 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.707962+0000", 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7020000000000001e-06 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.707967+0000", 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2700000000000004e-06 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797104+0000", 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089136961000000001 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797169+0000", 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5103000000000003e-05 2024-09-14T08:39:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797248+0000", 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8369999999999997e-05 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4282 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4432896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.707974+0000", 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9589541759999998, 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089462215999999997, 2024-09-14T08:39:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4282 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.707974+0000", 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.707974+0000", 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.707975+0000", 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7700000000000005e-07 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.707996+0000", 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1112e-05 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708004+0000", 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2740000000000007e-06 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708010+0000", 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.032e-06 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797295+0000", 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089285340000000005 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797359+0000", 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4060999999999995e-05 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797436+0000", 2024-09-14T08:39:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6920000000000002e-05 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4283 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4633600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.708025+0000", 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.958903437, 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089602493000000005, 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4283 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708025+0000", 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708025+0000", 2024-09-14T08:39:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708026+0000", 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708030+0000", 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7790000000000002e-06 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708039+0000", 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1810000000000007e-06 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708044+0000", 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2769999999999996e-06 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797481+0000", 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089437442000000006 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797544+0000", 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2280999999999995e-05 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797627+0000", 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3634999999999995e-05 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4284 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4444160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.708054+0000", 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.958874604, 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089775077999999994, 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4284 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708054+0000", 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708054+0000", 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708055+0000", 2024-09-14T08:39:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1599999999999999e-06 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708069+0000", 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3927999999999999e-05 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708082+0000", 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3212e-05 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708092+0000", 2024-09-14T08:39:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0017000000000001e-05 2024-09-14T08:39:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797672+0000", 2024-09-14T08:39:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089580079000000007 2024-09-14T08:39:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797738+0000", 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5939999999999995e-05 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797829+0000", 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0742000000000006e-05 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4285 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4644864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.708146+0000", 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9587826020000003, 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089894654000000004, 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4285 2024-09-14T08:39:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708146+0000", 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708146+0000", 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708147+0000", 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708152+0000", 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0849999999999996e-06 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708182+0000", 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0516999999999999e-05 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708195+0000", 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2364999999999999e-05 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797875+0000", 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089680147000000002 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.797943+0000", 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7875999999999999e-05 2024-09-14T08:39:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798040+0000", 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7527000000000003e-05 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4286 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4455424~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.708213+0000", 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9587155769999995, 2024-09-14T08:39:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.090033420000000003, 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4286 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708213+0000", 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708213+0000", 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708214+0000", 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.167e-06 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708219+0000", 2024-09-14T08:39:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6959999999999996e-06 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708232+0000", 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543000000000001e-05 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708256+0000", 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798086+0000", 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089830122999999998 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798155+0000", 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9314999999999996e-05 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798246+0000", 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1248000000000005e-05 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4287 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4656128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.708302+0000", 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9586267900000003, 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.090155984999999994, 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4287 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708302+0000", 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708302+0000", 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708303+0000", 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.393e-06 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708317+0000", 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.363e-05 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708332+0000", 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5418e-05 2024-09-14T08:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708357+0000", 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5313e-05 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798292+0000", 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089934441000000004 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798364+0000", 2024-09-14T08:39:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2391000000000005e-05 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798458+0000", 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3399000000000005e-05 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4289 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4667392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.708390+0000", 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9585386859999998, 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.090278886000000003, 2024-09-14T08:39:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4289 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708390+0000", 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708390+0000", 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708391+0000", 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.097e-06 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708396+0000", 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3329999999999996e-06 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708411+0000", 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5311999999999998e-05 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708422+0000", 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0779e-05 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798504+0000", 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.090081464 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798571+0000", 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7730000000000004e-05 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798669+0000", 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7170999999999995e-05 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4290 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4678656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.708481+0000", 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9584468719999997, 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.090594866999999996, 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4290 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708481+0000", 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708481+0000", 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708855+0000", 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037315200000000002 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708861+0000", 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0560000000000001e-06 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708880+0000", 2024-09-14T08:39:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9419000000000002e-05 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708889+0000", 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8319999999999995e-06 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798740+0000", 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089851451999999998 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.798894+0000", 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153843 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.799076+0000", 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182113 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4292 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4689920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.708932+0000", 2024-09-14T08:39:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9579962789999996, 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.090444688999999995, 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4292 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708932+0000", 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.708932+0000", 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709795+0000", 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086247099999999996 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709803+0000", 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709819+0000", 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5147000000000001e-05 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709828+0000", 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6460000000000005e-06 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.799152+0000", 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089323430999999995 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.799274+0000", 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122033 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.799377+0000", 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010302999999999999 2024-09-14T08:39:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4294 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4701184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.709848+0000", 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.957080436, 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089902335999999999, 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4294 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709848+0000", 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709848+0000", 2024-09-14T08:39:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709849+0000", 2024-09-14T08:39:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.031e-06 2024-09-14T08:39:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709852+0000", 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9019999999999999e-06 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709860+0000", 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6939999999999995e-06 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709893+0000", 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3370000000000001e-05 2024-09-14T08:39:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.799444+0000", 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089550606000000005 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.799573+0000", 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129178 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.799750+0000", 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000177555 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4295 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4712448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.709906+0000", 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9570224239999998, 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.090029277000000005, 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4295 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709906+0000", 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.709906+0000", 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710218+0000", 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031255699999999998 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710226+0000", 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3259999999999998e-06 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710241+0000", 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5545000000000001e-05 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710254+0000", 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3098999999999999e-05 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.799778+0000", 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089523851000000002 2024-09-14T08:39:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.799847+0000", 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8528000000000005e-05 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.799935+0000", 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8370999999999998e-05 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4340 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4197376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.710277+0000", 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.956650915, 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.090022860999999996, 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4340 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710277+0000", 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710277+0000", 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710545+0000", 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026750500000000002 2024-09-14T08:39:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710557+0000", 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1827999999999999e-05 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710576+0000", 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9658000000000001e-05 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710589+0000", 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2296000000000001e-05 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.800009+0000", 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089420453999999996 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.800128+0000", 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118813 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.800300+0000", 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017230699999999999 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4343 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4208640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.710613+0000", 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9563153870000001, 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089933974999999999, 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4343 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710613+0000", 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.710613+0000", 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711091+0000", 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047844199999999998 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711100+0000", 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3739999999999998e-06 2024-09-14T08:39:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711116+0000", 2024-09-14T08:39:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5954999999999999e-05 2024-09-14T08:39:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711128+0000", 2024-09-14T08:39:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2713e-05 2024-09-14T08:39:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.800353+0000", 2024-09-14T08:39:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089224699000000005 2024-09-14T08:39:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.800436+0000", 2024-09-14T08:39:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2515000000000005e-05 2024-09-14T08:39:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.800547+0000", 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111277 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4344 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4219904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.711152+0000", 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9557763819999998, 2024-09-14T08:39:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089789463999999999, 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4344 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711152+0000", 2024-09-14T08:39:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711152+0000", 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711461+0000", 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030894400000000002 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711482+0000", 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711495+0000", 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2976000000000001e-05 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711527+0000", 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1948e-05 2024-09-14T08:39:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.800610+0000", 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089082827000000003 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.800785+0000", 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017469600000000001 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.800941+0000", 2024-09-14T08:39:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000156775 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4345 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4231168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.711547+0000", 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9553814999999997, 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089728194999999997, 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4345 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711547+0000", 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711547+0000", 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711915+0000", 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036807700000000002 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711922+0000", 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.294e-06 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711954+0000", 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1668999999999998e-05 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711966+0000", 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2108e-05 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.801019+0000", 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089053120999999999 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.801134+0000", 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115011 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.801275+0000", 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000140915 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4347 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4242432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.711988+0000", 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9549402300000001, 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089661520999999994, 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4347 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711988+0000", 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.711988+0000", 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.712249+0000", 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026066099999999998 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.712255+0000", 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5649999999999998e-06 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.712267+0000", 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1984000000000001e-05 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.712276+0000", 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8410000000000006e-06 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.801362+0000", 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089085665999999994 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.801503+0000", 2024-09-14T08:39:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000140949 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.801650+0000", 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014685499999999999 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4348 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4253696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.712293+0000", 2024-09-14T08:39:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9546357560000001, 2024-09-14T08:39:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089662040999999998, 2024-09-14T08:39:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4348 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.712293+0000", 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.712293+0000", 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713088+0000", 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00079497599999999997 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713096+0000", 2024-09-14T08:39:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3559999999999993e-06 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713117+0000", 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0937e-05 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713132+0000", 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4659e-05 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.801711+0000", 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088579833999999996 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.801836+0000", 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000125017 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.801955+0000", 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118262 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4351 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4276224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.713247+0000", 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9536813009999996, 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089295991000000005, 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4351 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713247+0000", 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713247+0000", 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713526+0000", 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027861900000000002 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713531+0000", 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8559999999999998e-06 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713542+0000", 2024-09-14T08:39:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1858999999999999e-05 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713559+0000", 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6274e-05 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.802251+0000", 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088692574999999996 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.802383+0000", 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013176799999999999 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.802543+0000", 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016003999999999999 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:4353 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4287488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:43.713580+0000", 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.95334816, 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089320160999999995, 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4353 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713580+0000", 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713580+0000", 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713962+0000", 2024-09-14T08:39:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038187099999999999 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713968+0000", 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2149999999999998e-06 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713986+0000", 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7853999999999999e-05 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.713997+0000", 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0541e-05 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.802640+0000", 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088643496000000002 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.802758+0000", 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117924 2024-09-14T08:39:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:43.802900+0000", 2024-09-14T08:39:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014226000000000001 2024-09-14T08:39:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:48.756 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:48.757 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:39:48.758 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:39:48.758 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:48.759 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:48.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:48.759 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:48.761+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:48.760 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:48.760 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:48.773 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:48.774 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:48.806 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:48.806 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:48.826 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:48.826 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:48.858 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:48.859+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:48.938 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:48.938 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:48.955 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:49.000 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:49.005+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:49.060 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:49.061+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:49.087 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:49.087 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:49.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:49.161 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:49.163+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:49.262 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:49.263+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:49.280 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:49.280 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:49.299 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:49.363 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:39:49.367+0000 7f2d02cc4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25234) UID: 0 2024-09-14T08:39:49.425 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:49.425 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:49.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:49.463 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:49.467+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:49.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:39:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:49.583 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:49.587+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:49.585 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:49.665 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:49.669+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:49.726 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:49.726 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:49.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:39:49.789 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:49.793+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:49.868 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:49.871+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:49.880 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:49.881 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:49.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:39:49.968 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:49.973+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:50.055 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:50.055 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:50.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:39:50.070 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:50.073+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:50.170 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:50.173+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:50.197 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:50.197 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:50.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:50.272 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:50.273+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:50.347 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:50.347 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:50.366 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:50.373 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:50.377+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:50.473 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:50.474+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:50.504 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:50.505 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:50.521 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:50.534 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:39:50.574 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:50.577+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:50.675 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:50.677+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:50.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:50.749 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T08:39:50.749 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:39:50.749 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2, 3, 4, 5] 2024-09-14T08:39:50.750 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T08:39:50.750 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:39:50.777 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:50.781+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:50.824 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:50.839 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T08:39:50.839 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.0 2024-09-14T08:39:50.839 INFO:tasks.thrashosds.thrasher:remote for osd 0 is ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:39:50.839 DEBUG:teuthology.orchestra.run.smithi089:> type ceph-objectstore-tool 2024-09-14T08:39:50.840 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:50.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:39:50.877 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:50.881+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T08:39:50.886 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --op list-pgs 2024-09-14T08:39:50.979 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:50.985+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:51.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:51.080 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:51.082+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:51.145 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:51.189 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:51.193+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:51.275 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:51.275 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:51.281 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:51.282+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:51.288 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:3.c 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:2.4 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:2.5 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:3.10 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:3.12 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:3.17 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:3.3 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:3.18 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:3.b 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:3.1 2024-09-14T08:39:51.345 INFO:teuthology.orchestra.run.smithi089.stdout:3.1b 2024-09-14T08:39:51.346 INFO:teuthology.orchestra.run.smithi089.stdout:3.1f 2024-09-14T08:39:51.346 INFO:teuthology.orchestra.run.smithi089.stdout:3.15 2024-09-14T08:39:51.346 INFO:teuthology.orchestra.run.smithi089.stdout:3.6 2024-09-14T08:39:51.382 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:51.385+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:51.456 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:51.456 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:51.470 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:51.483 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:51.486+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:51.584 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:51.586+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:51.640 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:51.640 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:51.654 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:51.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --op export --pgid 3.10 --file /var/log/ceph/exp.3.10.0 2024-09-14T08:39:51.699 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:51.702+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:51.771 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:51.771 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:51.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:51.785 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:51.789+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:51.885 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:51.889+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:51.951 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:51.952 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:51.967 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:52.009 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:52.013+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:52.088 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:52.089+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:Exporting 3.10 info 3.10( v 38'58 (0'0,38'58] local-lis/les=21/22 n=15 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) 2024-09-14T08:39:52.112 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:08cfbe6a:::rbd_data.10f15daa646d.0000000000000172:head# 2024-09-14T08:39:52.112 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:09df4e87:::rbd_data.10f15daa646d.0000000000000199:head# 2024-09-14T08:39:52.112 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0a8795d9:::rbd_data.10f1c460e0d1.0000000000000003:6# 2024-09-14T08:39:52.112 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0a8795d9:::rbd_data.10f1c460e0d1.0000000000000003:head# 2024-09-14T08:39:52.113 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0abb170d:::rbd_data.10f1c460e0d1.000000000000005a:6# 2024-09-14T08:39:52.114 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0abb170d:::rbd_data.10f1c460e0d1.000000000000005a:head# 2024-09-14T08:39:52.114 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0ac1fdf2:::rbd_data.10f15daa646d.0000000000000203:5# 2024-09-14T08:39:52.114 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0ac1fdf2:::rbd_data.10f15daa646d.0000000000000203:head# 2024-09-14T08:39:52.114 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0ad1568a:::rbd_object_map.10f15daa646d:head# 2024-09-14T08:39:52.114 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0b49b20a:::rbd_data.10f1cfbb7ac7.000000000000002a:head# 2024-09-14T08:39:52.117 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0b77e398:::rbd_data.10f1663ce16c.000000000000000f:head# 2024-09-14T08:39:52.118 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0c820393:::rbd_data.10f15daa646d.0000000000000171:head# 2024-09-14T08:39:52.118 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0ca79255:::rbd_data.10f14aaf0423.0000000000000272:head# 2024-09-14T08:39:52.118 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0d5bc723:::rbd_data.10f15daa646d.00000000000001d1:head# 2024-09-14T08:39:52.118 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0e40f4c4:::rbd_data.10f13f8886eb.0000000000000007:head# 2024-09-14T08:39:52.124 INFO:teuthology.orchestra.run.smithi089.stderr:Export successful 2024-09-14T08:39:52.132 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:52.132 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:52.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:52.193 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:52.197+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:52.272 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:52.272 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:52.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:52.290 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:52.293+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:52.390 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:52.393+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:52.406 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:52.406 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:52.420 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:52.423 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --force --op remove --pgid 3.10 2024-09-14T08:39:52.492 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:52.493+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:52.537 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:52.537 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:52.558 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:52.558 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:39:52.592 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:52.597+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:52.693 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:52.697+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:52.695 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:52.695 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:52.714 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:52.794 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:52.797+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:52.829 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:52.829 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:52.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:52.894 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:52.897+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:52.974 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:52.974 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:52.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:53.037 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:53.041+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:53.095 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:53.097+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:53.134 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:53.134 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:53.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:53.196 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:53.198+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:53.297 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:53.301+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:53.322 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:53.322 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:53.336 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:53.397 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:53.398+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:53.498 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:53.501+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:53.502 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:53.502 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:53.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:53.547 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:39:53.623 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:53.626+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:53.690 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:53.690 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:53.700 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:53.702+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:53.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:53.802 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:53.806+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:53.838 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:53.838 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:53.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:53.902 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:53.905+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:53.973 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:54.157 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:54.159 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:54.159 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:54.162+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:54.260 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:54.261+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:54.341 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:54.342 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:54.356 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:54.359 INFO:teuthology.orchestra.run.smithi089.stdout: marking collection for removal 2024-09-14T08:39:54.360 INFO:teuthology.orchestra.run.smithi089.stdout:setting '_remove' omap key 2024-09-14T08:39:54.360 INFO:teuthology.orchestra.run.smithi089.stdout:finish_remove_pgs 3.10_head removing 3.10 2024-09-14T08:39:54.360 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:54.366+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:54.362 INFO:teuthology.orchestra.run.smithi089.stdout:Remove successful 2024-09-14T08:39:54.461 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:54.465+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:54.527 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:54.528 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:54.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:54.561 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:54.566+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:54.662 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:54.665+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:54.706 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:54.706 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:54.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:54.768 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:54.774+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:54.850 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:54.850 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:54.864 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:54.865 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:54.865+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:54.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.10.0 2024-09-14T08:39:54.965 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:54.969+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:55.034 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:55.035 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:55.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:55.066 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:55.068+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:55.167 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:55.168+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:55.213 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:55.214 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:55.227 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:55.268 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:55.268+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:55.347 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:55.347 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:55.361 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:55.369 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:55.372+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:55.470 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:55.476+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:55.474 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:55.474 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:55.489 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:55.570 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:55.574+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:55.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:39:55.613 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:55.613 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:55.629 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:55.673 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:55.676+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:55.759 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:55.759 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:55.772 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:55.772+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:55.772 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:55.872 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:55.878+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:55.940 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:55.941 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:55.954 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:56.001 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:56.004+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:56.009 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:39:56.038 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:56.070 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:56.070 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:56.074 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:56.076+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:56.077 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:56.077 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:56.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:56.103 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:56.129 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:56.129 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:56.154 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:56.154 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:56.159 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:39:56.159 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:39:56.177 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:56.180+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:56.256 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:56.256 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:56.256 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:39:56.256 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:56.269 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:56.313 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:56.316+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:56.376 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:56.381+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:56.438 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:56.438 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:56.438 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:56.438 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:56.438 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:56.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:56.497 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:56.500+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:56.542 INFO:teuthology.orchestra.run.smithi089.stdout:get_pg_num_history pg_num_history pg_num_history(e40 pg_nums {1={13=1},2={16=8},3={21=32}} deleted_pools ) 2024-09-14T08:39:56.543 INFO:teuthology.orchestra.run.smithi089.stdout:Importing pgid 3.10 2024-09-14T08:39:56.543 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:08cfbe6a:::rbd_data.10f15daa646d.0000000000000172:head# 2024-09-14T08:39:56.543 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 5=[]:{} 2024-09-14T08:39:56.544 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:09df4e87:::rbd_data.10f15daa646d.0000000000000199:head# 2024-09-14T08:39:56.544 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 5=[]:{} 2024-09-14T08:39:56.547 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0a8795d9:::rbd_data.10f1c460e0d1.0000000000000003:6# 2024-09-14T08:39:56.550 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0a8795d9:::rbd_data.10f1c460e0d1.0000000000000003:head# 2024-09-14T08:39:56.550 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 6=[]:{6=[6]} 2024-09-14T08:39:56.553 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0abb170d:::rbd_data.10f1c460e0d1.000000000000005a:6# 2024-09-14T08:39:56.554 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0abb170d:::rbd_data.10f1c460e0d1.000000000000005a:head# 2024-09-14T08:39:56.554 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 6=[]:{6=[6]} 2024-09-14T08:39:56.554 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0ac1fdf2:::rbd_data.10f15daa646d.0000000000000203:5# 2024-09-14T08:39:56.555 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0ac1fdf2:::rbd_data.10f15daa646d.0000000000000203:head# 2024-09-14T08:39:56.555 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 5=[]:{5=[5]} 2024-09-14T08:39:56.556 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0ad1568a:::rbd_object_map.10f15daa646d:head# 2024-09-14T08:39:56.556 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 0=[]:{} 2024-09-14T08:39:56.556 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0b49b20a:::rbd_data.10f1cfbb7ac7.000000000000002a:head# 2024-09-14T08:39:56.558 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 0=[]:{} 2024-09-14T08:39:56.565 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0b77e398:::rbd_data.10f1663ce16c.000000000000000f:head# 2024-09-14T08:39:56.565 INFO:teuthology.orchestra.run.smithi089.stdout:snapset a=[]:{} 2024-09-14T08:39:56.569 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0c820393:::rbd_data.10f15daa646d.0000000000000171:head# 2024-09-14T08:39:56.569 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 5=[]:{} 2024-09-14T08:39:56.569 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0ca79255:::rbd_data.10f14aaf0423.0000000000000272:head# 2024-09-14T08:39:56.569 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 0=[]:{} 2024-09-14T08:39:56.571 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0d5bc723:::rbd_data.10f15daa646d.00000000000001d1:head# 2024-09-14T08:39:56.572 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 5=[]:{} 2024-09-14T08:39:56.572 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:56.573 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:56.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:56.573 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:56.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.573 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50435 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.573 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:39:56.573 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9993084979999995, 2024-09-14T08:39:56.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089137862999999998, 2024-09-14T08:39:56.574 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.574 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.574 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50435 2024-09-14T08:39:56.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.575 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:39:56.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577709+0000", 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2100000000000002e-06 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577718+0000", 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0180000000000007e-06 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577727+0000", 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8959999999999992e-06 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666826+0000", 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089099245999999993 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666843+0000", 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6702999999999999e-05 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50436 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577736+0000", 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9992768359999999, 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089177490999999998, 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50436 2024-09-14T08:39:56.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.580 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577736+0000", 2024-09-14T08:39:56.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577736+0000", 2024-09-14T08:39:56.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577737+0000", 2024-09-14T08:39:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.23e-07 2024-09-14T08:39:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577740+0000", 2024-09-14T08:39:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9459999999999998e-06 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577748+0000", 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3890000000000005e-06 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577755+0000", 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9659999999999999e-06 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666901+0000", 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089145996000000005 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666914+0000", 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2471e-05 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50437 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9992485210000002, 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089225676000000004, 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50437 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:39:56.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577768+0000", 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577777+0000", 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.259e-06 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577784+0000", 2024-09-14T08:39:56.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9619999999999996e-06 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666971+0000", 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089187113999999998 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666990+0000", 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9728000000000002e-05 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50438 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577793+0000", 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9992203879999995, 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089268996000000003, 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50438 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.588 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577793+0000", 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577793+0000", 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577794+0000", 2024-09-14T08:39:56.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1299999999999999e-07 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577796+0000", 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9459999999999998e-06 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577805+0000", 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3850000000000002e-06 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577812+0000", 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8059999999999997e-06 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667049+0000", 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089236920999999997 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667062+0000", 2024-09-14T08:39:56.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3225e-05 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50439 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577821+0000", 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9991918969999993, 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089313248999999997, 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.592 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50439 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577821+0000", 2024-09-14T08:39:56.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577821+0000", 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577822+0000", 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577844+0000", 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1877000000000001e-05 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577854+0000", 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9350000000000006e-06 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577861+0000", 2024-09-14T08:39:56.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2989999999999999e-06 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667117+0000", 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089255930999999997 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667135+0000", 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7496999999999999e-05 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50440 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577904+0000", 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9991090259999993, 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089307379000000006, 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.597 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50440 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577904+0000", 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577904+0000", 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577906+0000", 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.996e-06 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577912+0000", 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6420000000000004e-06 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577929+0000", 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7421000000000001e-05 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577943+0000", 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4059999999999999e-05 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667192+0000", 2024-09-14T08:39:56.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089248220000000003 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667212+0000", 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0040000000000001e-05 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.601 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50441 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577967+0000", 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9990462900000008, 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089318996999999997, 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50441 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.602 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577967+0000", 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577967+0000", 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577968+0000", 2024-09-14T08:39:56.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.133e-06 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577974+0000", 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.195e-06 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577995+0000", 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0404e-05 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578007+0000", 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2758000000000001e-05 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667269+0000", 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089261251999999999 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667286+0000", 2024-09-14T08:39:56.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50442 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578029+0000", 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9989844439999995, 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089325107000000001, 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.606 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50442 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578029+0000", 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578029+0000", 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578030+0000", 2024-09-14T08:39:56.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0300000000000001e-06 2024-09-14T08:39:56.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578035+0000", 2024-09-14T08:39:56.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4129999999999997e-06 2024-09-14T08:39:56.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578052+0000", 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6704000000000001e-05 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578068+0000", 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6393999999999999e-05 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667339+0000", 2024-09-14T08:39:56.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089270648999999994 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667354+0000", 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4917e-05 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50443 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578086+0000", 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9989268530000004, 2024-09-14T08:39:56.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089354797, 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50443 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578086+0000", 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578086+0000", 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578087+0000", 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.077e-06 2024-09-14T08:39:56.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578093+0000", 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6389999999999997e-06 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578115+0000", 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1625999999999999e-05 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578158+0000", 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3680000000000002e-05 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667424+0000", 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089265854000000006 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667441+0000", 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6920999999999999e-05 2024-09-14T08:39:56.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50444 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578199+0000", 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9988140080000001, 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089308203000000003, 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50444 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578199+0000", 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578199+0000", 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578201+0000", 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.407e-06 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578208+0000", 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9949999999999999e-06 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578234+0000", 2024-09-14T08:39:56.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6526e-05 2024-09-14T08:39:56.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578249+0000", 2024-09-14T08:39:56.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5234e-05 2024-09-14T08:39:56.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667495+0000", 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089245559000000002 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667507+0000", 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2482e-05 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50445 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578269+0000", 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9987437000000003, 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089310284000000004, 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50445 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578269+0000", 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578269+0000", 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578271+0000", 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4500000000000001e-06 2024-09-14T08:39:56.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578276+0000", 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4759999999999997e-06 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578295+0000", 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8153999999999999e-05 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578313+0000", 2024-09-14T08:39:56.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-14T08:39:56.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667563+0000", 2024-09-14T08:39:56.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089249980000000007 2024-09-14T08:39:56.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667580+0000", 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7244e-05 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50446 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578330+0000", 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9986829759999996, 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089312538999999996, 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.624 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.625 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.625 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50446 2024-09-14T08:39:56.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.625 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578330+0000", 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578330+0000", 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578332+0000", 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3060000000000001e-06 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578337+0000", 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2429999999999996e-06 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578356+0000", 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8867000000000001e-05 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578369+0000", 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3301e-05 2024-09-14T08:39:56.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667630+0000", 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089261484000000002 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667643+0000", 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2337999999999999e-05 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50447 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578393+0000", 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9986205259999998, 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089321038000000005, 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50447 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578393+0000", 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578393+0000", 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578394+0000", 2024-09-14T08:39:56.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1200000000000001e-06 2024-09-14T08:39:56.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578400+0000", 2024-09-14T08:39:56.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.755e-06 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578438+0000", 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8034000000000002e-05 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578452+0000", 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4195e-05 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667697+0000", 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089244778999999996 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667714+0000", 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7155000000000001e-05 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50448 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9984866379999993, 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089253579, 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50448 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0299999999999997e-07 2024-09-14T08:39:56.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578532+0000", 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0670000000000002e-06 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578543+0000", 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1194e-05 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578550+0000", 2024-09-14T08:39:56.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7260000000000002e-06 2024-09-14T08:39:56.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667765+0000", 2024-09-14T08:39:56.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089214098000000006 2024-09-14T08:39:56.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667780+0000", 2024-09-14T08:39:56.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5591e-05 2024-09-14T08:39:56.638 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.638 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.638 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.638 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50449 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.638 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578562+0000", 2024-09-14T08:39:56.638 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9984513029999995, 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089293784000000001, 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50449 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578562+0000", 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578562+0000", 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578563+0000", 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578566+0000", 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1360000000000001e-06 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578575+0000", 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.619e-06 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578582+0000", 2024-09-14T08:39:56.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667838+0000", 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089256653000000005 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667856+0000", 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7421000000000001e-05 2024-09-14T08:39:56.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50450 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578591+0000", 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9984219420000002, 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089339475000000002, 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50450 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578591+0000", 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578591+0000", 2024-09-14T08:39:56.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578592+0000", 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578607+0000", 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5543e-05 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578617+0000", 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3430000000000002e-06 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578624+0000", 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0149999999999998e-06 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667917+0000", 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089293191999999993 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667931+0000", 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3698e-05 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50451 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9983784319999991, 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089383987999999998, 2024-09-14T08:39:56.647 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50451 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578647+0000", 2024-09-14T08:39:56.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1941e-05 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578656+0000", 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9449999999999999e-06 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578663+0000", 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8589999999999999e-06 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668002+0000", 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089338362000000004 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668019+0000", 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7150999999999999e-05 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50452 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578673+0000", 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9983398650000002, 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089408902999999998, 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50452 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578673+0000", 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578673+0000", 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578674+0000", 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578677+0000", 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9129999999999999e-06 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578685+0000", 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3920000000000003e-06 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578706+0000", 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0792999999999999e-05 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668067+0000", 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089360564000000003 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668082+0000", 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5511000000000001e-05 2024-09-14T08:39:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50453 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578717+0000", 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.998296259, 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089439313000000006, 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50453 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578717+0000", 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578717+0000", 2024-09-14T08:39:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578900+0000", 2024-09-14T08:39:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000183227 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578909+0000", 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578933+0000", 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4213e-05 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578949+0000", 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5770999999999999e-05 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668139+0000", 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089190332999999997 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668156+0000", 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7237000000000001e-05 2024-09-14T08:39:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50454 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578977+0000", 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.9980363610000005, 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089249535000000005, 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50454 2024-09-14T08:39:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578977+0000", 2024-09-14T08:39:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578977+0000", 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584558+0000", 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055811519999999998 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584570+0000", 2024-09-14T08:39:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1640999999999999e-05 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584596+0000", 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6679e-05 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584611+0000", 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5021000000000001e-05 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668211+0000", 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.083599604999999994 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668226+0000", 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5437000000000001e-05 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.666 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:56.667 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0e40f4c4:::rbd_data.10f13f8886eb.0000000000000007:head# 2024-09-14T08:39:56.667 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 0=[]:{} 2024-09-14T08:39:56.667 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:39:56.668 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:56.669 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:56.668+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:56.669 INFO:teuthology.orchestra.run.smithi089.stdout:write_pg epoch 38 info 3.10( v 38'58 (0'0,38'58] local-lis/les=21/22 n=15 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) 2024-09-14T08:39:56.669 INFO:teuthology.orchestra.run.smithi089.stdout:Import successful 2024-09-14T08:39:56.767 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:56.769+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31339 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844123+0000", 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016528633000000001, 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016552125000000001, 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31339 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844123+0000", 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844123+0000", 2024-09-14T08:39:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844124+0000", 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8299999999999995e-07 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844127+0000", 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844137+0000", 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0091999999999999e-05 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844145+0000", 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5560000000000002e-06 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31371 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845509+0000", 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015143004, 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015225318999999999, 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31371 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845509+0000", 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845509+0000", 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845509+0000", 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845512+0000", 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845521+0000", 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1060000000000006e-06 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845528+0000", 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3590000000000002e-06 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31340 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844156+0000", 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.01649602, 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016631126999999999, 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31340 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844156+0000", 2024-09-14T08:39:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844156+0000", 2024-09-14T08:39:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844156+0000", 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7300000000000005e-07 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844159+0000", 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844168+0000", 2024-09-14T08:39:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0850000000000003e-06 2024-09-14T08:39:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844185+0000", 2024-09-14T08:39:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6798000000000001e-05 2024-09-14T08:39:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31372 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845566+0000", 2024-09-14T08:39:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015085510999999999, 2024-09-14T08:39:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015268185, 2024-09-14T08:39:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31372 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845566+0000", 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845566+0000", 2024-09-14T08:39:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845567+0000", 2024-09-14T08:39:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4399999999999999e-07 2024-09-14T08:39:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845570+0000", 2024-09-14T08:39:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.96e-06 2024-09-14T08:39:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845580+0000", 2024-09-14T08:39:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0035e-05 2024-09-14T08:39:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845587+0000", 2024-09-14T08:39:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4719999999999998e-06 2024-09-14T08:39:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31341 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844228+0000", 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016423162000000002, 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016655898999999998, 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31341 2024-09-14T08:39:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844228+0000", 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844228+0000", 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844229+0000", 2024-09-14T08:39:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:39:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844238+0000", 2024-09-14T08:39:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:39:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844248+0000", 2024-09-14T08:39:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0528e-05 2024-09-14T08:39:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844255+0000", 2024-09-14T08:39:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2760000000000003e-06 2024-09-14T08:39:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31373 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845613+0000", 2024-09-14T08:39:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015038843, 2024-09-14T08:39:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015322404, 2024-09-14T08:39:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31373 2024-09-14T08:39:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845613+0000", 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845613+0000", 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845614+0000", 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.23e-07 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845617+0000", 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0970000000000002e-06 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845627+0000", 2024-09-14T08:39:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0009e-05 2024-09-14T08:39:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845634+0000", 2024-09-14T08:39:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2520000000000002e-06 2024-09-14T08:39:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31342 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844281+0000", 2024-09-14T08:39:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016370202, 2024-09-14T08:39:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01668174, 2024-09-14T08:39:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31342 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844281+0000", 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844281+0000", 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844282+0000", 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5300000000000003e-07 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844285+0000", 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.23e-06 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844296+0000", 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0166000000000001e-05 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844303+0000", 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6490000000000008e-06 2024-09-14T08:39:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31374 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845645+0000", 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015006636, 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015343659000000001, 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31374 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845645+0000", 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845645+0000", 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845646+0000", 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2600000000000001e-07 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845649+0000", 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845658+0000", 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1260000000000004e-06 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845666+0000", 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8189999999999992e-06 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31343 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844333+0000", 2024-09-14T08:39:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016318762000000001, 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016680611000000001, 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31343 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844333+0000", 2024-09-14T08:39:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844333+0000", 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844334+0000", 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5700000000000002e-07 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844337+0000", 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844347+0000", 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0232e-05 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844354+0000", 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3459999999999996e-06 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.895 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31375 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.895 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845676+0000", 2024-09-14T08:39:56.895 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014975634, 2024-09-14T08:39:56.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015365040999999999, 2024-09-14T08:39:56.895 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.895 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.895 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31375 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845676+0000", 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845676+0000", 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845677+0000", 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0699999999999996e-07 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845680+0000", 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.853e-06 2024-09-14T08:39:56.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845689+0000", 2024-09-14T08:39:56.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9050000000000003e-06 2024-09-14T08:39:56.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845696+0000", 2024-09-14T08:39:56.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3830000000000003e-06 2024-09-14T08:39:56.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.899 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.899 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31344 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.899 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844366+0000", 2024-09-14T08:39:56.899 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016285458999999999, 2024-09-14T08:39:56.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016699961999999999, 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31344 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844366+0000", 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844366+0000", 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844367+0000", 2024-09-14T08:39:56.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4e-07 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844370+0000", 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844396+0000", 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6376e-05 2024-09-14T08:39:56.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844406+0000", 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7659999999999993e-06 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31376 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.903 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845706+0000", 2024-09-14T08:39:56.904 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014945557999999999, 2024-09-14T08:39:56.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015405874, 2024-09-14T08:39:56.904 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.904 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.904 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.904 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31376 2024-09-14T08:39:56.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.905 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845706+0000", 2024-09-14T08:39:56.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845706+0000", 2024-09-14T08:39:56.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845707+0000", 2024-09-14T08:39:56.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-07 2024-09-14T08:39:56.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845709+0000", 2024-09-14T08:39:56.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-14T08:39:56.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845720+0000", 2024-09-14T08:39:56.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0282000000000001e-05 2024-09-14T08:39:56.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845727+0000", 2024-09-14T08:39:56.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.469e-06 2024-09-14T08:39:56.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.908 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.909 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.909 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31345 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.909 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844420+0000", 2024-09-14T08:39:56.909 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016231461999999999, 2024-09-14T08:39:56.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016723571, 2024-09-14T08:39:56.909 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.909 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.909 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.910 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.910 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.910 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.910 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31345 2024-09-14T08:39:56.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.910 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844420+0000", 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844420+0000", 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844421+0000", 2024-09-14T08:39:56.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.23e-07 2024-09-14T08:39:56.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844425+0000", 2024-09-14T08:39:56.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8530000000000002e-06 2024-09-14T08:39:56.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844434+0000", 2024-09-14T08:39:56.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5789999999999993e-06 2024-09-14T08:39:56.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844442+0000", 2024-09-14T08:39:56.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2919999999999998e-06 2024-09-14T08:39:56.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.913 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31377 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845763+0000", 2024-09-14T08:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014888738, 2024-09-14T08:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015410949, 2024-09-14T08:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.915 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31377 2024-09-14T08:39:56.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.915 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845763+0000", 2024-09-14T08:39:56.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845763+0000", 2024-09-14T08:39:56.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845764+0000", 2024-09-14T08:39:56.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:39:56.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845773+0000", 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2359999999999993e-06 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845784+0000", 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0579e-05 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845791+0000", 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.917 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31346 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844452+0000", 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016199558999999999, 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016747703999999999, 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31346 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844452+0000", 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844452+0000", 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844453+0000", 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844456+0000", 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.836e-06 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844464+0000", 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8459999999999997e-06 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844472+0000", 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3189999999999997e-06 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31378 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845813+0000", 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014838651, 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015426875, 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31378 2024-09-14T08:39:56.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845813+0000", 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845813+0000", 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845814+0000", 2024-09-14T08:39:56.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845817+0000", 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845827+0000", 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9259999999999995e-06 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845834+0000", 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3950000000000003e-06 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31347 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844498+0000", 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016153491999999998, 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016768238000000001, 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.925 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31347 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844498+0000", 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844498+0000", 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844499+0000", 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5000000000000001e-07 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844502+0000", 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2600000000000001e-06 2024-09-14T08:39:56.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844512+0000", 2024-09-14T08:39:56.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0129000000000001e-05 2024-09-14T08:39:56.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844520+0000", 2024-09-14T08:39:56.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3690000000000001e-06 2024-09-14T08:39:56.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.929 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.929 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31379 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.929 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845845+0000", 2024-09-14T08:39:56.929 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014806408, 2024-09-14T08:39:56.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01545036, 2024-09-14T08:39:56.930 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.930 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.930 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.930 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31379 2024-09-14T08:39:56.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.930 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845845+0000", 2024-09-14T08:39:56.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845845+0000", 2024-09-14T08:39:56.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845846+0000", 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5000000000000001e-07 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845849+0000", 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8270000000000002e-06 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845858+0000", 2024-09-14T08:39:56.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1220000000000001e-06 2024-09-14T08:39:56.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845879+0000", 2024-09-14T08:39:56.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0754000000000002e-05 2024-09-14T08:39:56.933 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.934 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.934 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.934 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31348 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.934 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844551+0000", 2024-09-14T08:39:56.934 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016100934000000001, 2024-09-14T08:39:56.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016770449999999999, 2024-09-14T08:39:56.934 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.934 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.935 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.935 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31348 2024-09-14T08:39:56.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.935 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844551+0000", 2024-09-14T08:39:56.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844551+0000", 2024-09-14T08:39:56.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844551+0000", 2024-09-14T08:39:56.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844555+0000", 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1389999999999999e-06 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844564+0000", 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8889999999999997e-06 2024-09-14T08:39:56.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844572+0000", 2024-09-14T08:39:56.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.362e-06 2024-09-14T08:39:56.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.939 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.939 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31380 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.940 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845893+0000", 2024-09-14T08:39:56.940 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014758782999999999, 2024-09-14T08:39:56.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015453489000000001, 2024-09-14T08:39:56.940 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.940 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.940 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.940 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31380 2024-09-14T08:39:56.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.941 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845893+0000", 2024-09-14T08:39:56.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845893+0000", 2024-09-14T08:39:56.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845894+0000", 2024-09-14T08:39:56.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8299999999999995e-07 2024-09-14T08:39:56.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845897+0000", 2024-09-14T08:39:56.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8760000000000001e-06 2024-09-14T08:39:56.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845909+0000", 2024-09-14T08:39:56.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2672e-05 2024-09-14T08:39:56.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845917+0000", 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6290000000000001e-06 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31349 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844583+0000", 2024-09-14T08:39:56.944 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016068631999999999, 2024-09-14T08:39:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016788811000000001, 2024-09-14T08:39:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31349 2024-09-14T08:39:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844583+0000", 2024-09-14T08:39:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844583+0000", 2024-09-14T08:39:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844584+0000", 2024-09-14T08:39:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8000000000000004e-07 2024-09-14T08:39:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844587+0000", 2024-09-14T08:39:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7870000000000002e-06 2024-09-14T08:39:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844596+0000", 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1419999999999999e-06 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844608+0000", 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2662e-05 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31381 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845927+0000", 2024-09-14T08:39:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014724157, 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015469303, 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31381 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845927+0000", 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845927+0000", 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845928+0000", 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7899999999999997e-07 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845931+0000", 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.853e-06 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845940+0000", 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9490000000000002e-06 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845948+0000", 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8390000000000007e-06 2024-09-14T08:39:56.952 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31350 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844619+0000", 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016032372999999999, 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016802385999999999, 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.953 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31350 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844619+0000", 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844619+0000", 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844620+0000", 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2399999999999997e-07 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844623+0000", 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.836e-06 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844635+0000", 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2014999999999999e-05 2024-09-14T08:39:56.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844642+0000", 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2389999999999996e-06 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31382 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845958+0000", 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014693291000000001, 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015492617, 2024-09-14T08:39:56.956 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31382 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845958+0000", 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845958+0000", 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845959+0000", 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845962+0000", 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8059999999999999e-06 2024-09-14T08:39:56.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845971+0000", 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.918e-06 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845978+0000", 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4800000000000004e-06 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31351 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844667+0000", 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015984695, 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016810309999999998, 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.960 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31351 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844667+0000", 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844667+0000", 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844668+0000", 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9999999999999996e-07 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844671+0000", 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0690000000000002e-06 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844681+0000", 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0052e-05 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844688+0000", 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3989999999999998e-06 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31383 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846008+0000", 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014644044, 2024-09-14T08:39:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015494414999999999, 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31383 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846008+0000", 2024-09-14T08:39:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846008+0000", 2024-09-14T08:39:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846008+0000", 2024-09-14T08:39:56.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1399999999999996e-07 2024-09-14T08:39:56.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846011+0000", 2024-09-14T08:39:56.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1190000000000001e-06 2024-09-14T08:39:56.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846021+0000", 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0009e-05 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846029+0000", 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31352 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844702+0000", 2024-09-14T08:39:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015949623, 2024-09-14T08:39:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016825211999999999, 2024-09-14T08:39:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.968 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.969 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.969 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31352 2024-09-14T08:39:56.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.969 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844702+0000", 2024-09-14T08:39:56.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844702+0000", 2024-09-14T08:39:56.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844703+0000", 2024-09-14T08:39:56.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1999999999999998e-07 2024-09-14T08:39:56.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844706+0000", 2024-09-14T08:39:56.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0429999999999999e-06 2024-09-14T08:39:56.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844717+0000", 2024-09-14T08:39:56.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0756e-05 2024-09-14T08:39:56.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844728+0000", 2024-09-14T08:39:56.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1738e-05 2024-09-14T08:39:56.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.972 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.973 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31384 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.973 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846040+0000", 2024-09-14T08:39:56.973 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014611707999999999, 2024-09-14T08:39:56.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015513776999999999, 2024-09-14T08:39:56.973 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.973 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.973 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.973 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31384 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846040+0000", 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846040+0000", 2024-09-14T08:39:56.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846041+0000", 2024-09-14T08:39:56.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:39:56.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846044+0000", 2024-09-14T08:39:56.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2760000000000001e-06 2024-09-14T08:39:56.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846053+0000", 2024-09-14T08:39:56.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0620000000000007e-06 2024-09-14T08:39:56.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846061+0000", 2024-09-14T08:39:56.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4429999999999997e-06 2024-09-14T08:39:56.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.977 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.977 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31353 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.978 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844744+0000", 2024-09-14T08:39:56.978 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015908050999999999, 2024-09-14T08:39:56.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01683513, 2024-09-14T08:39:56.978 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.978 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.978 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.978 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31353 2024-09-14T08:39:56.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.979 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844744+0000", 2024-09-14T08:39:56.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844744+0000", 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844744+0000", 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2299999999999999e-07 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844755+0000", 2024-09-14T08:39:56.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0902e-05 2024-09-14T08:39:56.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844765+0000", 2024-09-14T08:39:56.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7860000000000008e-06 2024-09-14T08:39:56.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844772+0000", 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2520000000000002e-06 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31385 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846071+0000", 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014580898, 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015533300999999999, 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31385 2024-09-14T08:39:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846071+0000", 2024-09-14T08:39:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846071+0000", 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846072+0000", 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9299999999999996e-07 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846075+0000", 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0469999999999998e-06 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846084+0000", 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9320000000000002e-06 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846091+0000", 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4760000000000001e-06 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31354 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844783+0000", 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015868641999999999, 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016846301000000001, 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.986 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31354 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844783+0000", 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844783+0000", 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844784+0000", 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7000000000000003e-07 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844787+0000", 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7920000000000001e-06 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844796+0000", 2024-09-14T08:39:56.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0520000000000007e-06 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844803+0000", 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2699999999999999e-06 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31386 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.989 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846101+0000", 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014550229, 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015552761999999999, 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31386 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846101+0000", 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846101+0000", 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846102+0000", 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846105+0000", 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0900000000000001e-06 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846120+0000", 2024-09-14T08:39:56.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4384e-05 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846127+0000", 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.61e-06 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31355 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844846+0000", 2024-09-14T08:39:56.993 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015805719999999999, 2024-09-14T08:39:56.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016833388000000001, 2024-09-14T08:39:56.994 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.994 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.994 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.994 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31355 2024-09-14T08:39:56.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.994 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:56.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:56.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844846+0000", 2024-09-14T08:39:56.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:56.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844846+0000", 2024-09-14T08:39:56.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:56.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:56.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844847+0000", 2024-09-14T08:39:56.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6600000000000005e-07 2024-09-14T08:39:56.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:56.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844850+0000", 2024-09-14T08:39:56.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1540000000000002e-06 2024-09-14T08:39:56.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:56.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844860+0000", 2024-09-14T08:39:56.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071999999999999e-05 2024-09-14T08:39:56.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:56.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844867+0000", 2024-09-14T08:39:56.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4150000000000002e-06 2024-09-14T08:39:56.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.998 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:56.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:56.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:56.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:56.998 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31387 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:56.998 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846159+0000", 2024-09-14T08:39:56.999 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014492725, 2024-09-14T08:39:56.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015545623, 2024-09-14T08:39:56.999 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:56.999 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:56.999 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:56.999 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:56.999 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:56.999 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:56.999 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31387 2024-09-14T08:39:57.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.000 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846159+0000", 2024-09-14T08:39:57.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846159+0000", 2024-09-14T08:39:57.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846160+0000", 2024-09-14T08:39:57.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9299999999999996e-07 2024-09-14T08:39:57.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846163+0000", 2024-09-14T08:39:57.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2430000000000001e-06 2024-09-14T08:39:57.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846175+0000", 2024-09-14T08:39:57.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2478e-05 2024-09-14T08:39:57.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846183+0000", 2024-09-14T08:39:57.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4989999999999997e-06 2024-09-14T08:39:57.003 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.004 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.004 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.004 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31356 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.004 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844896+0000", 2024-09-14T08:39:57.004 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015755846, 2024-09-14T08:39:57.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016867792, 2024-09-14T08:39:57.004 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.005 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.005 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.005 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.005 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.005 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.005 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31356 2024-09-14T08:39:57.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.005 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844896+0000", 2024-09-14T08:39:57.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844896+0000", 2024-09-14T08:39:57.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844897+0000", 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844900+0000", 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2059999999999999e-06 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844910+0000", 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0032e-05 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844917+0000", 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.379e-06 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.009 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31388 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.009 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846194+0000", 2024-09-14T08:39:57.009 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014457823, 2024-09-14T08:39:57.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015596842, 2024-09-14T08:39:57.009 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.009 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.009 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.009 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.010 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31388 2024-09-14T08:39:57.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.010 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846194+0000", 2024-09-14T08:39:57.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846194+0000", 2024-09-14T08:39:57.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846195+0000", 2024-09-14T08:39:57.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6600000000000005e-07 2024-09-14T08:39:57.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846198+0000", 2024-09-14T08:39:57.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9069999999999999e-06 2024-09-14T08:39:57.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846211+0000", 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3757999999999999e-05 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846220+0000", 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7960000000000001e-06 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.013 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31357 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844929+0000", 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015722967000000001, 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016889615, 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31357 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844929+0000", 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844929+0000", 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844929+0000", 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4e-07 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844932+0000", 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8229999999999999e-06 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844941+0000", 2024-09-14T08:39:57.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844952+0000", 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0451999999999999e-05 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31389 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.017 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846233+0000", 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014418514, 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015613284, 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31389 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846233+0000", 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846233+0000", 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846234+0000", 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2900000000000003e-07 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846243+0000", 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6190000000000006e-06 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846253+0000", 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846260+0000", 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4189999999999996e-06 2024-09-14T08:39:57.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31358 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844962+0000", 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015689564, 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016909512000000002, 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.022 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31358 2024-09-14T08:39:57.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.022 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844962+0000", 2024-09-14T08:39:57.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844962+0000", 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844963+0000", 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599999999999999e-07 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844966+0000", 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7939999999999998e-06 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844975+0000", 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1980000000000007e-06 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844982+0000", 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3529999999999997e-06 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31390 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846271+0000", 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014380689, 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015627253000000001, 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31390 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846271+0000", 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846271+0000", 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846272+0000", 2024-09-14T08:39:57.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:39:57.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846275+0000", 2024-09-14T08:39:57.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0460000000000001e-06 2024-09-14T08:39:57.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846284+0000", 2024-09-14T08:39:57.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9490000000000002e-06 2024-09-14T08:39:57.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846292+0000", 2024-09-14T08:39:57.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.799e-06 2024-09-14T08:39:57.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.028 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31359 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844992+0000", 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015659208000000001, 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01693105, 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.029 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31359 2024-09-14T08:39:57.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.030 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844992+0000", 2024-09-14T08:39:57.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844992+0000", 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844993+0000", 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8299999999999996e-07 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844996+0000", 2024-09-14T08:39:57.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9469999999999999e-06 2024-09-14T08:39:57.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845005+0000", 2024-09-14T08:39:57.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.969e-06 2024-09-14T08:39:57.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845012+0000", 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3250000000000002e-06 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31391 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846306+0000", 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014345123, 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015643401000000001, 2024-09-14T08:39:57.033 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.034 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.034 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.034 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.034 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.034 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.034 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31391 2024-09-14T08:39:57.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.034 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846306+0000", 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846306+0000", 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846307+0000", 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1299999999999999e-07 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846310+0000", 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.903e-06 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846319+0000", 2024-09-14T08:39:57.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0350000000000007e-06 2024-09-14T08:39:57.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846328+0000", 2024-09-14T08:39:57.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9290000000000004e-06 2024-09-14T08:39:57.037 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.037 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31360 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845050+0000", 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015601311, 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016924435000000002, 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.038 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31360 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845050+0000", 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845050+0000", 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845051+0000", 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3900000000000004e-07 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845054+0000", 2024-09-14T08:39:57.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9629999999999998e-06 2024-09-14T08:39:57.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845064+0000", 2024-09-14T08:39:57.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9860000000000006e-06 2024-09-14T08:39:57.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845073+0000", 2024-09-14T08:39:57.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1989999999999995e-06 2024-09-14T08:39:57.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.042 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.042 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31392 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.042 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846343+0000", 2024-09-14T08:39:57.042 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014308461, 2024-09-14T08:39:57.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015660932999999998, 2024-09-14T08:39:57.043 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.043 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.043 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.043 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31392 2024-09-14T08:39:57.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.043 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846343+0000", 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846343+0000", 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846344+0000", 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7599999999999997e-07 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846347+0000", 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9270000000000001e-06 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846357+0000", 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0539e-05 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846365+0000", 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.362e-06 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31361 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845101+0000", 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015550738, 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016929267000000001, 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31361 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845101+0000", 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845101+0000", 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845102+0000", 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.47e-07 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845105+0000", 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1159999999999999e-06 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845115+0000", 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0009e-05 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845122+0000", 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4730000000000003e-06 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31393 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846375+0000", 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014276755, 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015682134, 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.050 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31393 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846375+0000", 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846375+0000", 2024-09-14T08:39:57.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846375+0000", 2024-09-14T08:39:57.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:39:57.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846378+0000", 2024-09-14T08:39:57.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9359999999999999e-06 2024-09-14T08:39:57.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846387+0000", 2024-09-14T08:39:57.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.003e-06 2024-09-14T08:39:57.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846395+0000", 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.362e-06 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31362 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845133+0000", 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015518198, 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016948793, 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.054 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31362 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845133+0000", 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845133+0000", 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845134+0000", 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7599999999999996e-07 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845137+0000", 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845148+0000", 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0645999999999999e-05 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845155+0000", 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2690000000000002e-06 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.057 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31394 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846405+0000", 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014246564999999999, 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015703801, 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31394 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.058 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846405+0000", 2024-09-14T08:39:57.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846405+0000", 2024-09-14T08:39:57.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846406+0000", 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1699999999999997e-07 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846409+0000", 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:39:57.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846418+0000", 2024-09-14T08:39:57.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0650000000000005e-06 2024-09-14T08:39:57.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846429+0000", 2024-09-14T08:39:57.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1749000000000001e-05 2024-09-14T08:39:57.062 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.062 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.062 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.062 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31363 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.062 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845182+0000", 2024-09-14T08:39:57.062 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015469787, 2024-09-14T08:39:57.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016952925000000001, 2024-09-14T08:39:57.063 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.063 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.063 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.063 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.063 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.063 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.063 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31363 2024-09-14T08:39:57.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.064 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845182+0000", 2024-09-14T08:39:57.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845182+0000", 2024-09-14T08:39:57.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845183+0000", 2024-09-14T08:39:57.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0299999999999998e-07 2024-09-14T08:39:57.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845186+0000", 2024-09-14T08:39:57.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.196e-06 2024-09-14T08:39:57.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845197+0000", 2024-09-14T08:39:57.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1725999999999999e-05 2024-09-14T08:39:57.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845205+0000", 2024-09-14T08:39:57.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5850000000000002e-06 2024-09-14T08:39:57.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.067 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.067 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31395 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.068 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846460+0000", 2024-09-14T08:39:57.068 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014191898999999999, 2024-09-14T08:39:57.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015701815000000001, 2024-09-14T08:39:57.068 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.068 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.068 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.069 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31395 2024-09-14T08:39:57.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.069 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846460+0000", 2024-09-14T08:39:57.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846460+0000", 2024-09-14T08:39:57.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846461+0000", 2024-09-14T08:39:57.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1699999999999997e-07 2024-09-14T08:39:57.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846464+0000", 2024-09-14T08:39:57.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1530000000000001e-06 2024-09-14T08:39:57.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846475+0000", 2024-09-14T08:39:57.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1582e-05 2024-09-14T08:39:57.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846483+0000", 2024-09-14T08:39:57.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4189999999999996e-06 2024-09-14T08:39:57.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.072 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.073 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31364 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.073 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845216+0000", 2024-09-14T08:39:57.073 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015435572, 2024-09-14T08:39:57.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016970703, 2024-09-14T08:39:57.073 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.073 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.074 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.074 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31364 2024-09-14T08:39:57.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.074 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845216+0000", 2024-09-14T08:39:57.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845216+0000", 2024-09-14T08:39:57.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845217+0000", 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1699999999999997e-07 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845219+0000", 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845229+0000", 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7419999999999992e-06 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845242+0000", 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2308e-05 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.077 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31396 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846494+0000", 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014157626, 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01571935, 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31396 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846494+0000", 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846494+0000", 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846495+0000", 2024-09-14T08:39:57.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:39:57.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846498+0000", 2024-09-14T08:39:57.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-14T08:39:57.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846507+0000", 2024-09-14T08:39:57.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2520000000000005e-06 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846514+0000", 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2930000000000003e-06 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31365 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845264+0000", 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015387477, 2024-09-14T08:39:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016974474999999999, 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31365 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845264+0000", 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845264+0000", 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845265+0000", 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-06 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845276+0000", 2024-09-14T08:39:57.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0927999999999999e-05 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845287+0000", 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0522e-05 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845294+0000", 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5229999999999998e-06 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.084 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31397 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846524+0000", 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014127336000000001, 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015738992, 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31397 2024-09-14T08:39:57.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846524+0000", 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846524+0000", 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846525+0000", 2024-09-14T08:39:57.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8599999999999997e-07 2024-09-14T08:39:57.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846528+0000", 2024-09-14T08:39:57.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9900000000000002e-06 2024-09-14T08:39:57.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846537+0000", 2024-09-14T08:39:57.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8990000000000007e-06 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846544+0000", 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1559999999999998e-06 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.088 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31334 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3188736~1024 out=1024b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.089 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.843863+0000", 2024-09-14T08:39:57.089 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016788601, 2024-09-14T08:39:57.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018431013, 2024-09-14T08:39:57.089 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.089 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.089 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.089 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31334 2024-09-14T08:39:57.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.090 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843863+0000", 2024-09-14T08:39:57.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843863+0000", 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843864+0000", 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599999999999999e-07 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843867+0000", 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8899999999999999e-06 2024-09-14T08:39:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843876+0000", 2024-09-14T08:39:57.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6020000000000006e-06 2024-09-14T08:39:57.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843885+0000", 2024-09-14T08:39:57.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.772e-06 2024-09-14T08:39:57.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.861953+0000", 2024-09-14T08:39:57.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018067670000000001 2024-09-14T08:39:57.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.862161+0000", 2024-09-14T08:39:57.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000208047 2024-09-14T08:39:57.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.094 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.094 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31366 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.094 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845309+0000", 2024-09-14T08:39:57.094 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015342992999999999, 2024-09-14T08:39:57.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017017276000000001, 2024-09-14T08:39:57.095 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.095 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.095 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.095 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31366 2024-09-14T08:39:57.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.095 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845309+0000", 2024-09-14T08:39:57.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845309+0000", 2024-09-14T08:39:57.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845309+0000", 2024-09-14T08:39:57.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5700000000000001e-07 2024-09-14T08:39:57.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845312+0000", 2024-09-14T08:39:57.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:39:57.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845323+0000", 2024-09-14T08:39:57.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0725e-05 2024-09-14T08:39:57.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845330+0000", 2024-09-14T08:39:57.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:39:57.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.099 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.099 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31398 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.099 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846554+0000", 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014097526000000001, 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015797354, 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31398 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.100 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846554+0000", 2024-09-14T08:39:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846554+0000", 2024-09-14T08:39:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846555+0000", 2024-09-14T08:39:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:39:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846558+0000", 2024-09-14T08:39:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9830000000000001e-06 2024-09-14T08:39:57.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846567+0000", 2024-09-14T08:39:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1020000000000003e-06 2024-09-14T08:39:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846574+0000", 2024-09-14T08:39:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2790000000000001e-06 2024-09-14T08:39:57.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31335 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.843913+0000", 2024-09-14T08:39:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016738524000000001, 2024-09-14T08:39:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018464069999999999, 2024-09-14T08:39:57.104 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31335 2024-09-14T08:39:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.105 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843913+0000", 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843913+0000", 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843914+0000", 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.23e-07 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843917+0000", 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0699999999999998e-06 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843929+0000", 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1588e-05 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843936+0000", 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4189999999999996e-06 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.108 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31367 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845369+0000", 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015282413, 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017034824, 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31367 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845369+0000", 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845369+0000", 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845370+0000", 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4e-07 2024-09-14T08:39:57.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845373+0000", 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.056e-06 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845383+0000", 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0095000000000001e-05 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845391+0000", 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4660000000000002e-06 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31399 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.846584+0000", 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.014067319999999999, 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015844971999999999, 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.112 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31399 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846584+0000", 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846584+0000", 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846585+0000", 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846588+0000", 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-14T08:39:57.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846599+0000", 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0604999999999999e-05 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.846606+0000", 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3459999999999996e-06 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.115 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.116 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.116 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31336 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.116 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.843969+0000", 2024-09-14T08:39:57.116 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016682117999999999, 2024-09-14T08:39:57.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018486547999999998, 2024-09-14T08:39:57.116 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.116 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31336 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843969+0000", 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843969+0000", 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843970+0000", 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1999999999999998e-07 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843973+0000", 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0730000000000001e-06 2024-09-14T08:39:57.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843983+0000", 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9860000000000006e-06 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.843991+0000", 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3490000000000003e-06 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.120 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31368 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.120 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845416+0000", 2024-09-14T08:39:57.120 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015235756, 2024-09-14T08:39:57.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017065041999999999, 2024-09-14T08:39:57.120 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.120 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.120 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31368 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845416+0000", 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845416+0000", 2024-09-14T08:39:57.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845417+0000", 2024-09-14T08:39:57.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9699999999999995e-07 2024-09-14T08:39:57.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845420+0000", 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1530000000000001e-06 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845430+0000", 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0162e-05 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845437+0000", 2024-09-14T08:39:57.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4830000000000002e-06 2024-09-14T08:39:57.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.124 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.124 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31337 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.124 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844019+0000", 2024-09-14T08:39:57.124 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016632193999999999, 2024-09-14T08:39:57.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018488576, 2024-09-14T08:39:57.125 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.125 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.125 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.125 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.125 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.125 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.125 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31337 2024-09-14T08:39:57.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.125 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844019+0000", 2024-09-14T08:39:57.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844019+0000", 2024-09-14T08:39:57.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844020+0000", 2024-09-14T08:39:57.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9400000000000004e-07 2024-09-14T08:39:57.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844023+0000", 2024-09-14T08:39:57.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:39:57.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844033+0000", 2024-09-14T08:39:57.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0158e-05 2024-09-14T08:39:57.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844041+0000", 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2660000000000004e-06 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31369 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845448+0000", 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015203233, 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017086883000000001, 2024-09-14T08:39:57.129 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31369 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845448+0000", 2024-09-14T08:39:57.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845448+0000", 2024-09-14T08:39:57.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845449+0000", 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2600000000000001e-07 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845452+0000", 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7970000000000001e-06 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845461+0000", 2024-09-14T08:39:57.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9789999999999999e-06 2024-09-14T08:39:57.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845468+0000", 2024-09-14T08:39:57.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3459999999999996e-06 2024-09-14T08:39:57.133 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.133 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.133 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31338 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.844076+0000", 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.016575744, 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018486426, 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.135 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31338 2024-09-14T08:39:57.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.135 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844076+0000", 2024-09-14T08:39:57.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844076+0000", 2024-09-14T08:39:57.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844077+0000", 2024-09-14T08:39:57.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:39:57.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844080+0000", 2024-09-14T08:39:57.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2169999999999999e-06 2024-09-14T08:39:57.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844090+0000", 2024-09-14T08:39:57.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0182e-05 2024-09-14T08:39:57.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.844097+0000", 2024-09-14T08:39:57.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.362e-06 2024-09-14T08:39:57.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.138 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.138 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31370 3.c 3.d5ceaaac (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.139 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.845478+0000", 2024-09-14T08:39:57.139 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.015173305999999999, 2024-09-14T08:39:57.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017109316999999999, 2024-09-14T08:39:57.139 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.139 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.139 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31370 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845478+0000", 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845478+0000", 2024-09-14T08:39:57.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845479+0000", 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599999999999999e-07 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845482+0000", 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0460000000000001e-06 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845491+0000", 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8890000000000008e-06 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.845498+0000", 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3529999999999997e-06 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:31411 3.c 3.d5ceaaac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:56.861120+0000", 2024-09-14T08:39:57.142 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9995313, 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015070319999999999, 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31411 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.861120+0000", 2024-09-14T08:39:57.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.861120+0000", 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.861122+0000", 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.007e-06 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.861133+0000", 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0315e-05 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.861168+0000", 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5389000000000003e-05 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:56.861183+0000", 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5044e-05 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.146 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:39:57.146 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 67 2024-09-14T08:39:57.146 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:57.147 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:39:57.148 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:57.149+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:57.166 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /var/log/ceph/exp.3.10.0 2024-09-14T08:39:57.248 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:57.248+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:57.288 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:57.288 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:39:57.289 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:39:57.289 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:39:57.289 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:57.303 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:39:57.349 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:57.353+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:57.450 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:57.452+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:39:57.497 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:39:57.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:39:57.497 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:39:57.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.497 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1882 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 126976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.842311+0000", 2024-09-14T08:39:57.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.65882918, 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086228898999999998, 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1882 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842311+0000", 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842311+0000", 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842312+0000", 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.153e-06 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842315+0000", 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9189999999999999e-06 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842324+0000", 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842331+0000", 2024-09-14T08:39:57.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0620000000000003e-06 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.928108+0000", 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.085776406999999999 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.928293+0000", 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018579100000000001 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.928540+0000", 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024645800000000002 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1883 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.842341+0000", 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.658798882999999, 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086579491999999994, 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.502 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1883 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842341+0000", 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842341+0000", 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842342+0000", 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842354+0000", 2024-09-14T08:39:57.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2352e-05 2024-09-14T08:39:57.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842365+0000", 2024-09-14T08:39:57.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0468e-05 2024-09-14T08:39:57.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842372+0000", 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3080000000000002e-06 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.928615+0000", 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086242421 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.928751+0000", 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000136503 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.928921+0000", 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016971 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1884 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.842384+0000", 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.658756427, 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086996295000000001, 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1884 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842384+0000", 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842384+0000", 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842385+0000", 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4600000000000003e-07 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842388+0000", 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.14e-06 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842397+0000", 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4679999999999998e-06 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842404+0000", 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9290000000000001e-06 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.929003+0000", 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086598516 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.929174+0000", 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170994 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.929380+0000", 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020640200000000001 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.511 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1885 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 160768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.842414+0000", 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.658725809, 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.087330335999999995, 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1885 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842414+0000", 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842414+0000", 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842415+0000", 2024-09-14T08:39:57.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842418+0000", 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6790000000000001e-06 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842427+0000", 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9549999999999998e-06 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842437+0000", 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0417999999999999e-05 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.929453+0000", 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.087016158999999996 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.929584+0000", 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013100000000000001 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.929745+0000", 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016041800000000001 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1886 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.842447+0000", 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.658692765, 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.087765078999999996, 2024-09-14T08:39:57.516 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1886 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842447+0000", 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842447+0000", 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842448+0000", 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842458+0000", 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9049999999999992e-06 2024-09-14T08:39:57.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842468+0000", 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.825e-06 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842475+0000", 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.109e-06 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.929829+0000", 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.087353771999999996 2024-09-14T08:39:57.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.930008+0000", 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017956999999999999 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.930213+0000", 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020414200000000001 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1887 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.842486+0000", 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.658654351999999, 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.087991446000000001, 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1887 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.521 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842486+0000", 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842486+0000", 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842487+0000", 2024-09-14T08:39:57.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2600000000000001e-07 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842490+0000", 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.853e-06 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842499+0000", 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2380000000000003e-06 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842506+0000", 2024-09-14T08:39:57.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2420000000000003e-06 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.930287+0000", 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.087780665999999993 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.930374+0000", 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7703999999999999e-05 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.930477+0000", 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102917 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1889 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 194560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.842615+0000", 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.658525333, 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088357109000000003, 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1889 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842615+0000", 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842615+0000", 2024-09-14T08:39:57.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842616+0000", 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842621+0000", 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8420000000000004e-06 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842640+0000", 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9043e-05 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842669+0000", 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8634999999999999e-05 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.930581+0000", 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.087912773 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.930760+0000", 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000178216 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.930972+0000", 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212303 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1892 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.842825+0000", 2024-09-14T08:39:57.529 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.658315352000001, 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088383345000000002, 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1892 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842825+0000", 2024-09-14T08:39:57.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842825+0000", 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842826+0000", 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2270000000000001e-06 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842831+0000", 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9320000000000004e-06 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842849+0000", 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8122999999999999e-05 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842863+0000", 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3801000000000001e-05 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.931032+0000", 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088169447999999997 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.931107+0000", 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4385e-05 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.931208+0000", 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010142899999999999 2024-09-14T08:39:57.533 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1894 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 217088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.842958+0000", 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.658182406, 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088765683999999997, 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.534 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1894 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842958+0000", 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842958+0000", 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842959+0000", 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5290000000000001e-06 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842977+0000", 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8156999999999999e-05 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.842996+0000", 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.878e-05 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843010+0000", 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.931295+0000", 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088284594999999993 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.931494+0000", 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000199106 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.931723+0000", 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000229609 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1897 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.843172+0000", 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.657968192, 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088753676000000004, 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.538 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1897 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843172+0000", 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843172+0000", 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843173+0000", 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3260000000000001e-06 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843179+0000", 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1519999999999997e-06 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843203+0000", 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3696000000000001e-05 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843218+0000", 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4547e-05 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.931753+0000", 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088535473000000003 2024-09-14T08:39:57.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.931825+0000", 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2113000000000006e-05 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.931926+0000", 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100369 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1899 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.843375+0000", 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.657764984, 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089036192, 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1899 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843375+0000", 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843375+0000", 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843376+0000", 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4399999999999998e-07 2024-09-14T08:39:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843380+0000", 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843390+0000", 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0778000000000001e-05 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843398+0000", 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4889999999999998e-06 2024-09-14T08:39:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.932006+0000", 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.088608345000000005 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.932181+0000", 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017506499999999999 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.932411+0000", 2024-09-14T08:39:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023004899999999999 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:1901 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 250880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.843443+0000", 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.657696839, 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089202108000000002, 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1901 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843443+0000", 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843443+0000", 2024-09-14T08:39:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843444+0000", 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5000000000000002e-07 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843447+0000", 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.869e-06 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843456+0000", 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2150000000000007e-06 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.843463+0000", 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8889999999999996e-06 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.932475+0000", 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089012171000000001 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.932548+0000", 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2275999999999997e-05 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.932645+0000", 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7937999999999996e-05 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:2130 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 442368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.551 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.860792+0000", 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.64034841, 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.085761377, 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2130 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.860792+0000", 2024-09-14T08:39:57.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.860792+0000", 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.860793+0000", 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1599999999999999e-06 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.860796+0000", 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2959999999999999e-06 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.860810+0000", 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4171e-05 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.860831+0000", 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0115999999999998e-05 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.946379+0000", 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.085548747999999994 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.946453+0000", 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3456999999999998e-05 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.946553+0000", 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100429 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.555 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:2132 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 453632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.860850+0000", 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.640290144, 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086107056000000001, 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2132 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.860850+0000", 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.860850+0000", 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861104+0000", 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025415600000000001 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861113+0000", 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0159999999999997e-06 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861138+0000", 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4312e-05 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861155+0000", 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7272999999999999e-05 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.946624+0000", 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.085469451000000002 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.946776+0000", 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015128 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.946957+0000", 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018156800000000001 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:2133 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 464896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.861184+0000", 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.639956614999999, 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086024196999999997, 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2133 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861184+0000", 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861184+0000", 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861596+0000", 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041245300000000002 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861619+0000", 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2756e-05 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861639+0000", 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9936999999999999e-05 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861650+0000", 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1443999999999999e-05 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.947012+0000", 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.085362078999999993 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.947106+0000", 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3713000000000002e-05 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.947208+0000", 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000101815 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.564 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:2134 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 476160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.861672+0000", 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.639468246, 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.085992275000000007, 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861672+0000", 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861672+0000", 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861673+0000", 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6299999999999993e-07 2024-09-14T08:39:57.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861679+0000", 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9859999999999999e-06 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861700+0000", 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1169e-05 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861708+0000", 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3590000000000008e-06 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.947290+0000", 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.085581384999999996 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.947459+0000", 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000169359 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.947664+0000", 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020505400000000001 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:2136 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 487424~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.861723+0000", 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.639417187999999, 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086174698999999993, 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.569 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2136 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861723+0000", 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.861723+0000", 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862147+0000", 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042443500000000002 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862156+0000", 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9250000000000001e-06 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862178+0000", 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1222000000000001e-05 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862214+0000", 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5952999999999999e-05 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.947723+0000", 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.085509665999999998 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.947796+0000", 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2453000000000006e-05 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.947898+0000", 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102045 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:2137 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 498688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.862242+0000", 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.638897854, 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086110768000000004, 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2137 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.574 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862242+0000", 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862242+0000", 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862244+0000", 2024-09-14T08:39:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4759999999999999e-06 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862251+0000", 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.815e-06 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862276+0000", 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5273e-05 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862291+0000", 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4897e-05 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.947976+0000", 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.085684716999999994 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.948146+0000", 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017054900000000001 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.948353+0000", 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020704100000000001 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:2139 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 509952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.862333+0000", 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.638806757999999, 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086270583999999997, 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2139 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862333+0000", 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862333+0000", 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862335+0000", 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7600000000000001e-06 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862342+0000", 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5660000000000003e-06 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862361+0000", 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9119000000000001e-05 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862375+0000", 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4071e-05 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.948424+0000", 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086049282000000005 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.948499+0000", 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4418000000000005e-05 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.948604+0000", 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105368 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:2140 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 521216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:42.862396+0000", 2024-09-14T08:39:57.582 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.638743958999999, 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.086652522999999995, 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2140 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:39:57.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862396+0000", 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862396+0000", 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862801+0000", 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040469799999999999 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:39:57.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862808+0000", 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5320000000000001e-06 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862831+0000", 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2099e-05 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.862844+0000", 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3138e-05 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.948679+0000", 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.085835527999999994 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.948849+0000", 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016948199999999999 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:42.949049+0000", 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000200046 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:39:57.587 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:39:57.587 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:39:57.588 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:57.588+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:57.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:39:57.689 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:57.692+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:57.749 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:57.749 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:39:57.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35355 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.748891+0000", 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0029073359999999999, 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029311419999999999, 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35355 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.750 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748891+0000", 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748891+0000", 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748891+0000", 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8299999999999998e-07 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748893+0000", 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.485e-06 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748896+0000", 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8890000000000004e-06 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748900+0000", 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.101e-06 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35388 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749661+0000", 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021374670000000001, 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002194568, 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.753 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35388 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749661+0000", 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749661+0000", 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749661+0000", 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7000000000000001e-07 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749662+0000", 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4449999999999999e-06 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749666+0000", 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.687e-06 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749669+0000", 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9119999999999998e-06 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35424 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750232+0000", 2024-09-14T08:39:57.756 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001566458, 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0016497389999999999, 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35424 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750232+0000", 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750232+0000", 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750232+0000", 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3999999999999998e-07 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750236+0000", 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1649999999999999e-06 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750240+0000", 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4879999999999999e-06 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750242+0000", 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7319999999999998e-06 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35356 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.748921+0000", 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0028774019999999998, 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002985822, 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35356 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748921+0000", 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748921+0000", 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748921+0000", 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6199999999999998e-07 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748923+0000", 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.618e-06 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748927+0000", 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5390000000000001e-06 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748931+0000", 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2349999999999999e-06 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35389 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749673+0000", 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021253230000000001, 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022582219999999998, 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.763 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35389 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749673+0000", 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749673+0000", 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749673+0000", 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4400000000000001e-07 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749674+0000", 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2729999999999999e-06 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749678+0000", 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4460000000000001e-06 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749681+0000", 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9720000000000001e-06 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35425 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.766 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750247+0000", 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001551581, 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00170981, 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35425 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750247+0000", 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750247+0000", 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750247+0000", 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5800000000000001e-07 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750248+0000", 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.333e-06 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750251+0000", 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2729999999999998e-06 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750255+0000", 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0210000000000001e-06 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.769 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35357 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.748935+0000", 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002862842, 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030471019999999999, 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35357 2024-09-14T08:39:57.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748935+0000", 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748935+0000", 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748936+0000", 2024-09-14T08:39:57.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4200000000000002e-07 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748937+0000", 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.299e-06 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748940+0000", 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3859999999999999e-06 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748949+0000", 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9379999999999998e-06 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35390 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749685+0000", 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021134299999999999, 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023231570000000002, 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.773 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35390 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749685+0000", 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749685+0000", 2024-09-14T08:39:57.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749685+0000", 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6600000000000002e-07 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749687+0000", 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.302e-06 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749691+0000", 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6840000000000004e-06 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749695+0000", 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1280000000000001e-06 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.776 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35426 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750259+0000", 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001538881, 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0017722879999999999, 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35426 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750259+0000", 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750259+0000", 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750260+0000", 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.41e-07 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750261+0000", 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.097e-06 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750264+0000", 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3440000000000001e-06 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750268+0000", 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6650000000000001e-06 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35358 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.748959+0000", 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0028391639999999999, 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030986730000000001, 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.780 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35358 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748959+0000", 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748959+0000", 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748959+0000", 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3700000000000001e-07 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748961+0000", 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5349999999999999e-06 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748965+0000", 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0589999999999996e-06 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748968+0000", 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.253e-06 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35392 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.783 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749699+0000", 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002099184, 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023826630000000001, 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35392 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749699+0000", 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749699+0000", 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749699+0000", 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4200000000000002e-07 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749700+0000", 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1680000000000001e-06 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749704+0000", 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749709+0000", 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2349999999999999e-06 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35427 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750271+0000", 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001526779, 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0018340819999999999, 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35427 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750271+0000", 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750271+0000", 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750272+0000", 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4499999999999998e-07 2024-09-14T08:39:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750273+0000", 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.203e-06 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750277+0000", 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.709e-06 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750279+0000", 2024-09-14T08:39:57.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8030000000000001e-06 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35359 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.748973+0000", 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0028253589999999999, 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031562690000000002, 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.790 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35359 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748973+0000", 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748973+0000", 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748973+0000", 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.27e-07 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748986+0000", 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3253e-05 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748994+0000", 2024-09-14T08:39:57.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5669999999999997e-06 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.748998+0000", 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1180000000000002e-06 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35393 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749717+0000", 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0020807999999999998, 2024-09-14T08:39:57.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024356429999999999, 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35393 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749717+0000", 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749717+0000", 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749718+0000", 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9800000000000003e-07 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749720+0000", 2024-09-14T08:39:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9460000000000001e-06 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749724+0000", 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7400000000000002e-06 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749727+0000", 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.982e-06 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35428 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750284+0000", 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0015144830000000001, 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0018929439999999999, 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35428 2024-09-14T08:39:57.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750284+0000", 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750284+0000", 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750284+0000", 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4299999999999999e-07 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750285+0000", 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-06 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750289+0000", 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3280000000000002e-06 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750292+0000", 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.349e-06 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35360 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749005+0000", 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0027931229999999998, 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003195491, 2024-09-14T08:39:57.800 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35360 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749005+0000", 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749005+0000", 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749005+0000", 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3700000000000001e-07 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749007+0000", 2024-09-14T08:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4440000000000001e-06 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749010+0000", 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6569999999999999e-06 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749014+0000", 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.112e-06 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35395 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749731+0000", 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0020673010000000001, 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024934129999999999, 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35395 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749731+0000", 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749731+0000", 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749731+0000", 2024-09-14T08:39:57.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4699999999999998e-07 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749732+0000", 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2950000000000001e-06 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749736+0000", 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.275e-06 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749738+0000", 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.807e-06 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35429 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750296+0000", 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001502368, 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019575209999999998, 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.807 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35429 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750296+0000", 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750296+0000", 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750296+0000", 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3799999999999999e-07 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750297+0000", 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2550000000000001e-06 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750301+0000", 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750303+0000", 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7939999999999998e-06 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.810 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35361 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749044+0000", 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0027541250000000001, 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003233086, 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35361 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749044+0000", 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749044+0000", 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749045+0000", 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6600000000000002e-07 2024-09-14T08:39:57.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749046+0000", 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.578e-06 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749051+0000", 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4499999999999997e-06 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749054+0000", 2024-09-14T08:39:57.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.304e-06 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35396 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749742+0000", 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0020559659999999998, 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025600269999999999, 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.814 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35396 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749742+0000", 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749742+0000", 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749743+0000", 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7300000000000001e-07 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749744+0000", 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2640000000000001e-06 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749747+0000", 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3230000000000002e-06 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749750+0000", 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8109999999999999e-06 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.817 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35430 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750307+0000", 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0014911029999999999, 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020190400000000002, 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35430 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750307+0000", 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750307+0000", 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750307+0000", 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:39:57.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750309+0000", 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.201e-06 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750312+0000", 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1329999999999999e-06 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750314+0000", 2024-09-14T08:39:57.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7219999999999999e-06 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35362 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749059+0000", 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0027393740000000001, 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032911139999999999, 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.821 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35362 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749059+0000", 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749059+0000", 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749059+0000", 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1399999999999997e-07 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749061+0000", 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3009999999999999e-06 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749064+0000", 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3749999999999999e-06 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749067+0000", 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0309999999999999e-06 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35397 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749754+0000", 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0020442870000000001, 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026199169999999998, 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35397 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749754+0000", 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749754+0000", 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749754+0000", 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4299999999999999e-07 2024-09-14T08:39:57.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749755+0000", 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.156e-06 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749759+0000", 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749762+0000", 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9040000000000001e-06 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35431 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750318+0000", 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001480245, 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020797099999999998, 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.828 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35431 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750318+0000", 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750318+0000", 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750318+0000", 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4600000000000001e-07 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750319+0000", 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.215e-06 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750323+0000", 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2090000000000001e-06 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750325+0000", 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.831 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35363 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749087+0000", 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0027115379999999999, 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033351919999999998, 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35363 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749087+0000", 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749087+0000", 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749087+0000", 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749088+0000", 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3540000000000001e-06 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749092+0000", 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7790000000000002e-06 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749096+0000", 2024-09-14T08:39:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35398 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749767+0000", 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0020316259999999999, 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002678812, 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.835 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35398 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749767+0000", 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749767+0000", 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749767+0000", 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3999999999999998e-07 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749774+0000", 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.25e-06 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749780+0000", 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7849999999999997e-06 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749783+0000", 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.039e-06 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35432 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750339+0000", 2024-09-14T08:39:57.838 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001459164, 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002130205, 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35432 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750339+0000", 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750339+0000", 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750339+0000", 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8999999999999998e-07 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750341+0000", 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.522e-06 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750345+0000", 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8909999999999997e-06 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750348+0000", 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0060000000000001e-06 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.841 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35364 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749120+0000", 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002678457, 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033732720000000001, 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35364 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.842 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749120+0000", 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749120+0000", 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749120+0000", 2024-09-14T08:39:57.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7100000000000001e-07 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749122+0000", 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5460000000000001e-06 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749127+0000", 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5230000000000003e-06 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749131+0000", 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5779999999999999e-06 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35399 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749795+0000", 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0020027529999999999, 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027217930000000001, 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.845 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35399 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749795+0000", 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749795+0000", 2024-09-14T08:39:57.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749796+0000", 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6100000000000001e-07 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749798+0000", 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6670000000000001e-06 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749802+0000", 2024-09-14T08:39:57.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0069999999999999e-06 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749805+0000", 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2789999999999999e-06 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35433 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750352+0000", 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00144655, 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021893569999999998, 2024-09-14T08:39:57.848 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35433 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750352+0000", 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750352+0000", 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750352+0000", 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.48e-07 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750353+0000", 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2619999999999999e-06 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750357+0000", 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4209999999999999e-06 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750359+0000", 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.898e-06 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35365 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749144+0000", 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0026541680000000002, 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034219200000000002, 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35365 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749144+0000", 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749144+0000", 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749144+0000", 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:39:57.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749146+0000", 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5099999999999999e-06 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749159+0000", 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2656999999999999e-05 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749162+0000", 2024-09-14T08:39:57.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6289999999999999e-06 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35400 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749811+0000", 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0019875679999999999, 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027805490000000002, 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.855 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35400 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749811+0000", 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749811+0000", 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749811+0000", 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7999999999999996e-07 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749812+0000", 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2780000000000001e-06 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749817+0000", 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.69e-06 2024-09-14T08:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749820+0000", 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9249999999999999e-06 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35434 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750363+0000", 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00143502, 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022518769999999998, 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.858 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35434 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750363+0000", 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750363+0000", 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750363+0000", 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.48e-07 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750365+0000", 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.297e-06 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750368+0000", 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4319999999999999e-06 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750371+0000", 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8260000000000001e-06 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35366 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749202+0000", 2024-09-14T08:39:57.861 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0025960829999999999, 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034372180000000001, 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35366 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749202+0000", 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749202+0000", 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749203+0000", 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749204+0000", 2024-09-14T08:39:57.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7540000000000001e-06 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749209+0000", 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749213+0000", 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.16e-06 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35401 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749851+0000", 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001947428, 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028195719999999998, 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35401 2024-09-14T08:39:57.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749851+0000", 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749851+0000", 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749851+0000", 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6499999999999999e-07 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749853+0000", 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.302e-06 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749856+0000", 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6909999999999999e-06 2024-09-14T08:39:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749859+0000", 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2119999999999999e-06 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35435 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750375+0000", 2024-09-14T08:39:57.868 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001423337, 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023198889999999999, 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35435 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750375+0000", 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750375+0000", 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750375+0000", 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4900000000000002e-07 2024-09-14T08:39:57.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750376+0000", 2024-09-14T08:39:57.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2550000000000001e-06 2024-09-14T08:39:57.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750380+0000", 2024-09-14T08:39:57.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.32e-06 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750383+0000", 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.737e-06 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.873 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35367 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749219+0000", 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002579582, 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034999089999999998, 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35367 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749219+0000", 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749219+0000", 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749219+0000", 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7300000000000001e-07 2024-09-14T08:39:57.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749220+0000", 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2410000000000001e-06 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749224+0000", 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.337e-06 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749227+0000", 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9969999999999999e-06 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35402 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749864+0000", 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001934599, 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028786950000000001, 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.877 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35402 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749864+0000", 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749864+0000", 2024-09-14T08:39:57.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749864+0000", 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.53e-07 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749865+0000", 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.212e-06 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749868+0000", 2024-09-14T08:39:57.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2590000000000001e-06 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749871+0000", 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35436 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750390+0000", 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0014085429999999999, 2024-09-14T08:39:57.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023763109999999999, 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35436 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750390+0000", 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750390+0000", 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750390+0000", 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7399999999999999e-07 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750391+0000", 2024-09-14T08:39:57.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.522e-06 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750395+0000", 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750398+0000", 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7580000000000001e-06 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35368 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749245+0000", 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0025528339999999999, 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0035444729999999998, 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35368 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.884 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749245+0000", 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749245+0000", 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749246+0000", 2024-09-14T08:39:57.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.34e-07 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749247+0000", 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.553e-06 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749252+0000", 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3340000000000003e-06 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749255+0000", 2024-09-14T08:39:57.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.405e-06 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35403 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749888+0000", 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0019100149999999999, 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029253439999999999, 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.887 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35403 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749888+0000", 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749888+0000", 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749889+0000", 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999998e-07 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749890+0000", 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-06 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749894+0000", 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8619999999999996e-06 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749897+0000", 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2090000000000001e-06 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35437 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750402+0000", 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0013963879999999999, 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024355269999999998, 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.890 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35437 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750402+0000", 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750402+0000", 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750402+0000", 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4600000000000001e-07 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750403+0000", 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.251e-06 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750407+0000", 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4199999999999999e-06 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750410+0000", 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9079999999999999e-06 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.893 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35370 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749260+0000", 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0025381459999999998, 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0036007629999999999, 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35370 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749260+0000", 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749260+0000", 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749261+0000", 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.75e-07 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749262+0000", 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.297e-06 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749265+0000", 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.365e-06 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749268+0000", 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9900000000000002e-06 2024-09-14T08:39:57.896 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35404 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749902+0000", 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001895847, 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029822220000000001, 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35404 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749902+0000", 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749902+0000", 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749903+0000", 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749904+0000", 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3e-06 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749907+0000", 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3100000000000001e-06 2024-09-14T08:39:57.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749910+0000", 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.971e-06 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35438 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750413+0000", 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0013847530000000001, 2024-09-14T08:39:57.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024947210000000001, 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35438 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750413+0000", 2024-09-14T08:39:57.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750413+0000", 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750414+0000", 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.84e-07 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750415+0000", 2024-09-14T08:39:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.274e-06 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750418+0000", 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2880000000000001e-06 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750421+0000", 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8540000000000001e-06 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35371 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749288+0000", 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0025105309999999999, 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0036443259999999998, 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35371 2024-09-14T08:39:57.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749288+0000", 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749288+0000", 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749288+0000", 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5999999999999999e-07 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749289+0000", 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2869999999999999e-06 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749294+0000", 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8770000000000001e-06 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749297+0000", 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1709999999999998e-06 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35405 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749915+0000", 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0018832429999999999, 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030407239999999999, 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35405 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749915+0000", 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749915+0000", 2024-09-14T08:39:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749915+0000", 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3999999999999998e-07 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749916+0000", 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.285e-06 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749920+0000", 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.349e-06 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749923+0000", 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8679999999999999e-06 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.910 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35372 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749318+0000", 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0024802829999999998, 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0036615689999999999, 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35372 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749318+0000", 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749318+0000", 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749318+0000", 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0699999999999998e-07 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749327+0000", 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6789999999999994e-06 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749333+0000", 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4060000000000002e-06 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749337+0000", 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.264e-06 2024-09-14T08:39:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35406 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749926+0000", 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001871859, 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003078206, 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35406 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749926+0000", 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749926+0000", 2024-09-14T08:39:57.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749927+0000", 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.48e-07 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749928+0000", 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.308e-06 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749931+0000", 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.349e-06 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749934+0000", 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9689999999999999e-06 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35373 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749350+0000", 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0024484379999999998, 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0036785049999999999, 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35373 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749350+0000", 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749350+0000", 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749350+0000", 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.63e-07 2024-09-14T08:39:57.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749352+0000", 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4750000000000001e-06 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749357+0000", 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9570000000000001e-06 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749360+0000", 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2329999999999998e-06 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35407 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749955+0000", 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0018432660000000001, 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003097041, 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35407 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749955+0000", 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749955+0000", 2024-09-14T08:39:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749955+0000", 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2399999999999999e-07 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749957+0000", 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749960+0000", 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7979999999999999e-06 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749964+0000", 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1530000000000001e-06 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35374 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749364+0000", 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0024338099999999998, 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037132810000000001, 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35374 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749364+0000", 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749364+0000", 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749365+0000", 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2e-07 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749366+0000", 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2300000000000001e-06 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749369+0000", 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2660000000000002e-06 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749372+0000", 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0960000000000001e-06 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35408 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749968+0000", 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001830082, 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031347269999999999, 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35408 2024-09-14T08:39:57.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749968+0000", 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749968+0000", 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749969+0000", 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5299999999999999e-07 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749970+0000", 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.299e-06 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749973+0000", 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4419999999999998e-06 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749978+0000", 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.216e-06 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35375 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749394+0000", 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002404153, 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037326759999999999, 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.931 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35375 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749394+0000", 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749394+0000", 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749395+0000", 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749396+0000", 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8959999999999999e-06 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749401+0000", 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.549e-06 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749404+0000", 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35409 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749981+0000", 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001816911, 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031706, 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35409 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749981+0000", 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749981+0000", 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749982+0000", 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4299999999999999e-07 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749983+0000", 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1289999999999999e-06 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749986+0000", 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.377e-06 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749989+0000", 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8909999999999999e-06 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.937 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35376 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749410+0000", 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0023883329999999999, 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037658140000000001, 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35376 2024-09-14T08:39:57.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749410+0000", 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749410+0000", 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749410+0000", 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749412+0000", 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.252e-06 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749415+0000", 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3189999999999999e-06 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749418+0000", 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8420000000000001e-06 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35410 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749993+0000", 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0018056190000000001, 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032075990000000002, 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.941 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35410 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749993+0000", 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749993+0000", 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749993+0000", 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5499999999999999e-07 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749997+0000", 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9509999999999999e-06 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750000+0000", 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4640000000000002e-06 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750003+0000", 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8849999999999999e-06 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35377 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749449+0000", 2024-09-14T08:39:57.944 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0023490579999999998, 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037746619999999998, 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35377 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749449+0000", 2024-09-14T08:39:57.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749449+0000", 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749450+0000", 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5999999999999999e-07 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749451+0000", 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.429e-06 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749455+0000", 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8460000000000001e-06 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749458+0000", 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0900000000000001e-06 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35411 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750007+0000", 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0017911369999999999, 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032404130000000001, 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35411 2024-09-14T08:39:57.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750007+0000", 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750007+0000", 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750007+0000", 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.08e-07 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750009+0000", 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.246e-06 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750012+0000", 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4419999999999998e-06 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750015+0000", 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35378 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749462+0000", 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0023359029999999999, 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003809017, 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.951 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35378 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749462+0000", 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749462+0000", 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749463+0000", 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4600000000000001e-07 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749464+0000", 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.263e-06 2024-09-14T08:39:57.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749472+0000", 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6149999999999997e-06 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749476+0000", 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1609999999999999e-06 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35412 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750020+0000", 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001777877, 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032747010000000001, 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35412 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750020+0000", 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750020+0000", 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750021+0000", 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4099999999999999e-07 2024-09-14T08:39:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750022+0000", 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.28e-06 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750025+0000", 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3569999999999998e-06 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750028+0000", 2024-09-14T08:39:57.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9620000000000002e-06 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35379 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749487+0000", 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0023109559999999999, 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003831475, 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35379 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749487+0000", 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749487+0000", 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749488+0000", 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749489+0000", 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5039999999999999e-06 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749494+0000", 2024-09-14T08:39:57.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8080000000000004e-06 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749497+0000", 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2720000000000002e-06 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35413 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750043+0000", 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001755658, 2024-09-14T08:39:57.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032998580000000001, 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35413 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750043+0000", 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750043+0000", 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750043+0000", 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6899999999999999e-07 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750044+0000", 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4130000000000001e-06 2024-09-14T08:39:57.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750048+0000", 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579999999999998e-06 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750051+0000", 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0429999999999999e-06 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.964 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35380 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749502+0000", 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002296125, 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038640160000000001, 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35380 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749502+0000", 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749502+0000", 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749503+0000", 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7300000000000001e-07 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749504+0000", 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2780000000000001e-06 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749507+0000", 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4189999999999998e-06 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749515+0000", 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0339999999999997e-06 2024-09-14T08:39:57.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35415 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750055+0000", 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001742871, 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003335869, 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35415 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750055+0000", 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750055+0000", 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750056+0000", 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5400000000000002e-07 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750057+0000", 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3090000000000001e-06 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750060+0000", 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4079999999999998e-06 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750063+0000", 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9270000000000001e-06 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35381 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.971 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749520+0000", 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0022782760000000001, 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038985230000000001, 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35381 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749520+0000", 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749520+0000", 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749520+0000", 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9400000000000001e-07 2024-09-14T08:39:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749522+0000", 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.398e-06 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749525+0000", 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6600000000000001e-06 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749528+0000", 2024-09-14T08:39:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1760000000000002e-06 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35416 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750067+0000", 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0017312040000000001, 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003375004, 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35416 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750067+0000", 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750067+0000", 2024-09-14T08:39:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750067+0000", 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7899999999999999e-07 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750069+0000", 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2300000000000001e-06 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750072+0000", 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3119999999999998e-06 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750075+0000", 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.937e-06 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35382 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749532+0000", 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002265988, 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039336459999999998, 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35382 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749532+0000", 2024-09-14T08:39:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749532+0000", 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749533+0000", 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7899999999999999e-07 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749534+0000", 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.238e-06 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749537+0000", 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.281e-06 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749540+0000", 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9830000000000001e-06 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35418 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750092+0000", 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0017065310000000001, 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034569169999999999, 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35418 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750092+0000", 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750092+0000", 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750092+0000", 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.63e-07 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750094+0000", 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4270000000000001e-06 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750097+0000", 2024-09-14T08:39:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.726e-06 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750100+0000", 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1149999999999998e-06 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35383 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749557+0000", 2024-09-14T08:39:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0022412439999999999, 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040178159999999996, 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35383 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749557+0000", 2024-09-14T08:39:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749557+0000", 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749557+0000", 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6700000000000003e-07 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749559+0000", 2024-09-14T08:39:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8369999999999999e-06 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749564+0000", 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4410000000000003e-06 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749569+0000", 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9919999999999998e-06 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35419 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750134+0000", 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0016639929999999999, 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034642789999999998, 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35419 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750134+0000", 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750134+0000", 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750135+0000", 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6800000000000001e-07 2024-09-14T08:39:57.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750136+0000", 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750140+0000", 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7780000000000001e-06 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750143+0000", 2024-09-14T08:39:57.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.01e-06 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35384 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749592+0000", 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002206108, 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040322450000000003, 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35384 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749592+0000", 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749592+0000", 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749593+0000", 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749600+0000", 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7039999999999994e-06 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749606+0000", 2024-09-14T08:39:57.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4739999999999996e-06 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749611+0000", 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0860000000000001e-06 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35420 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750165+0000", 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001633114, 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034842800000000002, 2024-09-14T08:39:57.995 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35420 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750165+0000", 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750165+0000", 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750166+0000", 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6800000000000001e-07 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750167+0000", 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3510000000000001e-06 2024-09-14T08:39:57.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750172+0000", 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8849999999999998e-06 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750175+0000", 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.016e-06 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35385 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749617+0000", 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021816240000000001, 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040588330000000004, 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35385 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:57.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749617+0000", 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749617+0000", 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749617+0000", 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:39:58.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749618+0000", 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.361e-06 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749622+0000", 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5990000000000002e-06 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749625+0000", 2024-09-14T08:39:58.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2030000000000001e-06 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35421 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750195+0000", 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001603447, 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0035047939999999999, 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:58.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35421 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750195+0000", 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750195+0000", 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750195+0000", 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6100000000000001e-07 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750197+0000", 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3740000000000001e-06 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750200+0000", 2024-09-14T08:39:58.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.732e-06 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750204+0000", 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2329999999999998e-06 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35386 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749629+0000", 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021691359999999999, 2024-09-14T08:39:58.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040969040000000002, 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35386 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749629+0000", 2024-09-14T08:39:58.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749629+0000", 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749629+0000", 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4400000000000001e-07 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:58.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749631+0000", 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.235e-06 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749634+0000", 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2830000000000002e-06 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749637+0000", 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35422 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750208+0000", 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001590263, 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0035416599999999999, 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35422 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.009 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750208+0000", 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750208+0000", 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:58.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750208+0000", 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8099999999999998e-07 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750209+0000", 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.159e-06 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750213+0000", 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3050000000000001e-06 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:58.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750216+0000", 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0240000000000002e-06 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35387 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.749642+0000", 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002155948, 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0041328789999999999, 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:58.012 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35387 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749642+0000", 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749642+0000", 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749643+0000", 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749644+0000", 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.26e-06 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749647+0000", 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3620000000000002e-06 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.749656+0000", 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7269999999999996e-06 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:35423 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.750220+0000", 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0015778159999999999, 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0035784720000000001, 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35423 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.016 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750220+0000", 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750220+0000", 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:39:58.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750221+0000", 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4200000000000002e-07 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750222+0000", 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.237e-06 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750225+0000", 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3869999999999999e-06 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:39:58.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.750228+0000", 2024-09-14T08:39:58.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8569999999999999e-06 2024-09-14T08:39:58.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.019 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:39:58.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:39:58.019 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:39:58.019 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 79 2024-09-14T08:39:58.019 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:58.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:39:58.021 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:58.020+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:58.121 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:58.125+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:58.159 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:39:58.159 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:39:58.159 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:39:58.159 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:39:58.160 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:39:58.160 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:39:58.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:39:58.224 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:58.229+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:58.297 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:39:58.321 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:39:58.322 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:39:58.323 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:58.324+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:58.338 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:39:58.339 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:39:58.347 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:58.347 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:58.364 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:39:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:39:58.370 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:39:58.399 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:39:58.399 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:39:58.420 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:39:58.420 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:39:58.424 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:39:58.424 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:39:58.424 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:58.429+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:58.483 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:58.483 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:58.498 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:39:58.525 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:58.524+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:58.626 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:58.628+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:58.641 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:58.642 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:58.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:39:58.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:39:58.726 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:58.728+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:58.785 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:58.785 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:58.803 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:39:58.853 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:58.856+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:58.928 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:58.928+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:58.959 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:58.959 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:58.976 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:39:59.029 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:59.033+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:59.130 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:59.133+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:59.142 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:59.142 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:59.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:39:59.231 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:39:59.232+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:39:59.286 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:59.286 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:59.300 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:39:59.346 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:39:59.344+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:39:59.433 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:59.437+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:59.483 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:59.484 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:59.498 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:39:59.534 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:59.537+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:59.601 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:39:59.626 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:59.626 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:59.635 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:39:59.636+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:39:59.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:39:59.736 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:59.737+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:59.815 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:59.815 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:59.834 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:39:59.836 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:39:59.837+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:39:59.937 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:39:59.941+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:39:59.962 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:39:59.963 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:39:59.981 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:00.038 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:00.041+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:00.101 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:00.102 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:00.116 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:00.161 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:00.164+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:00.241 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:00.245+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:00.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:00.341 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:00.345+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:00.394 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:00.394 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:00.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:00.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:00.452 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:00.457+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:00.543 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:00.548+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:00.590 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:00.591 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:00.594 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:00.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:00.614 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:00.614 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:00.630 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:00.631 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:00.643 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:00.648+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:00.657 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:00.657 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:00.692 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:00.693 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:00.720 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:00.721 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:00.724 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:00.725 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:00.735 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31796 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3295232~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925501+0000", 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8146762380000001, 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070679979000000004, 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31796 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925501+0000", 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925501+0000", 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925502+0000", 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3399999999999999e-07 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925511+0000", 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925518+0000", 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6490000000000008e-06 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925525+0000", 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6640000000000001e-06 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.995833+0000", 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070308207999999997 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.995933+0000", 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010009999999999999 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996181+0000", 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024783200000000002 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31797 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3304448~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8146445280000001, 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071016060000000006, 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31797 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0699999999999997e-07 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925536+0000", 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.368e-06 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925543+0000", 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.781e-06 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925548+0000", 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996245+0000", 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070697276000000003 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996352+0000", 2024-09-14T08:40:00.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107054 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996549+0000", 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000196942 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31798 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3306496~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8146225080000002, 2024-09-14T08:40:00.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071397830999999995, 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31798 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925558+0000", 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2069999999999998e-06 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925564+0000", 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6290000000000004e-06 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925569+0000", 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.164e-06 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996603+0000", 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071033712999999998 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996708+0000", 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010466700000000001 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996953+0000", 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000244959 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.749 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31799 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3315712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8146011509999997, 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071768473999999999, 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31799 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925577+0000", 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925579+0000", 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925587+0000", 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925593+0000", 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997015+0000", 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071422484999999994 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997130+0000", 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115053 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997345+0000", 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214379 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31800 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3326976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8145774650000002, 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072113090000000005, 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31800 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.755 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925603+0000", 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925610+0000", 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8029999999999997e-06 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925618+0000", 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6930000000000007e-06 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997400+0000", 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071781929999999994 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997507+0000", 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107012 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997713+0000", 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020603 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8145517760000001, 2024-09-14T08:40:00.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:40:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.763 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8145292199999998, 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8144612049999997, 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:00.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8144114770000002, 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:40:00.773 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:40:00.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8143603219999997, 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.778 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:40:00.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8143083190000002, 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:40:00.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:40:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8142457489999999, 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.787 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:40:00.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8141791710000001, 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:40:00.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.814101387, 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:40:00.796 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:40:00.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:40:00.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.800 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8140486920000001, 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.801 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:40:00.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:40:00.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:00.805 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8140030390000002, 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:00.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:40:00.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:40:00.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.813956568, 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.810 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:40:00.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:00.814 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8139105799999999, 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:40:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.813882322, 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:40:00.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:40:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:00.823 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.813827544, 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:00.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:00.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.827 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.828 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.828 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:00.828 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:00.828 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:00.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:00.830 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:00.836+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:00.930 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:00.936+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:01.031 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:01.036+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:01.044 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:01.044 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53810 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030626+0000", 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012933429999999999, 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012985524, 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53810 2024-09-14T08:40:01.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030626+0000", 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030626+0000", 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030627+0000", 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5300000000000003e-07 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030630+0000", 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9830000000000001e-06 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030639+0000", 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3689999999999996e-06 2024-09-14T08:40:01.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030648+0000", 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6549999999999993e-06 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53856 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031715+0000", 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011844647, 2024-09-14T08:40:01.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012019185, 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53856 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031715+0000", 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031715+0000", 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031715+0000", 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031718+0000", 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031726+0000", 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2090000000000005e-06 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031733+0000", 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9290000000000001e-06 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.051 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53811 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030660+0000", 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012899221000000001, 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013149697, 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.052 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53811 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030660+0000", 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030660+0000", 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030661+0000", 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3699999999999999e-07 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030664+0000", 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8420000000000001e-06 2024-09-14T08:40:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030682+0000", 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8158000000000001e-05 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030689+0000", 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.289e-06 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53857 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031747+0000", 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011812507999999999, 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012133764999999999, 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53857 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031747+0000", 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031747+0000", 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031747+0000", 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:40:01.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031750+0000", 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7199999999999998e-06 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031760+0000", 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0424999999999999e-05 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031768+0000", 2024-09-14T08:40:01.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1389999999999998e-06 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53812 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030700+0000", 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012858703000000001, 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013291852999999999, 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.059 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53812 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030700+0000", 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030700+0000", 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030701+0000", 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030704+0000", 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.796e-06 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030714+0000", 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9760000000000007e-06 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030721+0000", 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6919999999999996e-06 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53883 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.062 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031777+0000", 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011782551, 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012290324, 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53883 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031777+0000", 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031777+0000", 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031778+0000", 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0299999999999997e-07 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031780+0000", 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6860000000000002e-06 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031791+0000", 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1082e-05 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031798+0000", 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:40:01.065 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53813 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030730+0000", 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012829623, 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013407110999999999, 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.066 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53813 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030730+0000", 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030730+0000", 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030730+0000", 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030733+0000", 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7860000000000001e-06 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030742+0000", 2024-09-14T08:40:01.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5059999999999995e-06 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030748+0000", 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7560000000000002e-06 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53886 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031819+0000", 2024-09-14T08:40:01.069 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011739774, 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012393688999999999, 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53886 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031819+0000", 2024-09-14T08:40:01.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031819+0000", 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031820+0000", 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031823+0000", 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9040000000000001e-06 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031832+0000", 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9619999999999999e-06 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031839+0000", 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9959999999999996e-06 2024-09-14T08:40:01.072 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53814 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030757+0000", 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012801817, 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013571679999999999, 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.073 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53814 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030757+0000", 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030757+0000", 2024-09-14T08:40:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030758+0000", 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1999999999999999e-07 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030761+0000", 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.88e-06 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030769+0000", 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2989999999999997e-06 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030776+0000", 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6919999999999996e-06 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53888 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.076 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031848+0000", 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011710884, 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012555988000000001, 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53888 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031848+0000", 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031848+0000", 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031849+0000", 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9299999999999997e-07 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031852+0000", 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7769999999999998e-06 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031860+0000", 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2719999999999997e-06 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031877+0000", 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7125e-05 2024-09-14T08:40:01.079 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53815 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030788+0000", 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012771589999999999, 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013686004999999999, 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.080 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53815 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030788+0000", 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030788+0000", 2024-09-14T08:40:01.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030788+0000", 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030814+0000", 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5976999999999999e-05 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030825+0000", 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1114999999999999e-05 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030832+0000", 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8990000000000004e-06 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53890 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.083 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031888+0000", 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011671645, 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012655272, 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53890 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031888+0000", 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031888+0000", 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031888+0000", 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3300000000000001e-07 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031891+0000", 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9459999999999998e-06 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031904+0000", 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3091999999999999e-05 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031911+0000", 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0060000000000003e-06 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53816 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030843+0000", 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012716313999999999, 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013808131, 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53816 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030843+0000", 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030843+0000", 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030844+0000", 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5700000000000002e-07 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030847+0000", 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8760000000000001e-06 2024-09-14T08:40:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030866+0000", 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9881000000000002e-05 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030874+0000", 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2320000000000004e-06 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53892 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031920+0000", 2024-09-14T08:40:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011639086, 2024-09-14T08:40:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012806952999999999, 2024-09-14T08:40:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53892 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031920+0000", 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031920+0000", 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031921+0000", 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031924+0000", 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031932+0000", 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2919999999999996e-06 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031939+0000", 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8190000000000003e-06 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53817 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030884+0000", 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012675562, 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01391264, 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53817 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030884+0000", 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030884+0000", 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030885+0000", 2024-09-14T08:40:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030887+0000", 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9189999999999999e-06 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030896+0000", 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6049999999999998e-06 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030903+0000", 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6930000000000001e-06 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53894 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031948+0000", 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011611626, 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012918112000000001, 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53894 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031948+0000", 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031948+0000", 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031948+0000", 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3300000000000002e-07 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031951+0000", 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8229999999999999e-06 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031962+0000", 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1272e-05 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031969+0000", 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7120000000000003e-06 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53818 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030912+0000", 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012647200000000001, 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014067712, 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53818 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030912+0000", 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030912+0000", 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030913+0000", 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2399999999999998e-07 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030915+0000", 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6730000000000001e-06 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030924+0000", 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4589999999999998e-06 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030931+0000", 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0090000000000001e-06 2024-09-14T08:40:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53896 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031978+0000", 2024-09-14T08:40:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011581197, 2024-09-14T08:40:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013080675999999999, 2024-09-14T08:40:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53896 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031978+0000", 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031978+0000", 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031979+0000", 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.37e-07 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031981+0000", 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7259999999999998e-06 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031992+0000", 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0672e-05 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031999+0000", 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.216e-06 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53819 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030940+0000", 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012619606, 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014192728999999999, 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53819 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030940+0000", 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030940+0000", 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030940+0000", 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9599999999999998e-07 2024-09-14T08:40:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030943+0000", 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.723e-06 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030952+0000", 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5259999999999993e-06 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030958+0000", 2024-09-14T08:40:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6290000000000004e-06 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53898 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.032008+0000", 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011551171000000001, 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013198641000000001, 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53898 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032008+0000", 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032008+0000", 2024-09-14T08:40:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032009+0000", 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032017+0000", 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5059999999999995e-06 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032026+0000", 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7250000000000003e-06 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032033+0000", 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0260000000000002e-06 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53820 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030969+0000", 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012590280000000001, 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014340317, 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53820 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030969+0000", 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030969+0000", 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030970+0000", 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030972+0000", 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7130000000000001e-06 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030981+0000", 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5059999999999995e-06 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030988+0000", 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7889999999999997e-06 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53900 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.032042+0000", 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011517095, 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013337603, 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53900 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032042+0000", 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032042+0000", 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032043+0000", 2024-09-14T08:40:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032045+0000", 2024-09-14T08:40:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.694e-06 2024-09-14T08:40:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032054+0000", 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4020000000000002e-06 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032061+0000", 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7819999999999996e-06 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53821 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030997+0000", 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012562647, 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014452019999999999, 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53821 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030997+0000", 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030997+0000", 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030997+0000", 2024-09-14T08:40:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4300000000000003e-07 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031000+0000", 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7369999999999998e-06 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031013+0000", 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3365e-05 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031023+0000", 2024-09-14T08:40:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8819999999999996e-06 2024-09-14T08:40:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53902 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.032101+0000", 2024-09-14T08:40:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011458265, 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013416353000000001, 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53902 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032101+0000", 2024-09-14T08:40:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032101+0000", 2024-09-14T08:40:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032102+0000", 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0599999999999999e-07 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032105+0000", 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9660000000000001e-06 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032115+0000", 2024-09-14T08:40:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0499000000000001e-05 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032122+0000", 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.922e-06 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53822 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031033+0000", 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012526667999999999, 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014597302, 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53822 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031033+0000", 2024-09-14T08:40:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031033+0000", 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031033+0000", 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3300000000000002e-07 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031036+0000", 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8399999999999999e-06 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031044+0000", 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3920000000000003e-06 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031051+0000", 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8460000000000002e-06 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53904 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.032132+0000", 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011427163000000001, 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013574297000000001, 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53904 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032132+0000", 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032132+0000", 2024-09-14T08:40:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032133+0000", 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9999999999999996e-07 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032136+0000", 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032146+0000", 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0789e-05 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.032153+0000", 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9890000000000003e-06 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53823 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031060+0000", 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012499250999999999, 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014715493, 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53823 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031060+0000", 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031060+0000", 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031061+0000", 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5600000000000005e-07 2024-09-14T08:40:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031063+0000", 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8030000000000001e-06 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031083+0000", 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9497999999999999e-05 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031090+0000", 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.272e-06 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53824 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031100+0000", 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012459313, 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014772046, 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53824 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031100+0000", 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031100+0000", 2024-09-14T08:40:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031101+0000", 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031104+0000", 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.932e-06 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031112+0000", 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7530000000000007e-06 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031119+0000", 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.849e-06 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53826 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031128+0000", 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012431183, 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014833178000000001, 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53826 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031128+0000", 2024-09-14T08:40:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031128+0000", 2024-09-14T08:40:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031129+0000", 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9599999999999999e-07 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031131+0000", 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7199999999999998e-06 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031140+0000", 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3690000000000007e-06 2024-09-14T08:40:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031146+0000", 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7059999999999998e-06 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53827 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031158+0000", 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012400757, 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014872387000000001, 2024-09-14T08:40:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53827 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031158+0000", 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031158+0000", 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031159+0000", 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5300000000000004e-07 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031162+0000", 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7630000000000001e-06 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031173+0000", 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0839000000000001e-05 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031179+0000", 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7859999999999999e-06 2024-09-14T08:40:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53828 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031218+0000", 2024-09-14T08:40:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012341114, 2024-09-14T08:40:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014886208, 2024-09-14T08:40:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53828 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031218+0000", 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031218+0000", 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031219+0000", 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3600000000000002e-07 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031229+0000", 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6420000000000002e-06 2024-09-14T08:40:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031240+0000", 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1212e-05 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031247+0000", 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1489999999999997e-06 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53829 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031257+0000", 2024-09-14T08:40:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012301968999999999, 2024-09-14T08:40:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014943124, 2024-09-14T08:40:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53829 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031257+0000", 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031257+0000", 2024-09-14T08:40:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031258+0000", 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031261+0000", 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031270+0000", 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5990000000000002e-06 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031276+0000", 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7429999999999996e-06 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53831 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031285+0000", 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012273930000000001, 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015015489, 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53831 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031285+0000", 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031285+0000", 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031286+0000", 2024-09-14T08:40:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0699999999999997e-07 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031289+0000", 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.706e-06 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031299+0000", 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0655999999999999e-05 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031306+0000", 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8460000000000002e-06 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53833 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031315+0000", 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.01224425, 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015081031, 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53833 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031315+0000", 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031315+0000", 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031316+0000", 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031319+0000", 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0299999999999998e-06 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031327+0000", 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1990000000000006e-06 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031334+0000", 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0090000000000001e-06 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53796 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 5764096~1024 out=1024b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030113+0000", 2024-09-14T08:40:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013445848999999999, 2024-09-14T08:40:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016396345, 2024-09-14T08:40:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53796 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030113+0000", 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030113+0000", 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030114+0000", 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030117+0000", 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7760000000000002e-06 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030127+0000", 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8390000000000002e-06 2024-09-14T08:40:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030136+0000", 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3859999999999996e-06 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.046211+0000", 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016074832000000001 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.046348+0000", 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013690600000000001 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.046510+0000", 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016197600000000001 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53835 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031343+0000", 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012216276999999999, 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015341631, 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53835 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031343+0000", 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031343+0000", 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031344+0000", 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4000000000000001e-07 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031346+0000", 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6730000000000001e-06 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031354+0000", 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1359999999999997e-06 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031361+0000", 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7360000000000004e-06 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53799 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 5646336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030145+0000", 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013414083, 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016628106, 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53799 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030145+0000", 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030145+0000", 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030146+0000", 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5600000000000005e-07 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030149+0000", 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7870000000000002e-06 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030158+0000", 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7690000000000008e-06 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030170+0000", 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1654999999999999e-05 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.046575+0000", 2024-09-14T08:40:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016404861 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.046717+0000", 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014183199999999999 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53836 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031370+0000", 2024-09-14T08:40:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012189317, 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015518402000000001, 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53836 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031370+0000", 2024-09-14T08:40:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031370+0000", 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031371+0000", 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.37e-07 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031373+0000", 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6589999999999999e-06 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031384+0000", 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0479000000000001e-05 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031391+0000", 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8920000000000003e-06 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.183 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53801 3.7 3:e0ddee08:::rbd_data.10f1c6465cc8.0000000000000002:8 [read 5657600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030188+0000", 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013371678999999999, 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016810803999999999, 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53801 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030188+0000", 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030188+0000", 2024-09-14T08:40:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030188+0000", 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030191+0000", 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1470000000000001e-06 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030205+0000", 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4117999999999999e-05 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030213+0000", 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2989999999999999e-06 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.046881+0000", 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016668527999999998 2024-09-14T08:40:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.047002+0000", 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120671 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53840 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031401+0000", 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012158224, 2024-09-14T08:40:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015682825000000001, 2024-09-14T08:40:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53840 2024-09-14T08:40:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031401+0000", 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031401+0000", 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031402+0000", 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.37e-07 2024-09-14T08:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031404+0000", 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7690000000000001e-06 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031414+0000", 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7820000000000005e-06 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031421+0000", 2024-09-14T08:40:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9090000000000003e-06 2024-09-14T08:40:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53802 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030256+0000", 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013303583000000001, 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016912199999999999, 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53802 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030256+0000", 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030256+0000", 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030256+0000", 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8899999999999998e-07 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030259+0000", 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8059999999999999e-06 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030273+0000", 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4065e-05 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030285+0000", 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1639e-05 2024-09-14T08:40:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.047188+0000", 2024-09-14T08:40:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016903097999999998 2024-09-14T08:40:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53842 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031430+0000", 2024-09-14T08:40:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012129311, 2024-09-14T08:40:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015842438, 2024-09-14T08:40:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53842 2024-09-14T08:40:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031430+0000", 2024-09-14T08:40:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031430+0000", 2024-09-14T08:40:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031431+0000", 2024-09-14T08:40:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031433+0000", 2024-09-14T08:40:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7939999999999998e-06 2024-09-14T08:40:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031444+0000", 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0618000000000001e-05 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031451+0000", 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8889999999999996e-06 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53803 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030295+0000", 2024-09-14T08:40:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013264322, 2024-09-14T08:40:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017053665999999999, 2024-09-14T08:40:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53803 2024-09-14T08:40:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030295+0000", 2024-09-14T08:40:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030295+0000", 2024-09-14T08:40:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030296+0000", 2024-09-14T08:40:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030319+0000", 2024-09-14T08:40:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3184e-05 2024-09-14T08:40:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030366+0000", 2024-09-14T08:40:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7126999999999998e-05 2024-09-14T08:40:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030374+0000", 2024-09-14T08:40:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2689999999999999e-06 2024-09-14T08:40:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53844 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031462+0000", 2024-09-14T08:40:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012097399, 2024-09-14T08:40:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016002595000000001, 2024-09-14T08:40:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53844 2024-09-14T08:40:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031462+0000", 2024-09-14T08:40:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031462+0000", 2024-09-14T08:40:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031463+0000", 2024-09-14T08:40:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3399999999999998e-07 2024-09-14T08:40:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031465+0000", 2024-09-14T08:40:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7499999999999999e-06 2024-09-14T08:40:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031476+0000", 2024-09-14T08:40:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0444e-05 2024-09-14T08:40:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031483+0000", 2024-09-14T08:40:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2200000000000003e-06 2024-09-14T08:40:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53804 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030387+0000", 2024-09-14T08:40:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013172074000000001, 2024-09-14T08:40:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017162809000000001, 2024-09-14T08:40:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53804 2024-09-14T08:40:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030387+0000", 2024-09-14T08:40:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030387+0000", 2024-09-14T08:40:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030388+0000", 2024-09-14T08:40:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1399999999999995e-07 2024-09-14T08:40:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030392+0000", 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5530000000000001e-06 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030401+0000", 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1449999999999997e-06 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030409+0000", 2024-09-14T08:40:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5520000000000005e-06 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53846 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031504+0000", 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012055277, 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016115620000000001, 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53846 2024-09-14T08:40:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031504+0000", 2024-09-14T08:40:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031504+0000", 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031505+0000", 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3699999999999999e-07 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031508+0000", 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9019999999999999e-06 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031526+0000", 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7878000000000001e-05 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031536+0000", 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0081999999999999e-05 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53805 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030418+0000", 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013140821, 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017273712, 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53805 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030418+0000", 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030418+0000", 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030419+0000", 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4300000000000003e-07 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030422+0000", 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7640000000000001e-06 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030440+0000", 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8614000000000002e-05 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030447+0000", 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0890000000000002e-06 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53848 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031548+0000", 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012011320000000001, 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016245191999999999, 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53848 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031548+0000", 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031548+0000", 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031549+0000", 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.54e-07 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031552+0000", 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8399999999999999e-06 2024-09-14T08:40:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031560+0000", 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5949999999999999e-06 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031567+0000", 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7789999999999998e-06 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53806 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030457+0000", 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013101796000000001, 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017418686999999999, 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53806 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030457+0000", 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030457+0000", 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030458+0000", 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5000000000000002e-07 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030461+0000", 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030472+0000", 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1425e-05 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030481+0000", 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2330000000000006e-06 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53849 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031576+0000", 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011983133, 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016369569, 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53849 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031576+0000", 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031576+0000", 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031577+0000", 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031579+0000", 2024-09-14T08:40:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6860000000000002e-06 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031588+0000", 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.276e-06 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031594+0000", 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7259999999999996e-06 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53807 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030494+0000", 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.01306539, 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017524113000000001, 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53807 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030494+0000", 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030494+0000", 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030494+0000", 2024-09-14T08:40:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4700000000000001e-07 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030498+0000", 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2090000000000001e-06 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030506+0000", 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5189999999999992e-06 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030513+0000", 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9450000000000004e-06 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53851 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031619+0000", 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011940598, 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016506377999999999, 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53851 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031619+0000", 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031619+0000", 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031619+0000", 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7599999999999997e-07 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031628+0000", 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9460000000000004e-06 2024-09-14T08:40:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031639+0000", 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0502e-05 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031646+0000", 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1289999999999998e-06 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53808 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030522+0000", 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013037221, 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017674947999999999, 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53808 2024-09-14T08:40:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030522+0000", 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030522+0000", 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030523+0000", 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2699999999999999e-07 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030525+0000", 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030539+0000", 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3604999999999999e-05 2024-09-14T08:40:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030546+0000", 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9360000000000002e-06 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53853 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031656+0000", 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011903389, 2024-09-14T08:40:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016616663, 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53853 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031656+0000", 2024-09-14T08:40:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031656+0000", 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031656+0000", 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031659+0000", 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8059999999999999e-06 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031668+0000", 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3690000000000007e-06 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031676+0000", 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1720000000000007e-06 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53809 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.030558+0000", 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013001598, 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017783784, 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53809 2024-09-14T08:40:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030558+0000", 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030558+0000", 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030558+0000", 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030561+0000", 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030580+0000", 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9004999999999998e-05 2024-09-14T08:40:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.030592+0000", 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1455e-05 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:53855 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:01.031685+0000", 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.01187421, 2024-09-14T08:40:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016780473000000001, 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 53855 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031685+0000", 2024-09-14T08:40:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031685+0000", 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031686+0000", 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8299999999999996e-07 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031688+0000", 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031699+0000", 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0471e-05 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:01.031706+0000", 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8059999999999997e-06 2024-09-14T08:40:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 56 2024-09-14T08:40:01.259 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:01.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:01.261 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:01.265+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:01.361 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:01.364+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:01.450 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:01.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:01.451 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:01.451 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:01.451 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:01.462 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:01.468+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:01.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:01.563 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:01.568+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:01.601 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33401 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3549184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.327563413, 2024-09-14T08:40:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065012249999999994, 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33401 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4000000000000001e-07 2024-09-14T08:40:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277738+0000", 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8729999999999999e-06 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277747+0000", 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6319999999999997e-06 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277754+0000", 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2729999999999997e-06 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342439+0000", 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064685272000000002 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342540+0000", 2024-09-14T08:40:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342747+0000", 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020656 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33403 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3560448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3274717489999999, 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065276109999999998, 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33403 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277827+0000", 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.23e-07 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277830+0000", 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277839+0000", 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277846+0000", 2024-09-14T08:40:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1590000000000004e-06 2024-09-14T08:40:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342820+0000", 2024-09-14T08:40:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064974064999999998 2024-09-14T08:40:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342954+0000", 2024-09-14T08:40:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133509 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343102+0000", 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000148539 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33404 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3571712~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3274402869999999, 2024-09-14T08:40:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065555713000000002, 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33404 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277861+0000", 2024-09-14T08:40:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9790000000000002e-06 2024-09-14T08:40:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277881+0000", 2024-09-14T08:40:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9463999999999999e-05 2024-09-14T08:40:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277889+0000", 2024-09-14T08:40:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7190000000000001e-06 2024-09-14T08:40:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343177+0000", 2024-09-14T08:40:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065288760000000001 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343279+0000", 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101974 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343414+0000", 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013411 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33405 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3273989759999996, 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065812103999999996, 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33405 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277900+0000", 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277922+0000", 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1540999999999999e-05 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277932+0000", 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0587999999999999e-05 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277940+0000", 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5360000000000004e-06 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343480+0000", 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065539753000000006 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343581+0000", 2024-09-14T08:40:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101005 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343711+0000", 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013069500000000001 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3273468429999999, 2024-09-14T08:40:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:40:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:40:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3273180470000003, 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:40:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:40:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:40:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3272892279999997, 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:40:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:40:01.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3272608989999997, 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:40:01.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3272316990000004, 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.641 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:40:01.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:40:01.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3271996909999997, 2024-09-14T08:40:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:01.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:40:01.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:40:01.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:40:01.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3271704150000003, 2024-09-14T08:40:01.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:01.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:40:01.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3271407489999998, 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.655 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:01.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.659 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3271122059999998, 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.660 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:40:01.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3270838999999999, 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:40:01.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3270386329999999, 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:40:01.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3270070110000001, 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.674 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:40:01.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:40:01.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3269491990000004, 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:40:01.678 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:40:01.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.682 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3268811859999996, 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:40:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.687 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3268458140000003, 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:40:01.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.3268114149999999, 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:01.692 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:40:01.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.697 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.697 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:01.697 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:01.697 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:01.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:40:01.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:01.699 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:01.704+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:01.799 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:01.804+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:01.836 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:01.836 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:01.837 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:01.837 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:01.850 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:01.900 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:01.901+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:02.001 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:02.005+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:02.031 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:02.031 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:02.031 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:02.031 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:02.032 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:02.045 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:02.102 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:02.108+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:02.183 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:02.183 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:02.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:02.183 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:02.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.183 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.183 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:02.184 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.938826046, 2024-09-14T08:40:02.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:40:02.184 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.184 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.184 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:40:02.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.185 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:02.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:02.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:40:02.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:40:02.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:40:02.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:40:02.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:40:02.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:40:02.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:40:02.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:40:02.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:40:02.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:40:02.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:40:02.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:40:02.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:40:02.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:40:02.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.189 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.190 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.190 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:02.190 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.938764033, 2024-09-14T08:40:02.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:40:02.190 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.190 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.190 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.191 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:40:02.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.191 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:02.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:02.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:40:02.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:40:02.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:40:02.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:40:02.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9386977029999999, 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:02.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:40:02.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.200 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9386422429999999, 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:40:02.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:40:02.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:40:02.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:40:02.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.205 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9385826229999998, 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.206 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:40:02.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:40:02.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:40:02.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:40:02.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:40:02.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:40:02.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:40:02.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:40:02.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.211 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.212 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.212 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:02.212 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9385010830000002, 2024-09-14T08:40:02.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:40:02.212 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.213 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.213 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.213 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:40:02.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.213 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:02.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:02.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:40:02.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:40:02.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:40:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:40:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:40:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:40:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:40:02.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:40:02.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:40:02.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:40:02.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:40:02.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:40:02.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:40:02.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:40:02.218 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.218 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.218 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.219 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.219 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:02.219 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9384447549999999, 2024-09-14T08:40:02.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:40:02.219 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.219 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.219 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.220 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:40:02.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.220 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:02.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:02.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:40:02.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:02.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:40:02.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:40:02.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:40:02.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:40:02.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:40:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:40:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:40:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:40:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9383732600000001, 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:40:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9383003890000001, 2024-09-14T08:40:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:40:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:40:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:40:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9382581769999998, 2024-09-14T08:40:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:40:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:40:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:40:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:40:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9382283469999999, 2024-09-14T08:40:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:40:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:40:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:40:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:40:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:40:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:40:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:40:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:40:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:40:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:40:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9382000499999998, 2024-09-14T08:40:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:40:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:40:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:40:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:40:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:40:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:40:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:40:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.938158955, 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:40:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9381299250000001, 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:40:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:40:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9381014410000001, 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:40:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:40:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:40:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:40:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:40:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:40:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:40:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:40:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9380733010000002, 2024-09-14T08:40:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:40:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:40:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:40:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:40:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:40:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:40:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:40:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:40:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:40:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:40:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:40:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:40:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:40:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:40:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:40:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:40:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.938044605, 2024-09-14T08:40:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:40:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:40:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:40:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:40:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:40:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:40:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:40:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:40:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:40:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:40:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:40:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:40:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:40:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:40:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:40:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.938015848, 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:40:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:40:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9379878010000002, 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:40:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:40:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9379578240000002, 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:40:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.298 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:02.298 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:40:02.298 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:40:02.299 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-14T08:40:02.299 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T08:40:02.299 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T08:40:02.299 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-14T08:40:02.301 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:02.301 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:02.304+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:02.400 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:02.401+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:02.478 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:02.478 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T08:40:02.478 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:02.487 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:02.487 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:02.487 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:02.487 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:02.501 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:02.504+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:02.502 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:02.605 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:40:02.606 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:02.609+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:02.679 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:02.679 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:02.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:02.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:02.746 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:02.752+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:02.802 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:02.805+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:02.824 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:02.824 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:02.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:02.824 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:02.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50435 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.251601990000001, 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089137862999999998, 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50435 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.825 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577709+0000", 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2100000000000002e-06 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577718+0000", 2024-09-14T08:40:02.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0180000000000007e-06 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577727+0000", 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8959999999999992e-06 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666826+0000", 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089099245999999993 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666843+0000", 2024-09-14T08:40:02.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6702999999999999e-05 2024-09-14T08:40:02.829 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.829 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.829 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.829 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50436 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.829 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577736+0000", 2024-09-14T08:40:02.829 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.251570328, 2024-09-14T08:40:02.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089177490999999998, 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50436 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577736+0000", 2024-09-14T08:40:02.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577736+0000", 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577737+0000", 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.23e-07 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577740+0000", 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9459999999999998e-06 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577748+0000", 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3890000000000005e-06 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577755+0000", 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9659999999999999e-06 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666901+0000", 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089145996000000005 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666914+0000", 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2471e-05 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.834 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50437 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.834 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:40:02.834 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.251542013000002, 2024-09-14T08:40:02.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089225676000000004, 2024-09-14T08:40:02.834 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.834 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.834 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.834 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.834 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50437 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577768+0000", 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577777+0000", 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.259e-06 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577784+0000", 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9619999999999996e-06 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666971+0000", 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089187113999999998 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666990+0000", 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9728000000000002e-05 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50438 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577793+0000", 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.251513880000001, 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089268996000000003, 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.838 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50438 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577793+0000", 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577793+0000", 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577794+0000", 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1299999999999999e-07 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577796+0000", 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9459999999999998e-06 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577805+0000", 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3850000000000002e-06 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577812+0000", 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8059999999999997e-06 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667049+0000", 2024-09-14T08:40:02.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089236920999999997 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667062+0000", 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3225e-05 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50439 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577821+0000", 2024-09-14T08:40:02.842 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.251485388999999, 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089313248999999997, 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50439 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577821+0000", 2024-09-14T08:40:02.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577821+0000", 2024-09-14T08:40:02.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577822+0000", 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577844+0000", 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1877000000000001e-05 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577854+0000", 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9350000000000006e-06 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577861+0000", 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2989999999999999e-06 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667117+0000", 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089255930999999997 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667135+0000", 2024-09-14T08:40:02.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7496999999999999e-05 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50440 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577904+0000", 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.251402517999999, 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089307379000000006, 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.847 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50440 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577904+0000", 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577904+0000", 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577906+0000", 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.996e-06 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577912+0000", 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6420000000000004e-06 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577929+0000", 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7421000000000001e-05 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577943+0000", 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4059999999999999e-05 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667192+0000", 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089248220000000003 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667212+0000", 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0040000000000001e-05 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50441 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577967+0000", 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.251339781999999, 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089318996999999997, 2024-09-14T08:40:02.851 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50441 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577967+0000", 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577967+0000", 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577968+0000", 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.133e-06 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577974+0000", 2024-09-14T08:40:02.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.195e-06 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577995+0000", 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0404e-05 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578007+0000", 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2758000000000001e-05 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667269+0000", 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089261251999999999 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667286+0000", 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.855 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50442 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578029+0000", 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.251277936000001, 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089325107000000001, 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.856 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50442 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578029+0000", 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578029+0000", 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578030+0000", 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0300000000000001e-06 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578035+0000", 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4129999999999997e-06 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578052+0000", 2024-09-14T08:40:02.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6704000000000001e-05 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578068+0000", 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6393999999999999e-05 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667339+0000", 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089270648999999994 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667354+0000", 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4917e-05 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50443 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578086+0000", 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.251220345, 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089354797, 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.860 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50443 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578086+0000", 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578086+0000", 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578087+0000", 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.077e-06 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578093+0000", 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6389999999999997e-06 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578115+0000", 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1625999999999999e-05 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578158+0000", 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3680000000000002e-05 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667424+0000", 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089265854000000006 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667441+0000", 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6920999999999999e-05 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50444 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578199+0000", 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.2511075, 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089308203000000003, 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.864 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.865 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.865 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.865 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.865 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.865 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50444 2024-09-14T08:40:02.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.865 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578199+0000", 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578199+0000", 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578201+0000", 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.407e-06 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578208+0000", 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9949999999999999e-06 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578234+0000", 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6526e-05 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578249+0000", 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5234e-05 2024-09-14T08:40:02.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667495+0000", 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089245559000000002 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667507+0000", 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2482e-05 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50445 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578269+0000", 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.251037191999998, 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089310284000000004, 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50445 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.869 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578269+0000", 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578269+0000", 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578271+0000", 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4500000000000001e-06 2024-09-14T08:40:02.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578276+0000", 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4759999999999997e-06 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578295+0000", 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8153999999999999e-05 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578313+0000", 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667563+0000", 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089249980000000007 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667580+0000", 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7244e-05 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.872 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50446 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578330+0000", 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.250976468000001, 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089312538999999996, 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.873 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50446 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578330+0000", 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578330+0000", 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578332+0000", 2024-09-14T08:40:02.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3060000000000001e-06 2024-09-14T08:40:02.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578337+0000", 2024-09-14T08:40:02.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2429999999999996e-06 2024-09-14T08:40:02.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578356+0000", 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8867000000000001e-05 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578369+0000", 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3301e-05 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667630+0000", 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089261484000000002 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667643+0000", 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2337999999999999e-05 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50447 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578393+0000", 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.250914018, 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089321038000000005, 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50447 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578393+0000", 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578393+0000", 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578394+0000", 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1200000000000001e-06 2024-09-14T08:40:02.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578400+0000", 2024-09-14T08:40:02.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.755e-06 2024-09-14T08:40:02.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578438+0000", 2024-09-14T08:40:02.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8034000000000002e-05 2024-09-14T08:40:02.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578452+0000", 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4195e-05 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667697+0000", 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089244778999999996 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667714+0000", 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7155000000000001e-05 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50448 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.250780129999999, 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089253579, 2024-09-14T08:40:02.882 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50448 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:40:02.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0299999999999997e-07 2024-09-14T08:40:02.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578532+0000", 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0670000000000002e-06 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578543+0000", 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1194e-05 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578550+0000", 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7260000000000002e-06 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667765+0000", 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089214098000000006 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667780+0000", 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5591e-05 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50449 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578562+0000", 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.250744794999999, 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089293784000000001, 2024-09-14T08:40:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50449 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578562+0000", 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578562+0000", 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578563+0000", 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578566+0000", 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1360000000000001e-06 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578575+0000", 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.619e-06 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578582+0000", 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:40:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667838+0000", 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089256653000000005 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667856+0000", 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7421000000000001e-05 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50450 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578591+0000", 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.250715434, 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089339475000000002, 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50450 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.892 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578591+0000", 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578591+0000", 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578592+0000", 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578607+0000", 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5543e-05 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578617+0000", 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3430000000000002e-06 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578624+0000", 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0149999999999998e-06 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667917+0000", 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089293191999999993 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667931+0000", 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3698e-05 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.895 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50451 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.250671923999999, 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089383987999999998, 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50451 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578647+0000", 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1941e-05 2024-09-14T08:40:02.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578656+0000", 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9449999999999999e-06 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578663+0000", 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8589999999999999e-06 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668002+0000", 2024-09-14T08:40:02.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089338362000000004 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668019+0000", 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7150999999999999e-05 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50452 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578673+0000", 2024-09-14T08:40:02.900 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.250633357000002, 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089408902999999998, 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50452 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578673+0000", 2024-09-14T08:40:02.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578673+0000", 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578674+0000", 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578677+0000", 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9129999999999999e-06 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578685+0000", 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3920000000000003e-06 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578706+0000", 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0792999999999999e-05 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668067+0000", 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089360564000000003 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668082+0000", 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5511000000000001e-05 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.904 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50453 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578717+0000", 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.250589751, 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089439313000000006, 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50453 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578717+0000", 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578717+0000", 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578900+0000", 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000183227 2024-09-14T08:40:02.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578909+0000", 2024-09-14T08:40:02.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:02.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578933+0000", 2024-09-14T08:40:02.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4213e-05 2024-09-14T08:40:02.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578949+0000", 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5770999999999999e-05 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668139+0000", 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089190332999999997 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668156+0000", 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7237000000000001e-05 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50454 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578977+0000", 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.250329853, 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089249535000000005, 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:02.909 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50454 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578977+0000", 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:02.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578977+0000", 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584558+0000", 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055811519999999998 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584570+0000", 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1640999999999999e-05 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584596+0000", 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6679e-05 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584611+0000", 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5021000000000001e-05 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668211+0000", 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.083599604999999994 2024-09-14T08:40:02.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:02.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:02.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:02.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668226+0000", 2024-09-14T08:40:02.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5437000000000001e-05 2024-09-14T08:40:02.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.913 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:02.913 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:02.913 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:02.914 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:02.915 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:02.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:02.916 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:02.917 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:02.917+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:02.928 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:02.928 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:02.952 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:02.952 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:02.972 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:02.972 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:02.976 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:02.976 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:03.015 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:03.020+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:03.105 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:03.106 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:03.116 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:03.120+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:03.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:03.217 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:03.220+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:03.307 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:03.308 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:03.318 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:03.324+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:03.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:03.419 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:03.424+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:03.496 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:03.497 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:03.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:03.557 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:03.561+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:03.620 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:03.624+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:03.653 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:03.653 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:03.672 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:03.721 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:03.724+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:03.821 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:03.828+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:03.863 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:03.863 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:03.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:03.923 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:03.927+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:04.011 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:04.011 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:04.023 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:04.027+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:04.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:04.124 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:04.127+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:04.155 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:04.155 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:04.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:04.226 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:04.231+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:04.310 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:04.310 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:04.327 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:04.331+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:04.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:04.428 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:04.431+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:04.456 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:04.456 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:04.476 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:04.529 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:04.531+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:04.630 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:04.631+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:04.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:40:04.634 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:04.730 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:04.735+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:04.831 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:04.835+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:04.835 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:04.835 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:04.850 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:04.942 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:04.947+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:04.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:05.028 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:05.028 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:05.033 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:05.035+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:05.043 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:05.103 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:05.129 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:05.129 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:05.135 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:05.139+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:05.149 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:05.149 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:05.167 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:05.167 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:05.186 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:05.186 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:05.206 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:05.206 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:05.209 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:05.210 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:05.216 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:05.216 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:05.216 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:05.216 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:05.230 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:05.278 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:05.283+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:05.337 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:05.339+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:05.401 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:05.401 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:05.401 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:05.401 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:05.401 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:05.415 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:05.438 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:05.440+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:05.539 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:05.543+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:05.582 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:05.582 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:05.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:05.582 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:05.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.582 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50435 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.582 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:40:05.582 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.009133445, 2024-09-14T08:40:05.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089137862999999998, 2024-09-14T08:40:05.582 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50435 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577705+0000", 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577709+0000", 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2100000000000002e-06 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577718+0000", 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0180000000000007e-06 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577727+0000", 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8959999999999992e-06 2024-09-14T08:40:05.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666826+0000", 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089099245999999993 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666843+0000", 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6702999999999999e-05 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.586 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50436 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577736+0000", 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.009101782999998, 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089177490999999998, 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50436 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577736+0000", 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577736+0000", 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577737+0000", 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.23e-07 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577740+0000", 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9459999999999998e-06 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577748+0000", 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3890000000000005e-06 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577755+0000", 2024-09-14T08:40:05.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9659999999999999e-06 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666901+0000", 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089145996000000005 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666914+0000", 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2471e-05 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50437 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.009073468, 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089225676000000004, 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.591 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50437 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577765+0000", 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577768+0000", 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577777+0000", 2024-09-14T08:40:05.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.259e-06 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577784+0000", 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9619999999999996e-06 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666971+0000", 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089187113999999998 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.666990+0000", 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9728000000000002e-05 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50438 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577793+0000", 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.009045335, 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089268996000000003, 2024-09-14T08:40:05.595 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50438 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577793+0000", 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577793+0000", 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577794+0000", 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1299999999999999e-07 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577796+0000", 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9459999999999998e-06 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577805+0000", 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3850000000000002e-06 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577812+0000", 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8059999999999997e-06 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667049+0000", 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089236920999999997 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667062+0000", 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3225e-05 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.599 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50439 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577821+0000", 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.009016844000001, 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089313248999999997, 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50439 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577821+0000", 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577821+0000", 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577822+0000", 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:40:05.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577844+0000", 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1877000000000001e-05 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577854+0000", 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9350000000000006e-06 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577861+0000", 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2989999999999999e-06 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667117+0000", 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089255930999999997 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667135+0000", 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7496999999999999e-05 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.603 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50440 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577904+0000", 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008933973000001, 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089307379000000006, 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50440 2024-09-14T08:40:05.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577904+0000", 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577904+0000", 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577906+0000", 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.996e-06 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577912+0000", 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6420000000000004e-06 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577929+0000", 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7421000000000001e-05 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577943+0000", 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4059999999999999e-05 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667192+0000", 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089248220000000003 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667212+0000", 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0040000000000001e-05 2024-09-14T08:40:05.607 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50441 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.577967+0000", 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008871237000001, 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089318996999999997, 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50441 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577967+0000", 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577967+0000", 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577968+0000", 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.133e-06 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577974+0000", 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.195e-06 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.577995+0000", 2024-09-14T08:40:05.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0404e-05 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578007+0000", 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2758000000000001e-05 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667269+0000", 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089261251999999999 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667286+0000", 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50442 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578029+0000", 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008809391, 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089325107000000001, 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.612 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50442 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578029+0000", 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578029+0000", 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578030+0000", 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0300000000000001e-06 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578035+0000", 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4129999999999997e-06 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578052+0000", 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6704000000000001e-05 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578068+0000", 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6393999999999999e-05 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667339+0000", 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089270648999999994 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667354+0000", 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4917e-05 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50443 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.616 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578086+0000", 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008751799999999, 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089354797, 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50443 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578086+0000", 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578086+0000", 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578087+0000", 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.077e-06 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578093+0000", 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6389999999999997e-06 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578115+0000", 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1625999999999999e-05 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578158+0000", 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3680000000000002e-05 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667424+0000", 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089265854000000006 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667441+0000", 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6920999999999999e-05 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50444 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578199+0000", 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008638954999999, 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089308203000000003, 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50444 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578199+0000", 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578199+0000", 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578201+0000", 2024-09-14T08:40:05.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.407e-06 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578208+0000", 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9949999999999999e-06 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578234+0000", 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6526e-05 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578249+0000", 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5234e-05 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667495+0000", 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089245559000000002 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667507+0000", 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2482e-05 2024-09-14T08:40:05.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50445 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578269+0000", 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008568647000001, 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089310284000000004, 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50445 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578269+0000", 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578269+0000", 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578271+0000", 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4500000000000001e-06 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578276+0000", 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4759999999999997e-06 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578295+0000", 2024-09-14T08:40:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8153999999999999e-05 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578313+0000", 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667563+0000", 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089249980000000007 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667580+0000", 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7244e-05 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50446 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578330+0000", 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008507923, 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089312538999999996, 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.629 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50446 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578330+0000", 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578330+0000", 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578332+0000", 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3060000000000001e-06 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578337+0000", 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2429999999999996e-06 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578356+0000", 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8867000000000001e-05 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578369+0000", 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3301e-05 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667630+0000", 2024-09-14T08:40:05.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089261484000000002 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667643+0000", 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2337999999999999e-05 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50447 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578393+0000", 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008445472999998, 2024-09-14T08:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089321038000000005, 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50447 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578393+0000", 2024-09-14T08:40:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578393+0000", 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578394+0000", 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1200000000000001e-06 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578400+0000", 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.755e-06 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578438+0000", 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8034000000000002e-05 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578452+0000", 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4195e-05 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667697+0000", 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089244778999999996 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667714+0000", 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7155000000000001e-05 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.637 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50448 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008311585000001, 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089253579, 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50448 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578527+0000", 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0299999999999997e-07 2024-09-14T08:40:05.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578532+0000", 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0670000000000002e-06 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578543+0000", 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1194e-05 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578550+0000", 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7260000000000002e-06 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667765+0000", 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089214098000000006 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667780+0000", 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5591e-05 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.641 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50449 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578562+0000", 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008276250000002, 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089293784000000001, 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50449 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578562+0000", 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578562+0000", 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578563+0000", 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578566+0000", 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1360000000000001e-06 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578575+0000", 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.619e-06 2024-09-14T08:40:05.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578582+0000", 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667838+0000", 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089256653000000005 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667856+0000", 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7421000000000001e-05 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50450 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578591+0000", 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008246888999999, 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089339475000000002, 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.646 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50450 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578591+0000", 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578591+0000", 2024-09-14T08:40:05.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578592+0000", 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578607+0000", 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5543e-05 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578617+0000", 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3430000000000002e-06 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578624+0000", 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0149999999999998e-06 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667917+0000", 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089293191999999993 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.667931+0000", 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3698e-05 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50451 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008203379000001, 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089383987999999998, 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.650 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50451 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578635+0000", 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578647+0000", 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1941e-05 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578656+0000", 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9449999999999999e-06 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578663+0000", 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8589999999999999e-06 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668002+0000", 2024-09-14T08:40:05.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089338362000000004 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668019+0000", 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7150999999999999e-05 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50452 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578673+0000", 2024-09-14T08:40:05.654 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008164812, 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089408902999999998, 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50452 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578673+0000", 2024-09-14T08:40:05.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578673+0000", 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578674+0000", 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578677+0000", 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9129999999999999e-06 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578685+0000", 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3920000000000003e-06 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578706+0000", 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0792999999999999e-05 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668067+0000", 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089360564000000003 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668082+0000", 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5511000000000001e-05 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.658 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50453 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578717+0000", 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.008121205999998, 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089439313000000006, 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50453 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578717+0000", 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578717+0000", 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578900+0000", 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000183227 2024-09-14T08:40:05.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578909+0000", 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578933+0000", 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4213e-05 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578949+0000", 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5770999999999999e-05 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668139+0000", 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089190332999999997 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668156+0000", 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7237000000000001e-05 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4612.0:50454 3.3 3.c5550963 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:46.578977+0000", 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.007861307999999, 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.089249535000000005, 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4612", 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1122069739", 2024-09-14T08:40:05.663 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 50454 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578977+0000", 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.578977+0000", 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584558+0000", 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055811519999999998 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584570+0000", 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1640999999999999e-05 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584596+0000", 2024-09-14T08:40:05.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6679e-05 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.584611+0000", 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5021000000000001e-05 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668211+0000", 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.083599604999999994 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:05.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:05.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:46.668226+0000", 2024-09-14T08:40:05.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5437000000000001e-05 2024-09-14T08:40:05.667 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.667 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.667 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.667 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:05.667 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:05.667 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:05.669 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:40:05.669 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:05.670 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:05.671+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:05.769 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:05.771+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:05.840 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:05.841 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:05.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:05.870 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:05.872+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:05.970 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:05.972+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:06.027 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:06.028 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:06.028 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:06.028 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:06.028 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:06.042 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:06.086 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:06.091+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:06.162 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:06.162 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:06.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:06.162 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:06.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.162 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54084 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5699584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.162 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:06.162 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0869529179999997, 2024-09-14T08:40:06.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093000530999999997, 2024-09-14T08:40:06.162 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54084 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:06.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078497+0000", 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078500+0000", 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1360000000000001e-06 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078509+0000", 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9490000000000002e-06 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078516+0000", 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.233e-06 2024-09-14T08:40:06.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.170871+0000", 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092354443999999994 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171110+0000", 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000239349 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171497+0000", 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038669300000000002 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54085 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5710848~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0869229139999996, 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093690545, 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54085 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:06.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078527+0000", 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078530+0000", 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8660000000000002e-06 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078539+0000", 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9560000000000003e-06 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078546+0000", 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1489999999999997e-06 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171585+0000", 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093038914 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171820+0000", 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000235558 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172217+0000", 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039639900000000002 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.171 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54086 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5722112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0868933839999997, 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094383724000000002, 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54086 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078557+0000", 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078560+0000", 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-06 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078571+0000", 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0951999999999999e-05 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078579+0000", 2024-09-14T08:40:06.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7760000000000003e-06 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172313+0000", 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093733343999999996 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172558+0000", 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024562199999999997 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172940+0000", 2024-09-14T08:40:06.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038131999999999999 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54087 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5644288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0868593640000004, 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095045525000000006, 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.176 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54087 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078591+0000", 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078594+0000", 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078603+0000", 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3759999999999997e-06 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078610+0000", 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0160000000000003e-06 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173032+0000", 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094421672999999998 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173265+0000", 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000233265 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173635+0000", 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037049899999999999 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.180 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54088 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5733376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0868288939999999, 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095706712999999999, 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54088 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078621+0000", 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:40:06.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078624+0000", 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078633+0000", 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3950000000000007e-06 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078641+0000", 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4900000000000003e-06 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173728+0000", 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095086680000000007 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173954+0000", 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022685000000000001 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174327+0000", 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037261800000000002 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0867980770000001, 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0867099800000002, 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.190 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:06.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0866425829999997, 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:06.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:06.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0865688870000003, 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.199 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:06.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0864934149999996, 2024-09-14T08:40:06.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:06.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.207 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0864362109999997, 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:06.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:06.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0863773270000001, 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:06.212 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:06.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:06.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0863124009999998, 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.217 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:06.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0862509500000002, 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.221 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:06.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0861914160000001, 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:06.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:06.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.086132106, 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:06.230 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:06.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.234 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0860600739999997, 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:06.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:06.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56620 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5999616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.559867026, 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092334608999999998, 2024-09-14T08:40:06.239 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56620 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605583+0000", 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605586+0000", 2024-09-14T08:40:06.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0060000000000001e-06 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605595+0000", 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605602+0000", 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2760000000000003e-06 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697625+0000", 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092022458000000001 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697749+0000", 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124201 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697917+0000", 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016798900000000001 2024-09-14T08:40:06.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56621 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 6010880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5598367660000001, 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092668125000000004, 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56621 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605613+0000", 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605616+0000", 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.106e-06 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605627+0000", 2024-09-14T08:40:06.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1026000000000001e-05 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605635+0000", 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3289999999999996e-06 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697992+0000", 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092357106999999994 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698109+0000", 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117615 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698281+0000", 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017125199999999999 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56622 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 6022144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:06.248 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5598043060000002, 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092976195999999997, 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56622 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605646+0000", 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:06.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605649+0000", 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0730000000000001e-06 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605658+0000", 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9090000000000006e-06 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605667+0000", 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9160000000000007e-06 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698330+0000", 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092663841999999996 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698447+0000", 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116921 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698621+0000", 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017383200000000001 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.252 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:06.253 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:06.253 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:06.254 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:06.259+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:06.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:06.356 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:06.359+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:06.401 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:06.401 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:06.401 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:06.401 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:06.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:06.457 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:06.459+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:06.554 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:06.554 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:06.558 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:06.563+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:06.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:06.659 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:06.663+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:06.701 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:06.701 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:06.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:06.701 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:06.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.701 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31796 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3295232~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.701 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925501+0000", 2024-09-14T08:40:06.701 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7761654129999993, 2024-09-14T08:40:06.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070679979000000004, 2024-09-14T08:40:06.701 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31796 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925501+0000", 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925501+0000", 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925502+0000", 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3399999999999999e-07 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925511+0000", 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:06.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925518+0000", 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6490000000000008e-06 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925525+0000", 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6640000000000001e-06 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.995833+0000", 2024-09-14T08:40:06.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070308207999999997 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.995933+0000", 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010009999999999999 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996181+0000", 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024783200000000002 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.705 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31797 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3304448~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7761337029999993, 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071016060000000006, 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31797 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0699999999999997e-07 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925536+0000", 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.368e-06 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925543+0000", 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.781e-06 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925548+0000", 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996245+0000", 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070697276000000003 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996352+0000", 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107054 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996549+0000", 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000196942 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31798 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3306496~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7761116829999999, 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071397830999999995, 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31798 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:06.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925558+0000", 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2069999999999998e-06 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925564+0000", 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6290000000000004e-06 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925569+0000", 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.164e-06 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996603+0000", 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071033712999999998 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996708+0000", 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010466700000000001 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996953+0000", 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000244959 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31799 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3315712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7760903260000003, 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071768473999999999, 2024-09-14T08:40:06.715 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31799 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925577+0000", 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925579+0000", 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:40:06.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925587+0000", 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925593+0000", 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997015+0000", 2024-09-14T08:40:06.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071422484999999994 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997130+0000", 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115053 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997345+0000", 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214379 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31800 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3326976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7760666399999998, 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072113090000000005, 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31800 2024-09-14T08:40:06.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925603+0000", 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925610+0000", 2024-09-14T08:40:06.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8029999999999997e-06 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925618+0000", 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6930000000000007e-06 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997400+0000", 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071781929999999994 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997507+0000", 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107012 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997713+0000", 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020603 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.724 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7760409510000006, 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:40:06.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:40:06.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7760183949999995, 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:06.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.733 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7759503799999994, 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:06.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:40:06.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7759006520000007, 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:06.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.742 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7758494969999994, 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:06.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:06.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:40:06.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:06.747 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7757974940000008, 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:40:06.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:40:06.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:40:06.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:40:06.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:40:06.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:40:06.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.775734924, 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:40:06.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7756683459999998, 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:06.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7755905619999997, 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.763 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:40:06.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:40:06.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:40:06.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:40:06.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:40:06.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7755378670000006, 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:06.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.772 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7754922139999998, 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:40:06.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7754457430000006, 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:40:06.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:40:06.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.781 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7753997550000005, 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:40:06.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:40:06.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7753714970000001, 2024-09-14T08:40:06.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:40:06.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:40:06.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7753167189999992, 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:40:06.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:06.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:40:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:40:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:06.795 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:06.797 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:06.797 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:06.799+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:06.897 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:06.900+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:06.935 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:06.935 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:06.935 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:06.935 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:06.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:06.998 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:07.003+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:07.099 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:07.103+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:07.113 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:07.114 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:07.114 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:07.114 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:07.114 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:07.129 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:07.200 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:07.200+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:07.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:07.249 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33401 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3549184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9751602160000008, 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065012249999999994, 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33401 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4000000000000001e-07 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277738+0000", 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8729999999999999e-06 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277747+0000", 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6319999999999997e-06 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277754+0000", 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2729999999999997e-06 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342439+0000", 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064685272000000002 2024-09-14T08:40:07.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342540+0000", 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342747+0000", 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020656 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33403 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3560448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9750685519999998, 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065276109999999998, 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.255 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33403 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277827+0000", 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.23e-07 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277830+0000", 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277839+0000", 2024-09-14T08:40:07.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277846+0000", 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1590000000000004e-06 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342820+0000", 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064974064999999998 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342954+0000", 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133509 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343102+0000", 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000148539 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33404 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3571712~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:07.259 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9750370900000007, 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065555713000000002, 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33404 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:07.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277861+0000", 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9790000000000002e-06 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277881+0000", 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9463999999999999e-05 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277889+0000", 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7190000000000001e-06 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343177+0000", 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065288760000000001 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343279+0000", 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101974 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343414+0000", 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013411 2024-09-14T08:40:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33405 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9749957790000003, 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065812103999999996, 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33405 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:07.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277900+0000", 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277922+0000", 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1540999999999999e-05 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277932+0000", 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0587999999999999e-05 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277940+0000", 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5360000000000004e-06 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343480+0000", 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065539753000000006 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343581+0000", 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101005 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343711+0000", 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013069500000000001 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.268 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9749436459999998, 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:40:07.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9749148499999993, 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:40:07.273 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:40:07.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9748860310000005, 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.278 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:40:07.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9748577019999995, 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:40:07.282 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:40:07.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9748285019999994, 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:40:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:40:07.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9747964939999996, 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:40:07.291 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:40:07.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:40:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9747672180000002, 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:40:07.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:40:07.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9747375520000006, 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:40:07.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9747090089999997, 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:07.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9746807030000006, 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.309 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:40:07.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9746354359999998, 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.314 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:40:07.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.974603814, 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.318 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:07.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.322 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9745460020000003, 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:40:07.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9744779890000004, 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:07.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.331 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9744426169999993, 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9744082180000007, 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:07.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:40:07.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:40:07.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:07.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:40:07.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:40:07.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.340 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.340 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.340 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:07.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:07.342 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:07.343+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:07.353 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:07.371 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:07.371 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:07.387 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:07.387 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:07.408 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:07.408 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:07.438 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:07.438 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:07.442 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:07.444+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:07.462 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:07.462 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:07.465 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:07.465 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:07.492 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:07.492 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:07.493 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:40:07.493 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:40:07.493 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T08:40:07.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T08:40:07.506 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:07.550 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:07.555+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:07.643 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:07.643 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:07.644 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:07.644+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:07.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:07.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:40:07.746 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:07.751+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:07.825 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:07.825 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:07.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:07.845 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:07.848+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:40:07.863 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 49, 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "57b092b7-5550-41a0-8f78-531de0e7c469", 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-09-14T08:38:48.610112+0000", 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-09-14T08:40:05.605734+0000", 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-09-14T08:39:51.541202+0000", 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-09-14T08:38:51.099971+0000", 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5801984, 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "noscrub", 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-09-14T08:40:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 5, 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 3, 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 6, 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "luminous", 2024-09-14T08:40:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:00.306403+0000", 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "15", 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-09-14T08:40:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 6.059999942779541, 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 6.059999942779541, 2024-09-14T08:40:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 1, 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 1 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:06.370159+0000", 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:40:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-09-14T08:40:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-09-14T08:40:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 2, 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 19, 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:40:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.2699999809265137, 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.2699999809265137, 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.82999998331069946, 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 1, 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 1 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "pool_client.0", 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:16.437713+0000", 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "37", 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 10, 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 37, 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:40:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 1.7000000476837158, 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 1.7000000476837158, 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.82999998331069946, 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 1, 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 1 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d", 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 0, 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:40:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 41, 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6800", 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6801", 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6802", 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6803", 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6806", 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6807", 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6804", 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6805", 2024-09-14T08:40:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6801/2282442554", 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6803/2282442554", 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6807/2282442554", 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6805/2282442554", 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "exists" 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "09ba1390-a0d1-48a3-9342-5f5aa64e2217", 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 41, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6808", 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6809", 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6810", 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6811", 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6814", 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6815", 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6812", 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6813", 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6809/2739597491", 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6811/2739597491", 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6815/2739597491", 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6813/2739597491", 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:40:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "a7cd8610-d8e1-44e7-a423-4419cad90d8e", 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 45, 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6816", 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817", 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818", 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819", 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6822", 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6823", 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6820", 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6821", 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6817/1157205327", 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6819/1157205327", 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6823/1157205327", 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6821/1157205327", 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "1339fb05-5d1c-4c0a-8388-314119543bb6", 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 44, 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6808", 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6809", 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6810", 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6811", 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6814", 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6815", 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6812", 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6813", 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6809/1656791341", 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6811/1656791341", 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6815/1656791341", 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6813/1656791341", 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "0cebba54-9019-47bd-870f-306664e390e1", 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 41, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6816", 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6817", 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6818", 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6819", 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6822", 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6823", 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6820", 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6821", 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6817/1186206237", 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6819/1186206237", 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6823/1186206237", 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6821/1186206237", 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "e571e73b-0e9d-417d-b01c-59b651016763", 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:40:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 45, 2024-09-14T08:40:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6800", 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6801", 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.916 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6802", 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6803", 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.917 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6806", 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6807", 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6804", 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6805", 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6801/796623465", 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6803/796623465", 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6807/796623465", 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6805/796623465", 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:40:07.920 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.174731+0000", 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 41 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:07.921 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.475467+0000", 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.606174+0000", 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.835957+0000", 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.753547+0000", 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:07.924 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.284212+0000", 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [ 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "1.0", 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: 4 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [ 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 4, 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 0 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.a", 2024-09-14T08:40:07.926 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 4, 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 1 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 5, 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 2 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.927 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.13", 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 3, 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 0 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [ 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.928 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: 4 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: 5 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:07.929 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.13", 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: 5, 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-09-14T08:40:07.930 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-09-14T08:40:07.931 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-09-14T08:40:07.932 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-09-14T08:40:07.932 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-09-14T08:40:07.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:07.932 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:07.934 INFO:tasks.thrashosds.thrasher:j is {'epoch': 49, 'fsid': '57b092b7-5550-41a0-8f78-531de0e7c469', 'created': '2024-09-14T08:38:48.610112+0000', 'modified': '2024-09-14T08:40:05.605734+0000', 'last_up_change': '2024-09-14T08:39:51.541202+0000', 'last_in_change': '2024-09-14T08:38:51.099971+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T08:39:00.306403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T08:39:06.370159+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.2699999809265137, 'score_stable': 2.2699999809265137, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T08:39:16.437713+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 10, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7000000476837158, 'score_stable': 1.7000000476837158, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 21, 'down_at': 41, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 2282442554}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 2282442554}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 2282442554}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 2282442554}]}, 'public_addr': '172.21.15.89:6801/2282442554', 'cluster_addr': '172.21.15.89:6803/2282442554', 'heartbeat_back_addr': '172.21.15.89:6807/2282442554', 'heartbeat_front_addr': '172.21.15.89:6805/2282442554', 'state': ['exists']}, {'osd': 1, 'uuid': '09ba1390-a0d1-48a3-9342-5f5aa64e2217', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6808', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6809', 'nonce': 2739597491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6810', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6811', 'nonce': 2739597491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6814', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6815', 'nonce': 2739597491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6812', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6813', 'nonce': 2739597491}]}, 'public_addr': '172.21.15.89:6809/2739597491', 'cluster_addr': '172.21.15.89:6811/2739597491', 'heartbeat_back_addr': '172.21.15.89:6815/2739597491', 'heartbeat_front_addr': '172.21.15.89:6813/2739597491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a7cd8610-d8e1-44e7-a423-4419cad90d8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6816', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6817', 'nonce': 1157205327}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6818', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 1157205327}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6822', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6823', 'nonce': 1157205327}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6820', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6821', 'nonce': 1157205327}]}, 'public_addr': '172.21.15.89:6817/1157205327', 'cluster_addr': '172.21.15.89:6819/1157205327', 'heartbeat_back_addr': '172.21.15.89:6823/1157205327', 'heartbeat_front_addr': '172.21.15.89:6821/1157205327', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1339fb05-5d1c-4c0a-8388-314119543bb6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 44, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6808', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6809', 'nonce': 1656791341}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6810', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6811', 'nonce': 1656791341}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6814', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6815', 'nonce': 1656791341}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6812', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6813', 'nonce': 1656791341}]}, 'public_addr': '172.21.15.112:6809/1656791341', 'cluster_addr': '172.21.15.112:6811/1656791341', 'heartbeat_back_addr': '172.21.15.112:6815/1656791341', 'heartbeat_front_addr': '172.21.15.112:6813/1656791341', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0cebba54-9019-47bd-870f-306664e390e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6816', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6817', 'nonce': 1186206237}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6818', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6819', 'nonce': 1186206237}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6822', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6823', 'nonce': 1186206237}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6820', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6821', 'nonce': 1186206237}]}, 'public_addr': '172.21.15.112:6817/1186206237', 'cluster_addr': '172.21.15.112:6819/1186206237', 'heartbeat_back_addr': '172.21.15.112:6823/1186206237', 'heartbeat_front_addr': '172.21.15.112:6821/1186206237', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e571e73b-0e9d-417d-b01c-59b651016763', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 796623465}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 796623465}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 796623465}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 796623465}]}, 'public_addr': '172.21.15.112:6801/796623465', 'cluster_addr': '172.21.15.112:6803/796623465', 'heartbeat_back_addr': '172.21.15.112:6807/796623465', 'heartbeat_front_addr': '172.21.15.112:6805/796623465', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.174731+0000', 'dead_epoch': 41}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.475467+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.606174+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.835957+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.753547+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.284212+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '1.0', 'osds': [2, 4]}], 'pg_upmap_items': [{'pgid': '3.9', 'mappings': [{'from': 4, 'to': 0}]}, {'pgid': '3.a', 'mappings': [{'from': 4, 'to': 1}]}, {'pgid': '3.10', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.13', 'mappings': [{'from': 3, 'to': 0}]}], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '3.9', 'osds': [2, 4]}, {'pgid': '3.10', 'osds': [2, 5]}, {'pgid': '3.13', 'osds': [5, 3]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T08:40:07.934 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:40:07.978 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:07.983+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:08.046 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:08.051+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:08.067 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:08.067 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:08.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:08.147 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:08.148+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:08.248 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:08.248+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:08.258 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:08.259 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:08.274 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:08.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:40:08.312+0000 7f64effff640 0 --2- 172.21.15.89:0/311392703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64f00a2220 0x7f64f0133f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T08:40:08.349 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:08.348+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:08.404 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:08.404 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:08.421 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:08.466 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:08.471+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:08.547 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:40:08.548 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:40:08.550 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:08.555+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-09-14T08:40:08.282300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":208931315,"num_objects":518,"num_object_clones":96,"num_object_copies":1036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":49,"num_objects_unfound":0,"num_objects_dirty":518,"num_whiteouts":312,"num_read":167401,"num_read_kb":213343,"num_write":2549,"num_write_kb":22852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":38,"num_bytes_recovered":784542,"num_keys_recovered":15,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2610,"ondisk_log_size":2610,"up":66,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":210080,"kb_used_data":22952,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566020960,"statfs":{"total":579820584960,"available":579605463040,"internally_reserved":0,"allocated":23502848,"data_stored":21199401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":191486624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-19,"num_objects_degraded":0,"num_objects_misplaced":49,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49936,"num_read_kb":26647,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":177790,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002231"},"pg_stats":[{"pgid":"3.1f","version":"38'25","reported_seq":110,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:05.617390+0000","last_change":"2024-09-14T08:39:52.554986+0000","last_active":"2024-09-14T08:40:05.617390+0000","last_peered":"2024-09-14T08:40:05.617390+0000","last_clean":"2024-09-14T08:39:47.197484+0000","last_became_active":"2024-09-14T08:39:52.554986+0000","last_became_peered":"2024-09-14T08:39:52.554986+0000","last_unstale":"2024-09-14T08:40:05.617390+0000","last_undegraded":"2024-09-14T08:39:52.551188+0000","last_fullsized":"2024-09-14T08:39:52.550960+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:47.681692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001451897,"stat_sum":{"num_bytes":16,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":11,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":10,"num_read":25,"num_read_kb":8,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":11}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"38'40","reported_seq":14865,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.644392+0000","last_change":"2024-09-14T08:39:20.418973+0000","last_active":"2024-09-14T08:40:05.644392+0000","last_peered":"2024-09-14T08:40:05.644392+0000","last_clean":"2024-09-14T08:40:05.644392+0000","last_became_active":"2024-09-14T08:39:18.380137+0000","last_became_peered":"2024-09-14T08:39:18.380137+0000","last_unstale":"2024-09-14T08:40:05.644392+0000","last_undegraded":"2024-09-14T08:40:05.644392+0000","last_fullsized":"2024-09-14T08:40:05.644392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:03.061026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013459450000000001,"stat_sum":{"num_bytes":10341888,"num_objects":16,"num_object_clones":2,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":11,"num_read":14768,"num_read_kb":13627,"num_write":31,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"38'65","reported_seq":2656,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-14T08:40:02.612201+0000","last_change":"2024-09-14T08:39:20.399554+0000","last_active":"2024-09-14T08:40:02.612201+0000","last_peered":"2024-09-14T08:40:02.612201+0000","last_clean":"2024-09-14T08:40:02.612201+0000","last_became_active":"2024-09-14T08:39:18.383208+0000","last_became_peered":"2024-09-14T08:39:18.383208+0000","last_unstale":"2024-09-14T08:40:02.612201+0000","last_undegraded":"2024-09-14T08:40:02.612201+0000","last_fullsized":"2024-09-14T08:40:02.612201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:20.690891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003027493,"stat_sum":{"num_bytes":8785408,"num_objects":21,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":14,"num_read":2538,"num_read_kb":20737,"num_write":49,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"38'51","reported_seq":2015,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-14T08:40:02.612258+0000","last_change":"2024-09-14T08:39:20.396598+0000","last_active":"2024-09-14T08:40:02.612258+0000","last_peered":"2024-09-14T08:40:02.612258+0000","last_clean":"2024-09-14T08:40:02.612258+0000","last_became_active":"2024-09-14T08:39:18.384784+0000","last_became_peered":"2024-09-14T08:39:18.384784+0000","last_unstale":"2024-09-14T08:40:02.612258+0000","last_undegraded":"2024-09-14T08:40:02.612258+0000","last_fullsized":"2024-09-14T08:40:02.612258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:00.213976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001345691,"stat_sum":{"num_bytes":19757092,"num_objects":18,"num_object_clones":3,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":11,"num_read":1931,"num_read_kb":15128,"num_write":37,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"49'80","reported_seq":457,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:06.064521+0000","last_change":"2024-09-14T08:39:52.563176+0000","last_active":"2024-09-14T08:40:06.064521+0000","last_peered":"2024-09-14T08:40:06.064521+0000","last_clean":"2024-09-14T08:39:47.936799+0000","last_became_active":"2024-09-14T08:39:52.563176+0000","last_became_peered":"2024-09-14T08:39:52.563176+0000","last_unstale":"2024-09-14T08:40:06.064521+0000","last_undegraded":"2024-09-14T08:39:52.558992+0000","last_fullsized":"2024-09-14T08:39:52.558706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:20:45.975416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910279999999999,"stat_sum":{"num_bytes":799232,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":7,"num_read":676,"num_read_kb":873,"num_write":45,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":13}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"38'105","reported_seq":840,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.642995+0000","last_change":"2024-09-14T08:39:20.388365+0000","last_active":"2024-09-14T08:40:05.642995+0000","last_peered":"2024-09-14T08:40:05.642995+0000","last_clean":"2024-09-14T08:40:05.642995+0000","last_became_active":"2024-09-14T08:39:18.383879+0000","last_became_peered":"2024-09-14T08:39:18.383879+0000","last_unstale":"2024-09-14T08:40:05.642995+0000","last_undegraded":"2024-09-14T08:40:05.642995+0000","last_fullsized":"2024-09-14T08:40:05.642995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:33:45.300548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211712,"stat_sum":{"num_bytes":2828342,"num_objects":14,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":7,"num_read":1039,"num_read_kb":1111,"num_write":154,"num_write_kb":1707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"39'163","reported_seq":985,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.617949+0000","last_change":"2024-09-14T08:39:20.386019+0000","last_active":"2024-09-14T08:40:05.617949+0000","last_peered":"2024-09-14T08:40:05.617949+0000","last_clean":"2024-09-14T08:40:05.617949+0000","last_became_active":"2024-09-14T08:39:18.384097+0000","last_became_peered":"2024-09-14T08:39:18.384097+0000","last_unstale":"2024-09-14T08:40:05.617949+0000","last_undegraded":"2024-09-14T08:40:05.617949+0000","last_fullsized":"2024-09-14T08:40:05.617949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:15.635935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014331750000000001,"stat_sum":{"num_bytes":3047503,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":7,"num_read":1350,"num_read_kb":4394,"num_write":232,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"38'43","reported_seq":242,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:05.644560+0000","last_change":"2024-09-14T08:39:52.548543+0000","last_active":"2024-09-14T08:40:05.644560+0000","last_peered":"2024-09-14T08:40:05.644560+0000","last_clean":"2024-09-14T08:39:50.545311+0000","last_became_active":"2024-09-14T08:39:52.548543+0000","last_became_peered":"2024-09-14T08:39:52.548543+0000","last_unstale":"2024-09-14T08:40:05.644560+0000","last_undegraded":"2024-09-14T08:39:52.547916+0000","last_fullsized":"2024-09-14T08:39:52.547825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:32.697063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922599999999997,"stat_sum":{"num_bytes":532628,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":16,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":11,"num_read":144,"num_read_kb":1367,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"38'95","reported_seq":2600,"reported_epoch":48,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:02.612305+0000","last_change":"2024-09-14T08:39:52.560566+0000","last_active":"2024-09-14T08:40:02.612305+0000","last_peered":"2024-09-14T08:40:02.612305+0000","last_clean":"2024-09-14T08:39:44.516221+0000","last_became_active":"2024-09-14T08:39:52.560566+0000","last_became_peered":"2024-09-14T08:39:52.560566+0000","last_unstale":"2024-09-14T08:40:02.612305+0000","last_undegraded":"2024-09-14T08:39:52.556527+0000","last_fullsized":"2024-09-14T08:39:52.556283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:41.258040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862059999999999,"stat_sum":{"num_bytes":6310124,"num_objects":19,"num_object_clones":4,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":19,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":11,"num_read":2735,"num_read_kb":15348,"num_write":76,"num_write_kb":1261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":19}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"38'57","reported_seq":14397,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.171882+0000","last_change":"2024-09-14T08:39:20.398753+0000","last_active":"2024-09-14T08:40:05.171882+0000","last_peered":"2024-09-14T08:40:05.171882+0000","last_clean":"2024-09-14T08:40:05.171882+0000","last_became_active":"2024-09-14T08:39:18.390054+0000","last_became_peered":"2024-09-14T08:39:18.390054+0000","last_unstale":"2024-09-14T08:40:05.171882+0000","last_undegraded":"2024-09-14T08:40:05.171882+0000","last_fullsized":"2024-09-14T08:40:05.171882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:59.083247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029337040000000001,"stat_sum":{"num_bytes":6458368,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":8,"num_read":14288,"num_read_kb":9584,"num_write":53,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"38'48","reported_seq":804,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:05.617165+0000","last_change":"2024-09-14T08:39:52.554928+0000","last_active":"2024-09-14T08:40:05.617165+0000","last_peered":"2024-09-14T08:40:05.617165+0000","last_clean":"2024-09-14T08:39:50.547225+0000","last_became_active":"2024-09-14T08:39:52.554928+0000","last_became_peered":"2024-09-14T08:39:52.554928+0000","last_unstale":"2024-09-14T08:40:05.617165+0000","last_undegraded":"2024-09-14T08:39:52.550685+0000","last_fullsized":"2024-09-14T08:39:52.550453+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:13.959125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018449409999999999,"stat_sum":{"num_bytes":3743841,"num_objects":11,"num_object_clones":1,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":11,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":7,"num_read":710,"num_read_kb":4523,"num_write":40,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":11}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"38'65","reported_seq":16227,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.616931+0000","last_change":"2024-09-14T08:39:20.410293+0000","last_active":"2024-09-14T08:40:05.616931+0000","last_peered":"2024-09-14T08:40:05.616931+0000","last_clean":"2024-09-14T08:40:05.616931+0000","last_became_active":"2024-09-14T08:39:18.386000+0000","last_became_peered":"2024-09-14T08:39:18.386000+0000","last_unstale":"2024-09-14T08:40:05.616931+0000","last_undegraded":"2024-09-14T08:40:05.616931+0000","last_fullsized":"2024-09-14T08:40:05.616931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:50.405710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014343330000000001,"stat_sum":{"num_bytes":14714063,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":6,"num_read":16244,"num_read_kb":14736,"num_write":79,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.617644+0000","last_change":"2024-09-14T08:39:10.710340+0000","last_active":"2024-09-14T08:40:05.617644+0000","last_peered":"2024-09-14T08:40:05.617644+0000","last_clean":"2024-09-14T08:40:05.617644+0000","last_became_active":"2024-09-14T08:39:08.202439+0000","last_became_peered":"2024-09-14T08:39:08.202439+0000","last_unstale":"2024-09-14T08:40:05.617644+0000","last_undegraded":"2024-09-14T08:40:05.617644+0000","last_fullsized":"2024-09-14T08:40:05.617644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:23.410553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001636462,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"38'86","reported_seq":23729,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:05.618225+0000","last_change":"2024-09-14T08:39:52.551765+0000","last_active":"2024-09-14T08:40:05.618225+0000","last_peered":"2024-09-14T08:40:05.618225+0000","last_clean":"2024-09-14T08:39:47.208280+0000","last_became_active":"2024-09-14T08:39:52.551765+0000","last_became_peered":"2024-09-14T08:39:52.551765+0000","last_unstale":"2024-09-14T08:40:05.618225+0000","last_undegraded":"2024-09-14T08:39:52.550793+0000","last_fullsized":"2024-09-14T08:39:52.550716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:34:45.964693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484614,"stat_sum":{"num_bytes":25133568,"num_objects":22,"num_object_clones":5,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":22,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":15,"num_read":23601,"num_read_kb":13637,"num_write":66,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":22}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.618490+0000","last_change":"2024-09-14T08:39:10.138177+0000","last_active":"2024-09-14T08:40:05.618490+0000","last_peered":"2024-09-14T08:40:05.618490+0000","last_clean":"2024-09-14T08:40:05.618490+0000","last_became_active":"2024-09-14T08:39:08.132530+0000","last_became_peered":"2024-09-14T08:39:08.132530+0000","last_unstale":"2024-09-14T08:40:05.618490+0000","last_undegraded":"2024-09-14T08:40:05.618490+0000","last_fullsized":"2024-09-14T08:40:05.618490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:17.902057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"38'69","reported_seq":21713,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:06.043970+0000","last_change":"2024-09-14T08:39:20.419181+0000","last_active":"2024-09-14T08:40:06.043970+0000","last_peered":"2024-09-14T08:40:06.043970+0000","last_clean":"2024-09-14T08:40:06.043970+0000","last_became_active":"2024-09-14T08:39:18.382867+0000","last_became_peered":"2024-09-14T08:39:18.382867+0000","last_unstale":"2024-09-14T08:40:06.043970+0000","last_undegraded":"2024-09-14T08:40:06.043970+0000","last_fullsized":"2024-09-14T08:40:06.043970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:50.066142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015322599999999999,"stat_sum":{"num_bytes":11346983,"num_objects":18,"num_object_clones":3,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":9,"num_read":21615,"num_read_kb":16761,"num_write":56,"num_write_kb":861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-09-14T08:40:05.617305+0000","last_change":"2024-09-14T08:39:52.558040+0000","last_active":"2024-09-14T08:40:05.617305+0000","last_peered":"2024-09-14T08:40:05.617305+0000","last_clean":"2024-09-14T08:39:50.547498+0000","last_became_active":"2024-09-14T08:39:52.558040+0000","last_became_peered":"2024-09-14T08:39:52.558040+0000","last_unstale":"2024-09-14T08:40:05.617305+0000","last_undegraded":"2024-09-14T08:40:05.617305+0000","last_fullsized":"2024-09-14T08:39:52.551903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:32.236979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"38'37","reported_seq":149,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.618112+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:40:05.618112+0000","last_peered":"2024-09-14T08:40:05.618112+0000","last_clean":"2024-09-14T08:40:05.618112+0000","last_became_active":"2024-09-14T08:39:18.387737+0000","last_became_peered":"2024-09-14T08:39:18.387737+0000","last_unstale":"2024-09-14T08:40:05.618112+0000","last_undegraded":"2024-09-14T08:40:05.618112+0000","last_fullsized":"2024-09-14T08:40:05.618112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:09.052473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010096059999999999,"stat_sum":{"num_bytes":688128,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":8,"num_read":51,"num_read_kb":480,"num_write":29,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-09-14T08:40:05.618171+0000","last_change":"2024-09-14T08:39:52.551815+0000","last_active":"2024-09-14T08:40:05.618171+0000","last_peered":"2024-09-14T08:40:05.618171+0000","last_clean":"2024-09-14T08:39:50.569724+0000","last_became_active":"2024-09-14T08:39:52.551815+0000","last_became_peered":"2024-09-14T08:39:52.551815+0000","last_unstale":"2024-09-14T08:40:05.618171+0000","last_undegraded":"2024-09-14T08:40:05.618171+0000","last_fullsized":"2024-09-14T08:39:52.550804+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:21.879310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"38'331","reported_seq":480,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-14T08:40:02.612235+0000","last_change":"2024-09-14T08:39:20.399293+0000","last_active":"2024-09-14T08:40:02.612235+0000","last_peered":"2024-09-14T08:40:02.612235+0000","last_clean":"2024-09-14T08:40:02.612235+0000","last_became_active":"2024-09-14T08:39:18.382577+0000","last_became_peered":"2024-09-14T08:39:18.382577+0000","last_unstale":"2024-09-14T08:40:02.612235+0000","last_undegraded":"2024-09-14T08:40:02.612235+0000","last_fullsized":"2024-09-14T08:40:02.612235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:40:57.576216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032365710000000002,"stat_sum":{"num_bytes":649448,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":11,"num_read":1718,"num_read_kb":1441,"num_write":571,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"38'72","reported_seq":6959,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:06.334147+0000","last_change":"2024-09-14T08:39:52.566848+0000","last_active":"2024-09-14T08:40:06.334147+0000","last_peered":"2024-09-14T08:40:06.334147+0000","last_clean":"2024-09-14T08:39:50.573428+0000","last_became_active":"2024-09-14T08:39:52.566848+0000","last_became_peered":"2024-09-14T08:39:52.566848+0000","last_unstale":"2024-09-14T08:40:06.334147+0000","last_undegraded":"2024-09-14T08:39:52.559844+0000","last_fullsized":"2024-09-14T08:39:52.559536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:47.577372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599846,"stat_sum":{"num_bytes":3775488,"num_objects":25,"num_object_clones":4,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":25,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":16,"num_read":6834,"num_read_kb":4728,"num_write":56,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":25}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":80,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-14T08:40:02.612098+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:40:02.612098+0000","last_peered":"2024-09-14T08:40:02.612098+0000","last_clean":"2024-09-14T08:40:02.612098+0000","last_became_active":"2024-09-14T08:39:08.130091+0000","last_became_peered":"2024-09-14T08:39:08.130091+0000","last_unstale":"2024-09-14T08:40:02.612098+0000","last_undegraded":"2024-09-14T08:40:02.612098+0000","last_fullsized":"2024-09-14T08:40:02.612098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:12.463612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"38'46","reported_seq":14329,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.617823+0000","last_change":"2024-09-14T08:39:20.385113+0000","last_active":"2024-09-14T08:40:05.617823+0000","last_peered":"2024-09-14T08:40:05.617823+0000","last_clean":"2024-09-14T08:40:05.617823+0000","last_became_active":"2024-09-14T08:39:18.387585+0000","last_became_peered":"2024-09-14T08:39:18.387585+0000","last_unstale":"2024-09-14T08:40:05.617823+0000","last_undegraded":"2024-09-14T08:40:05.617823+0000","last_fullsized":"2024-09-14T08:40:05.617823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.791323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058750299999999996,"stat_sum":{"num_bytes":8836624,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":10,"num_read":14232,"num_read_kb":9392,"num_write":36,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.644301+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:40:05.644301+0000","last_peered":"2024-09-14T08:40:05.644301+0000","last_clean":"2024-09-14T08:40:05.644301+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:40:05.644301+0000","last_undegraded":"2024-09-14T08:40:05.644301+0000","last_fullsized":"2024-09-14T08:40:05.644301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"38'37","reported_seq":219,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:05.642896+0000","last_change":"2024-09-14T08:39:52.560317+0000","last_active":"2024-09-14T08:40:05.642896+0000","last_peered":"2024-09-14T08:40:05.642896+0000","last_clean":"2024-09-14T08:39:44.515729+0000","last_became_active":"2024-09-14T08:39:52.560317+0000","last_became_peered":"2024-09-14T08:39:52.560317+0000","last_unstale":"2024-09-14T08:40:05.642896+0000","last_undegraded":"2024-09-14T08:39:52.558935+0000","last_fullsized":"2024-09-14T08:39:52.558691+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:42.084949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047135900000000002,"stat_sum":{"num_bytes":259072,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":5,"num_read":130,"num_read_kb":329,"num_write":27,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":8}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.616902+0000","last_change":"2024-09-14T08:39:10.709726+0000","last_active":"2024-09-14T08:40:05.616902+0000","last_peered":"2024-09-14T08:40:05.616902+0000","last_clean":"2024-09-14T08:40:05.616902+0000","last_became_active":"2024-09-14T08:39:08.129482+0000","last_became_peered":"2024-09-14T08:39:08.129482+0000","last_unstale":"2024-09-14T08:40:05.616902+0000","last_undegraded":"2024-09-14T08:40:05.616902+0000","last_fullsized":"2024-09-14T08:40:05.616902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.464996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010748229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"38'26","reported_seq":871,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.618497+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:40:05.618497+0000","last_peered":"2024-09-14T08:40:05.618497+0000","last_clean":"2024-09-14T08:40:05.618497+0000","last_became_active":"2024-09-14T08:39:18.387242+0000","last_became_peered":"2024-09-14T08:39:18.387242+0000","last_unstale":"2024-09-14T08:40:05.618497+0000","last_undegraded":"2024-09-14T08:40:05.618497+0000","last_fullsized":"2024-09-14T08:40:05.618497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:54.014956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332069,"stat_sum":{"num_bytes":5649936,"num_objects":10,"num_object_clones":1,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":6,"num_read":784,"num_read_kb":8127,"num_write":20,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-14T08:40:02.612516+0000","last_change":"2024-09-14T08:39:10.137121+0000","last_active":"2024-09-14T08:40:02.612516+0000","last_peered":"2024-09-14T08:40:02.612516+0000","last_clean":"2024-09-14T08:40:02.612516+0000","last_became_active":"2024-09-14T08:39:08.129594+0000","last_became_peered":"2024-09-14T08:39:08.129594+0000","last_unstale":"2024-09-14T08:40:02.612516+0000","last_undegraded":"2024-09-14T08:40:02.612516+0000","last_fullsized":"2024-09-14T08:40:02.612516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:50.092003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001084296,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.644506+0000","last_change":"2024-09-14T08:39:19.413056+0000","last_active":"2024-09-14T08:40:05.644506+0000","last_peered":"2024-09-14T08:40:05.644506+0000","last_clean":"2024-09-14T08:40:05.644506+0000","last_became_active":"2024-09-14T08:39:19.391073+0000","last_became_peered":"2024-09-14T08:39:19.391073+0000","last_unstale":"2024-09-14T08:40:05.644506+0000","last_undegraded":"2024-09-14T08:40:05.644506+0000","last_fullsized":"2024-09-14T08:40:05.644506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:47.792966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"39'122","reported_seq":17586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.644583+0000","last_change":"2024-09-14T08:39:20.418935+0000","last_active":"2024-09-14T08:40:05.644583+0000","last_peered":"2024-09-14T08:40:05.644583+0000","last_clean":"2024-09-14T08:40:05.644583+0000","last_became_active":"2024-09-14T08:39:18.382844+0000","last_became_peered":"2024-09-14T08:39:18.382844+0000","last_unstale":"2024-09-14T08:40:05.644583+0000","last_undegraded":"2024-09-14T08:40:05.644583+0000","last_fullsized":"2024-09-14T08:40:05.644583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:57.172743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013334390000000001,"stat_sum":{"num_bytes":6590525,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":11,"num_read":15851,"num_read_kb":10516,"num_write":85,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"38'163","reported_seq":2139,"reported_epoch":49,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:05.644296+0000","last_change":"2024-09-14T08:39:56.596375+0000","last_active":"2024-09-14T08:40:05.644296+0000","last_peered":"2024-09-14T08:40:05.644296+0000","last_clean":"2024-09-14T08:40:05.644296+0000","last_became_active":"2024-09-14T08:39:56.595813+0000","last_became_peered":"2024-09-14T08:39:56.595813+0000","last_unstale":"2024-09-14T08:40:05.644296+0000","last_undegraded":"2024-09-14T08:40:05.644296+0000","last_fullsized":"2024-09-14T08:40:05.644296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:58:27.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011980249999999999,"stat_sum":{"num_bytes":15996416,"num_objects":19,"num_object_clones":5,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":19,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":11,"num_read":3246,"num_read_kb":4372,"num_write":136,"num_write_kb":2182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[{"shards":"2,4","objects":19}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"38'84","reported_seq":687,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.617010+0000","last_change":"2024-09-14T08:39:55.635377+0000","last_active":"2024-09-14T08:40:05.617010+0000","last_peered":"2024-09-14T08:40:05.617010+0000","last_clean":"2024-09-14T08:40:05.617010+0000","last_became_active":"2024-09-14T08:39:55.584059+0000","last_became_peered":"2024-09-14T08:39:55.584059+0000","last_unstale":"2024-09-14T08:40:05.617010+0000","last_undegraded":"2024-09-14T08:40:05.617010+0000","last_fullsized":"2024-09-14T08:40:05.617010+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:15:10.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002911753,"stat_sum":{"num_bytes":352256,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":7,"num_read":1107,"num_read_kb":970,"num_write":50,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16384,"num_keys_recovered":15,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"35'24","reported_seq":145,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:05.618140+0000","last_change":"2024-09-14T08:39:52.551432+0000","last_active":"2024-09-14T08:40:05.618140+0000","last_peered":"2024-09-14T08:40:05.618140+0000","last_clean":"2024-09-14T08:39:50.569609+0000","last_became_active":"2024-09-14T08:39:52.551432+0000","last_became_peered":"2024-09-14T08:39:52.551432+0000","last_unstale":"2024-09-14T08:40:05.618140+0000","last_undegraded":"2024-09-14T08:39:52.550774+0000","last_fullsized":"2024-09-14T08:39:52.550674+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:36.522295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013500459999999999,"stat_sum":{"num_bytes":878608,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":12,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":7,"num_read":57,"num_read_kb":216,"num_write":19,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":12}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"38'121","reported_seq":14512,"reported_epoch":48,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:05.072455+0000","last_change":"2024-09-14T08:39:52.561097+0000","last_active":"2024-09-14T08:40:05.072455+0000","last_peered":"2024-09-14T08:40:05.072455+0000","last_clean":"2024-09-14T08:39:50.651509+0000","last_became_active":"2024-09-14T08:39:52.561097+0000","last_became_peered":"2024-09-14T08:39:52.561097+0000","last_unstale":"2024-09-14T08:40:05.072455+0000","last_undegraded":"2024-09-14T08:39:52.557286+0000","last_fullsized":"2024-09-14T08:39:52.556541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:21.570344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652499,"stat_sum":{"num_bytes":10177575,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":13,"num_read":15092,"num_read_kb":11431,"num_write":106,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":23}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"39'51","reported_seq":299,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.617226+0000","last_change":"2024-09-14T08:39:20.411611+0000","last_active":"2024-09-14T08:40:05.617226+0000","last_peered":"2024-09-14T08:40:05.617226+0000","last_clean":"2024-09-14T08:40:05.617226+0000","last_became_active":"2024-09-14T08:39:18.373934+0000","last_became_peered":"2024-09-14T08:39:18.373934+0000","last_unstale":"2024-09-14T08:40:05.617226+0000","last_undegraded":"2024-09-14T08:40:05.617226+0000","last_fullsized":"2024-09-14T08:40:05.617226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:40:54.252698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024901429999999998,"stat_sum":{"num_bytes":3124736,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":6,"num_read":241,"num_read_kb":1508,"num_write":37,"num_write_kb":742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"38'40","reported_seq":721,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-14T08:40:02.612546+0000","last_change":"2024-09-14T08:39:20.397983+0000","last_active":"2024-09-14T08:40:02.612546+0000","last_peered":"2024-09-14T08:40:02.612546+0000","last_clean":"2024-09-14T08:40:02.612546+0000","last_became_active":"2024-09-14T08:39:18.384061+0000","last_became_peered":"2024-09-14T08:39:18.384061+0000","last_unstale":"2024-09-14T08:40:02.612546+0000","last_undegraded":"2024-09-14T08:40:02.612546+0000","last_fullsized":"2024-09-14T08:40:02.612546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:41.225693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002389113,"stat_sum":{"num_bytes":5900800,"num_objects":16,"num_object_clones":2,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":11,"num_read":623,"num_read_kb":4781,"num_write":31,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"38'66","reported_seq":764,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-14T08:40:02.612508+0000","last_change":"2024-09-14T08:39:20.398068+0000","last_active":"2024-09-14T08:40:02.612508+0000","last_peered":"2024-09-14T08:40:02.612508+0000","last_clean":"2024-09-14T08:40:02.612508+0000","last_became_active":"2024-09-14T08:39:18.389870+0000","last_became_peered":"2024-09-14T08:39:18.389870+0000","last_unstale":"2024-09-14T08:40:02.612508+0000","last_undegraded":"2024-09-14T08:40:02.612508+0000","last_fullsized":"2024-09-14T08:40:02.612508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:42.603121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023917970000000002,"stat_sum":{"num_bytes":6349840,"num_objects":24,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":16,"num_read":654,"num_read_kb":4453,"num_write":49,"num_write_kb":2194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"38'58","reported_seq":58,"reported_epoch":49,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:05.644231+0000","last_change":"2024-09-14T08:39:56.643519+0000","last_active":"2024-09-14T08:40:05.644231+0000","last_peered":"2024-09-14T08:40:05.644231+0000","last_clean":"2024-09-14T08:40:05.644231+0000","last_became_active":"2024-09-14T08:39:56.593633+0000","last_became_peered":"2024-09-14T08:39:56.593633+0000","last_unstale":"2024-09-14T08:40:05.644231+0000","last_undegraded":"2024-09-14T08:40:05.644231+0000","last_fullsized":"2024-09-14T08:40:05.644231+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:42:57.662984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024547029999999999,"stat_sum":{"num_bytes":13156478,"num_objects":15,"num_object_clones":3,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":15,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":6,"num_read":1158,"num_read_kb":13497,"num_write":67,"num_write_kb":743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":177790,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[{"shards":"2,5","objects":15}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"38'103","reported_seq":847,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-14T08:40:05.616907+0000","last_change":"2024-09-14T08:39:20.410176+0000","last_active":"2024-09-14T08:40:05.616907+0000","last_peered":"2024-09-14T08:40:05.616907+0000","last_clean":"2024-09-14T08:40:05.616907+0000","last_became_active":"2024-09-14T08:39:18.385169+0000","last_became_peered":"2024-09-14T08:39:18.385169+0000","last_unstale":"2024-09-14T08:40:05.616907+0000","last_undegraded":"2024-09-14T08:40:05.616907+0000","last_fullsized":"2024-09-14T08:40:05.616907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:01.585554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001362044,"stat_sum":{"num_bytes":528896,"num_objects":21,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":14,"num_read":1485,"num_read_kb":1468,"num_write":65,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"38'119","reported_seq":1978,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:05.616978+0000","last_change":"2024-09-14T08:39:52.552459+0000","last_active":"2024-09-14T08:40:05.616978+0000","last_peered":"2024-09-14T08:40:05.616978+0000","last_clean":"2024-09-14T08:39:46.839527+0000","last_became_active":"2024-09-14T08:39:52.552459+0000","last_became_peered":"2024-09-14T08:39:52.552459+0000","last_unstale":"2024-09-14T08:40:05.616978+0000","last_undegraded":"2024-09-14T08:39:52.550601+0000","last_fullsized":"2024-09-14T08:39:52.550330+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:11.055470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013117140000000001,"stat_sum":{"num_bytes":2921984,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":18,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":11,"num_read":2128,"num_read_kb":2094,"num_write":63,"num_write_kb":2122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":18}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"38'43","reported_seq":374,"reported_epoch":48,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:02.612168+0000","last_change":"2024-09-14T08:39:56.592735+0000","last_active":"2024-09-14T08:40:02.612168+0000","last_peered":"2024-09-14T08:40:02.612168+0000","last_clean":"2024-09-14T08:40:02.612168+0000","last_became_active":"2024-09-14T08:39:56.591710+0000","last_became_peered":"2024-09-14T08:39:56.591710+0000","last_unstale":"2024-09-14T08:40:02.612168+0000","last_undegraded":"2024-09-14T08:40:02.612168+0000","last_fullsized":"2024-09-14T08:40:02.612168+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:22.781881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018326740000000001,"stat_sum":{"num_bytes":8705062,"num_objects":15,"num_object_clones":2,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":15,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":9,"num_read":280,"num_read_kb":1651,"num_write":35,"num_write_kb":716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[{"shards":"3,5","objects":15}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":208340928,"num_objects":514,"num_object_clones":96,"num_object_copies":1028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":49,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":312,"num_read":167335,"num_read_kb":213288,"num_write":2446,"num_write_kb":21222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":194174,"num_keys_recovered":15,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19173376,"data_stored":18811390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2535,"ondisk_log_size":2535,"up":50,"acting":53,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":14,"acting":14,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34376,"kb_used_data":3188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337464,"statfs":{"total":96636764160,"available":96601563136,"internally_reserved":0,"allocated":3264512,"data_stored":2854096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":5884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":6025216,"data_stored":5631683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34144,"kb_used_data":2956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337696,"statfs":{"total":96636764160,"available":96601800704,"internally_reserved":0,"allocated":3026944,"data_stored":2686939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34384,"kb_used_data":3196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337456,"statfs":{"total":96636764160,"available":96601554944,"internally_reserved":0,"allocated":3272704,"data_stored":2925156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607569,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35012,"kb_used_data":3824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336828,"statfs":{"total":96636764160,"available":96600911872,"internally_reserved":0,"allocated":3915776,"data_stored":3480110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607567,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35092,"kb_used_data":3904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336748,"statfs":{"total":96636764160,"available":96600829952,"internally_reserved":0,"allocated":3997696,"data_stored":3621417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3571712,"data_stored":3460262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2732032,"data_stored":2717977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1884160,"data_stored":1884270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5476352,"data_stored":5419382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2134016,"data_stored":2056568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3375104,"data_stored":3272931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:40:08.570 INFO:tasks.thrashosds.thrasher:Setting 3.9 to [1, 0] 2024-09-14T08:40:08.570 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.9', '1', '0'] 2024-09-14T08:40:08.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.9 1 0 2024-09-14T08:40:08.574 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:08.574 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:08.591 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:08.623 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:40:08.651 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:08.652+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:08.752 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:08.755+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:08.754 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:08.754 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:08.769 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:08.854 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:08.859+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:08.896 INFO:teuthology.orchestra.run.smithi188.stdout:695 trunc from 0xadffa00 to 0x7410a00 2024-09-14T08:40:08.938 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:08.938 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:08.954 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:08.956+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:08.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:09.055 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:09.059+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:09.134 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:09.134 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:09.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:09.156 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:09.159+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:09.256 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:09.259+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:09.265 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:09.265 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:09.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:09.357 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:09.360+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:09.392 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:09.392 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:09.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:09.458 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:09.459+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:09.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:09.559 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:09.563+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:09.626 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:09.626 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:09.633 INFO:teuthology.orchestra.run.smithi089.stderr:set 3.9 pg_upmap mapping to [1,0] 2024-09-14T08:40:09.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:09.670 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:09.668+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:09.682 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:09.704 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:09.704 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:09.726 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:09.726 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:09.744 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:09.744 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:09.760 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:09.760+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:09.765 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:09.765 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:09.789 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:09.789 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:09.792 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:09.793 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:09.809 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:09.810 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:09.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:09.861 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:09.863+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:09.962 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:09.967+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:09.982 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:09.982 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:09.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:09.982 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:09.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.982 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33401 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3549184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:09.982 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:09.982 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707476213, 2024-09-14T08:40:09.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065012249999999994, 2024-09-14T08:40:09.982 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33401 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:09.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277735+0000", 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4000000000000001e-07 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277738+0000", 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8729999999999999e-06 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277747+0000", 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6319999999999997e-06 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277754+0000", 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2729999999999997e-06 2024-09-14T08:40:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342439+0000", 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064685272000000002 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342540+0000", 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:09.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342747+0000", 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020656 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33403 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3560448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707384549, 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065276109999999998, 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:09.987 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33403 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277827+0000", 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.23e-07 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277830+0000", 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:40:09.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277839+0000", 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277846+0000", 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1590000000000004e-06 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:09.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342820+0000", 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064974064999999998 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342954+0000", 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133509 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343102+0000", 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000148539 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:09.991 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33404 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3571712~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707353087, 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065555713000000002, 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:09.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33404 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:09.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277861+0000", 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9790000000000002e-06 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277881+0000", 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9463999999999999e-05 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277889+0000", 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7190000000000001e-06 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343177+0000", 2024-09-14T08:40:09.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065288760000000001 2024-09-14T08:40:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343279+0000", 2024-09-14T08:40:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101974 2024-09-14T08:40:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343414+0000", 2024-09-14T08:40:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013411 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33405 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707311775999999, 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065812103999999996, 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:09.997 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33405 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277900+0000", 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277922+0000", 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1540999999999999e-05 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277932+0000", 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0587999999999999e-05 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277940+0000", 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5360000000000004e-06 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343480+0000", 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065539753000000006 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343581+0000", 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101005 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343711+0000", 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013069500000000001 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707259643, 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707230847, 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:40:10.006 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:40:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707202027999999, 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.011 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:40:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707173699, 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.016 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:40:10.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707144499, 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.021 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:40:10.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.025 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707112491, 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.026 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:40:10.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.030 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707083215000001, 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:40:10.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707053548999999, 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.035 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:40:10.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.707025006, 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:10.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.706996699999999, 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:40:10.044 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:40:10.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:40:10.048 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.706951433, 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:40:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:40:10.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.706919811000001, 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:10.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:40:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.706861999000001, 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:40:10.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.706793985999999, 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.063 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:40:10.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:40:10.067 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.068 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.068 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.068 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:10.068 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.706758614, 2024-09-14T08:40:10.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:40:10.068 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:40:10.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.072 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.706724214999999, 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.073 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:40:10.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:10.077 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:10.079 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:10.080 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:10.083+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:10.180 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:10.180+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:10.199 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:10.199 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:10.199 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:10.199 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:10.213 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:10.280 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:10.280+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:10.348 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:10.348 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:10.362 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:10.406 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:10.411+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.235529718, 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:40:10.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:40:10.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.486 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.235467705, 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.487 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.235401375, 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:40:10.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:40:10.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:40:10.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:40:10.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:40:10.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:10.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.235345915, 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:40:10.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.235286295, 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.503 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:10.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:40:10.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.235204755, 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:40:10.508 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:40:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.235148427, 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:40:10.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.235076932, 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:40:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:40:10.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.523 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.524 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.524 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:10.524 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.235004061, 2024-09-14T08:40:10.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:40:10.524 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.524 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.524 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:40:10.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:10.529 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234961848999999, 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:40:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234932019, 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:40:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234903722, 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:40:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:40:10.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234862627, 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.545 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:10.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:40:10.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:10.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.550 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234833597, 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.551 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:40:10.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:40:10.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:40:10.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:10.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:10.556 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234805113, 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:40:10.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234776973000001, 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:40:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234748277, 2024-09-14T08:40:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:40:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:40:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234719520000001, 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:40:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:40:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:40:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:40:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:40:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:40:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:40:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234691473, 2024-09-14T08:40:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:40:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:40:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:40:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.234661495999999, 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:40:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:40:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:40:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:40:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:10.589 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:10.591 INFO:teuthology.orchestra.run.smithi188.stdout:697 read 0x2077200 thru 0x2082254 (0xb055 bytes) 2024-09-14T08:40:10.591 INFO:teuthology.orchestra.run.smithi188.stdout:698 read 0xd88a00 thru 0xd90e8d (0x848e bytes) 2024-09-14T08:40:10.591 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:10.592 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:10.592+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:10.638 INFO:teuthology.orchestra.run.smithi188.stdout:702 write 0xc712400 thru 0xc7174e7 (0x50e8 bytes) 2024-09-14T08:40:10.649 INFO:teuthology.orchestra.run.smithi188.stdout:704 punch from 0x226cc00 to 0x226fc00, (0x3000 bytes) 2024-09-14T08:40:10.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:40:10.653 INFO:teuthology.orchestra.run.smithi188.stdout:705 write 0x8949200 thru 0x894c9fa (0x37fb bytes) 2024-09-14T08:40:10.701 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:10.704+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:10.793 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:10.796+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:10.800 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:10.800 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:10.800 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:10.800 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:10.814 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:10.894 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:10.896+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:10.956 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:10.956 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:10.956 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:10.957 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:10.957 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:10.975 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:10.996 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:10.996+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:11.096 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:11.099+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:11.115 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2333303019999999, 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:40:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:40:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2220782670000001, 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:40:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.221218382, 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2209117570000001, 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:40:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.220508422, 2024-09-14T08:40:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:40:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:40:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2201047190000001, 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:40:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:40:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.219753973, 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:40:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:40:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2193677009999999, 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:40:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:40:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2191771680000001, 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:40:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:40:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:40:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:40:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:40:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:40:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:40:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:40:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2186704399999999, 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:40:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2183443679999999, 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:40:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.218034756, 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:40:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2175392140000001, 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2172234559999999, 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:40:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:40:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2167360199999999, 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.216386008, 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:40:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2155948890000001, 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.21518583, 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15691 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2255872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.905659+0000", 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2140032789999999, 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098156625999999997, 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15691 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905659+0000", 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905659+0000", 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.906171+0000", 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051182300000000001 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.906178+0000", 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6369999999999999e-06 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.906198+0000", 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9514e-05 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.906211+0000", 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2685e-05 2024-09-14T08:40:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.003512+0000", 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097301841 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.003626+0000", 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011382700000000001 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.003815+0000", 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000189299 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2125531430000001, 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.210 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:11.212 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:11.212 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:11.215+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:11.312 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:11.312+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:11.396 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:11.396 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:11.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.396 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:34284 3.16 3:6a513e68:::rbd_data.10f1c6465cc8.0000000000000006:8 [read 3335168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-14T08:40:11.396 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:11.399082+0000", 2024-09-14T08:40:11.396 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.002611281, 2024-09-14T08:40:11.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002630903, 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 34284 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399082+0000", 2024-09-14T08:40:11.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399082+0000", 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399083+0000", 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.23e-07 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399086+0000", 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1949999999999999e-06 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399098+0000", 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1941e-05 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399107+0000", 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.611e-06 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.401681+0000", 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025738010000000001 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:34286 3.16 3.167c8a56 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:11.399138+0000", 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0025551530000000001, 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002611585, 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.400 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 34286 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399138+0000", 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399138+0000", 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399139+0000", 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3900000000000003e-07 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399143+0000", 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.647e-06 2024-09-14T08:40:11.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399154+0000", 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1430000000000001e-05 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399179+0000", 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5457e-05 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.403 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:34288 3.16 3.167c8a56 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:11.399206+0000", 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0024870140000000001, 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025709740000000002, 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 34288 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399206+0000", 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399206+0000", 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399207+0000", 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5199999999999995e-07 2024-09-14T08:40:11.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399211+0000", 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399221+0000", 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7350000000000008e-06 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399226+0000", 2024-09-14T08:40:11.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0270000000000003e-06 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:34290 3.16 3.167c8a56 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:11.399236+0000", 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.002456738, 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002566048, 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.407 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 34290 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399236+0000", 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399236+0000", 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399237+0000", 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399239+0000", 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2259999999999999e-06 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399246+0000", 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4500000000000001e-06 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399250+0000", 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3460000000000004e-06 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.410 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:34292 3.16 3.167c8a56 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:11.399336+0000", 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0023569509999999999, 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002491376, 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 34292 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399336+0000", 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399336+0000", 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399337+0000", 2024-09-14T08:40:11.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7400000000000003e-07 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399340+0000", 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8499999999999998e-06 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399350+0000", 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9969999999999993e-06 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399355+0000", 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1109999999999999e-06 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:34294 3.16 3.167c8a56 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:11.399464+0000", 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0022288669999999998, 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023898109999999999, 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:11.414 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 34294 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399464+0000", 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399464+0000", 2024-09-14T08:40:11.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399465+0000", 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4700000000000001e-07 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399468+0000", 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.977e-06 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399488+0000", 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0017000000000002e-05 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399500+0000", 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2411e-05 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:34296 3.16 3.167c8a56 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:11.399522+0000", 2024-09-14T08:40:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0021715079999999999, 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002358822, 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 34296 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399522+0000", 2024-09-14T08:40:11.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399522+0000", 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399523+0000", 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-07 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399526+0000", 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8999999999999999e-06 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399537+0000", 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0613e-05 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:11.399546+0000", 2024-09-14T08:40:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5299999999999996e-06 2024-09-14T08:40:11.421 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.421 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.421 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.421 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.421 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:40:11.421 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 7 2024-09-14T08:40:11.421 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:11.422 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:11.423 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:11.424+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:11.523 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:11.527+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:11.555 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:11.556 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:11.556 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:11.556 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:11.556 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:11.570 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:11.652 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:40:11.658 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:11.663+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:11.724 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:11.727+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:11.778 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54084 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5699584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.704000352, 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093000530999999997, 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54084 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078497+0000", 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078500+0000", 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1360000000000001e-06 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078509+0000", 2024-09-14T08:40:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9490000000000002e-06 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078516+0000", 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.233e-06 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.170871+0000", 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092354443999999994 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171110+0000", 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000239349 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171497+0000", 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038669300000000002 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54085 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5710848~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703970348, 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093690545, 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54085 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078527+0000", 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078530+0000", 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8660000000000002e-06 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078539+0000", 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9560000000000003e-06 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078546+0000", 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1489999999999997e-06 2024-09-14T08:40:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171585+0000", 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093038914 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171820+0000", 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000235558 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172217+0000", 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039639900000000002 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54086 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5722112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703940818, 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094383724000000002, 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54086 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078557+0000", 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078560+0000", 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-06 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078571+0000", 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0951999999999999e-05 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078579+0000", 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7760000000000003e-06 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172313+0000", 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093733343999999996 2024-09-14T08:40:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172558+0000", 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024562199999999997 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172940+0000", 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038131999999999999 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54087 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5644288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703906798, 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095045525000000006, 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54087 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078591+0000", 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078594+0000", 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078603+0000", 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3759999999999997e-06 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078610+0000", 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0160000000000003e-06 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173032+0000", 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094421672999999998 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173265+0000", 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000233265 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173635+0000", 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037049899999999999 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54088 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5733376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703876328, 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095706712999999999, 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.797 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54088 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078621+0000", 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078624+0000", 2024-09-14T08:40:11.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078633+0000", 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3950000000000007e-06 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078641+0000", 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4900000000000003e-06 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173728+0000", 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095086680000000007 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173954+0000", 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022685000000000001 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174327+0000", 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037261800000000002 2024-09-14T08:40:11.801 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703845511000001, 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.802 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:11.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:11.806 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703757414, 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703690017, 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.811 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:11.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703616321, 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.816 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703540848999999, 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:11.820 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:11.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.824 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703483645, 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:11.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:11.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703424761000001, 2024-09-14T08:40:11.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.833 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703359835000001, 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.834 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:11.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:11.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:11.838 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703298384, 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:11.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:11.842 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.70323885, 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:11.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703179540000001, 2024-09-14T08:40:11.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:11.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:11.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.703107508, 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:11.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.856 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56620 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5999616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.176914460000001, 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092334608999999998, 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56620 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605583+0000", 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605586+0000", 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0060000000000001e-06 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605595+0000", 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605602+0000", 2024-09-14T08:40:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2760000000000003e-06 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697625+0000", 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092022458000000001 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697749+0000", 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124201 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697917+0000", 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016798900000000001 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56621 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 6010880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.1768842, 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092668125000000004, 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.861 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.862 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56621 2024-09-14T08:40:11.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.862 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:11.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605613+0000", 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605616+0000", 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.106e-06 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605627+0000", 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1026000000000001e-05 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605635+0000", 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3289999999999996e-06 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697992+0000", 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092357106999999994 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698109+0000", 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117615 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698281+0000", 2024-09-14T08:40:11.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017125199999999999 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56622 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 6022144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.17685174, 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092976195999999997, 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:11.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56622 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:11.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605646+0000", 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605649+0000", 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0730000000000001e-06 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:11.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605658+0000", 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9090000000000006e-06 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605667+0000", 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9160000000000007e-06 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698330+0000", 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092663841999999996 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:11.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698447+0000", 2024-09-14T08:40:11.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116921 2024-09-14T08:40:11.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:11.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:11.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:11.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698621+0000", 2024-09-14T08:40:11.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017383200000000001 2024-09-14T08:40:11.870 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.870 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.871 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.871 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:11.871 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:11.871 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:11.871 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:11.873 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:11.875+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:11.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:11.974 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:11.975+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:12.028 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41039 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986361+0000", 2024-09-14T08:40:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.031244805, 2024-09-14T08:40:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031259483999999997, 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41039 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986361+0000", 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986361+0000", 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986361+0000", 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4200000000000001e-07 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986363+0000", 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4150000000000002e-06 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986371+0000", 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0380000000000002e-06 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986376+0000", 2024-09-14T08:40:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5140000000000001e-06 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41189 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987107+0000", 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030498153, 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030545981999999999, 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41189 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987107+0000", 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987107+0000", 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987107+0000", 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2999999999999999e-07 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987109+0000", 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.124e-06 2024-09-14T08:40:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987112+0000", 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5899999999999999e-06 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987117+0000", 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2750000000000003e-06 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41249 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988266+0000", 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029339528, 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029413725000000002, 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41249 2024-09-14T08:40:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988266+0000", 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988266+0000", 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988266+0000", 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5699999999999998e-07 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988268+0000", 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1780000000000002e-06 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988273+0000", 2024-09-14T08:40:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.028e-06 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988276+0000", 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9610000000000001e-06 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41583 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.004909+0000", 2024-09-14T08:40:12.039 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012696877000000001, 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012800005999999999, 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41583 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004909+0000", 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004909+0000", 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005089+0000", 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018042199999999999 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005092+0000", 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5379999999999998e-06 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005100+0000", 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9710000000000004e-06 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005106+0000", 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9200000000000001e-06 2024-09-14T08:40:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41708 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011582+0000", 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.006023016, 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006170572, 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.043 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41708 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011582+0000", 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011582+0000", 2024-09-14T08:40:12.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011583+0000", 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.44e-07 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011585+0000", 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1009999999999999e-06 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011591+0000", 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2940000000000002e-06 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011596+0000", 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6670000000000004e-06 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.046 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41041 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986384+0000", 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.031221717, 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031421151000000001, 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41041 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986384+0000", 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986384+0000", 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986384+0000", 2024-09-14T08:40:12.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2899999999999999e-07 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986386+0000", 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8899999999999999e-06 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986392+0000", 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5300000000000004e-06 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986396+0000", 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.617e-06 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41190 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987125+0000", 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030480357999999999, 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030730305999999999, 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.050 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41190 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987125+0000", 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987125+0000", 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987127+0000", 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8500000000000001e-06 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987129+0000", 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9369999999999998e-06 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987135+0000", 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7490000000000004e-06 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987139+0000", 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5120000000000002e-06 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.053 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41252 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988292+0000", 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.02931338, 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029611543000000001, 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41252 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988292+0000", 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988292+0000", 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988332+0000", 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9580999999999999e-05 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988333+0000", 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.73e-06 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988338+0000", 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2640000000000002e-06 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988341+0000", 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0529999999999998e-06 2024-09-14T08:40:12.056 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41379 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.992277+0000", 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.02532877, 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025667142, 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41379 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992277+0000", 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992277+0000", 2024-09-14T08:40:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992451+0000", 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000174811 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992455+0000", 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7780000000000001e-06 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992466+0000", 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1211e-05 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992473+0000", 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8709999999999999e-06 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.060 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41411 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.995184+0000", 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.022421573, 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022786952999999999, 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41411 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995184+0000", 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995184+0000", 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995184+0000", 2024-09-14T08:40:12.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8599999999999999e-07 2024-09-14T08:40:12.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995196+0000", 2024-09-14T08:40:12.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1328999999999999e-05 2024-09-14T08:40:12.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995202+0000", 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.302e-06 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995205+0000", 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1480000000000002e-06 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41544 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.001851+0000", 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.015754579000000001, 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016145082000000002, 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41544 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.065 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001851+0000", 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001851+0000", 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001851+0000", 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001854+0000", 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2560000000000001e-06 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001860+0000", 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1190000000000002e-06 2024-09-14T08:40:12.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001865+0000", 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8250000000000004e-06 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41585 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.005122+0000", 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012483655999999999, 2024-09-14T08:40:12.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012898260999999999, 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41585 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005122+0000", 2024-09-14T08:40:12.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005122+0000", 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005122+0000", 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4199999999999995e-07 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005125+0000", 2024-09-14T08:40:12.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.356e-06 2024-09-14T08:40:12.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005131+0000", 2024-09-14T08:40:12.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1410000000000002e-06 2024-09-14T08:40:12.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005135+0000", 2024-09-14T08:40:12.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5399999999999997e-06 2024-09-14T08:40:12.072 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.072 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.072 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.072 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41661 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.008225+0000", 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0093806900000000006, 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0098193489999999998, 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41661 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008225+0000", 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008225+0000", 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008225+0000", 2024-09-14T08:40:12.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2e-07 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008227+0000", 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.148e-06 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008233+0000", 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1059999999999996e-06 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008238+0000", 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8280000000000002e-06 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41043 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986402+0000", 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.031203033000000002, 2024-09-14T08:40:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031686812000000002, 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41043 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986402+0000", 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986402+0000", 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986403+0000", 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1100000000000001e-07 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986404+0000", 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7010000000000001e-06 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986408+0000", 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5710000000000002e-06 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986410+0000", 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4380000000000002e-06 2024-09-14T08:40:12.079 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41191 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987145+0000", 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030460132000000001, 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030993021999999999, 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.080 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41191 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987145+0000", 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987145+0000", 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987146+0000", 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2899999999999999e-07 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987147+0000", 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7230000000000001e-06 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987153+0000", 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987157+0000", 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2590000000000002e-06 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.083 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41254 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988348+0000", 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029257004999999999, 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029838173999999999, 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41254 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988348+0000", 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988348+0000", 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988349+0000", 2024-09-14T08:40:12.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.84e-07 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988362+0000", 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3414999999999999e-05 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988366+0000", 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9750000000000001e-06 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988369+0000", 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8669999999999998e-06 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41587 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.005143+0000", 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012462766, 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013092612999999999, 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.087 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41587 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005143+0000", 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005143+0000", 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005355+0000", 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021211799999999999 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005359+0000", 2024-09-14T08:40:12.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9380000000000002e-06 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005364+0000", 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3020000000000002e-06 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005368+0000", 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7469999999999999e-06 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41664 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.008245+0000", 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0093603019999999992, 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010031691000000001, 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41664 2024-09-14T08:40:12.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008245+0000", 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008245+0000", 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008246+0000", 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9400000000000001e-07 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008247+0000", 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9700000000000002e-06 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008257+0000", 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5740000000000002e-06 2024-09-14T08:40:12.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008262+0000", 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9899999999999997e-06 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41710 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.012921+0000", 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0046843170000000003, 2024-09-14T08:40:12.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0053802989999999998, 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41710 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012921+0000", 2024-09-14T08:40:12.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012921+0000", 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012922+0000", 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9599999999999999e-07 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012924+0000", 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7049999999999999e-06 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012932+0000", 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8040000000000002e-06 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012938+0000", 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.097 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41045 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986437+0000", 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.031168675999999999, 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031902211999999999, 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.098 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41045 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986437+0000", 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986437+0000", 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986437+0000", 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4299999999999999e-07 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986439+0000", 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986445+0000", 2024-09-14T08:40:12.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9699999999999996e-06 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986449+0000", 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4950000000000002e-06 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41192 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987164+0000", 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030441689000000001, 2024-09-14T08:40:12.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031222703000000001, 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41192 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987164+0000", 2024-09-14T08:40:12.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987164+0000", 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987164+0000", 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5499999999999999e-07 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987165+0000", 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.235e-06 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987170+0000", 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.296e-06 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987172+0000", 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5170000000000002e-06 2024-09-14T08:40:12.104 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41256 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988374+0000", 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029231627, 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030041062, 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.105 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41256 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988374+0000", 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988374+0000", 2024-09-14T08:40:12.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988435+0000", 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1116000000000002e-05 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988437+0000", 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4619999999999999e-06 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988444+0000", 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7499999999999997e-06 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988448+0000", 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7009999999999998e-06 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.108 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41381 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.992506+0000", 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.025099033999999999, 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025932356, 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41381 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.109 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992506+0000", 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992506+0000", 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992670+0000", 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016384400000000001 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992673+0000", 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1030000000000002e-06 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992682+0000", 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2979999999999992e-06 2024-09-14T08:40:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992688+0000", 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9120000000000003e-06 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41413 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.995221+0000", 2024-09-14T08:40:12.112 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.022384614000000001, 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023242108000000001, 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41413 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995221+0000", 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995221+0000", 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995221+0000", 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:40:12.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995222+0000", 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.063e-06 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995225+0000", 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0469999999999998e-06 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995228+0000", 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4439999999999998e-06 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41508 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.998593+0000", 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019012423000000001, 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019905652999999999, 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.116 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41508 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998593+0000", 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998593+0000", 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998594+0000", 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6400000000000002e-07 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998596+0000", 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7149999999999998e-06 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998603+0000", 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8889999999999996e-06 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998608+0000", 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.028e-06 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.119 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41546 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.001957+0000", 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.015648410000000001, 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016589493, 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41546 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001957+0000", 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001957+0000", 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001957+0000", 2024-09-14T08:40:12.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.15e-07 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001959+0000", 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3400000000000001e-06 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001962+0000", 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3270000000000001e-06 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001972+0000", 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5049999999999996e-06 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41589 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.005375+0000", 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012230679, 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013220202, 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.123 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41589 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005375+0000", 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005375+0000", 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005375+0000", 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0800000000000001e-07 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005376+0000", 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3909999999999999e-06 2024-09-14T08:40:12.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005389+0000", 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2286999999999999e-05 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005392+0000", 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.101e-06 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.126 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41666 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.008269+0000", 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0093368340000000005, 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010374909, 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41666 2024-09-14T08:40:12.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008269+0000", 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008269+0000", 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008269+0000", 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4300000000000003e-07 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008271+0000", 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2709999999999999e-06 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008277+0000", 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9179999999999999e-06 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008282+0000", 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6890000000000003e-06 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41047 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986456+0000", 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.031149567999999999, 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032248891000000002, 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41047 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986456+0000", 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986456+0000", 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986456+0000", 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2000000000000001e-07 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986458+0000", 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.722e-06 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986463+0000", 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4009999999999996e-06 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986468+0000", 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1220000000000003e-06 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41193 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987189+0000", 2024-09-14T08:40:12.133 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030416715, 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031542642000000003, 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41193 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987189+0000", 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987189+0000", 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987189+0000", 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2999999999999999e-07 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987190+0000", 2024-09-14T08:40:12.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.218e-06 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987197+0000", 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3960000000000003e-06 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987200+0000", 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5779999999999999e-06 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41258 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988455+0000", 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029149916000000001, 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030309011, 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41258 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.137 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988455+0000", 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988455+0000", 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988456+0000", 2024-09-14T08:40:12.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2200000000000003e-07 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988458+0000", 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5090000000000001e-06 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988462+0000", 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2830000000000003e-06 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988465+0000", 2024-09-14T08:40:12.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4149999999999999e-06 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41510 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.998617+0000", 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018988365, 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020171868999999999, 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41510 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998617+0000", 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998617+0000", 2024-09-14T08:40:12.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998618+0000", 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5899999999999996e-07 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998620+0000", 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.001e-06 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998625+0000", 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5659999999999997e-06 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998630+0000", 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7859999999999996e-06 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41591 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.005399+0000", 2024-09-14T08:40:12.143 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012206633999999999, 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013415577, 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41591 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005399+0000", 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005399+0000", 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005399+0000", 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9100000000000004e-07 2024-09-14T08:40:12.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005401+0000", 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9089999999999998e-06 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005405+0000", 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7299999999999999e-06 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005410+0000", 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4020000000000001e-06 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.146 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41668 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.008288+0000", 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0093172319999999999, 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010550274, 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41668 2024-09-14T08:40:12.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008288+0000", 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008288+0000", 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008466+0000", 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000177701 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008474+0000", 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6629999999999993e-06 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008482+0000", 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6100000000000006e-06 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008488+0000", 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6860000000000003e-06 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41712 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.012971+0000", 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0046346080000000001, 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0059233819999999996, 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.150 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41712 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012971+0000", 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012971+0000", 2024-09-14T08:40:12.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012971+0000", 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012973+0000", 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0250000000000001e-06 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012980+0000", 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4219999999999997e-06 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.012985+0000", 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9080000000000003e-06 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41049 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986510+0000", 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.031095653000000001, 2024-09-14T08:40:12.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032427040999999997, 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41049 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986510+0000", 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986510+0000", 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986510+0000", 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.72e-07 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986511+0000", 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2389999999999999e-06 2024-09-14T08:40:12.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986516+0000", 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5220000000000001e-06 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986519+0000", 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7489999999999999e-06 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41194 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987204+0000", 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030401342000000001, 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031783856999999999, 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41194 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987204+0000", 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987204+0000", 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987204+0000", 2024-09-14T08:40:12.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2000000000000001e-07 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987205+0000", 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0950000000000001e-06 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987209+0000", 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9110000000000003e-06 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987212+0000", 2024-09-14T08:40:12.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.424e-06 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41261 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988481+0000", 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029123955, 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.03055472, 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41261 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988481+0000", 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988481+0000", 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988482+0000", 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7099999999999997e-07 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988484+0000", 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0109999999999999e-06 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988490+0000", 2024-09-14T08:40:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1850000000000001e-06 2024-09-14T08:40:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988495+0000", 2024-09-14T08:40:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5390000000000001e-06 2024-09-14T08:40:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41332 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.989707+0000", 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027898459, 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029377113, 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41332 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989707+0000", 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989707+0000", 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989707+0000", 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1200000000000003e-07 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989710+0000", 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.125e-06 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989716+0000", 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3799999999999999e-06 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989721+0000", 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9910000000000002e-06 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41383 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.992720+0000", 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.024885905999999999, 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.026395083999999999, 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41383 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992720+0000", 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992720+0000", 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992863+0000", 2024-09-14T08:40:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000143144 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992866+0000", 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0740000000000001e-06 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992874+0000", 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2819999999999996e-06 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992880+0000", 2024-09-14T08:40:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9710000000000001e-06 2024-09-14T08:40:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41415 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.995347+0000", 2024-09-14T08:40:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.022258196000000001, 2024-09-14T08:40:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023794259000000002, 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41415 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995347+0000", 2024-09-14T08:40:12.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995347+0000", 2024-09-14T08:40:12.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995378+0000", 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0414999999999999e-05 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995381+0000", 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1e-06 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995396+0000", 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4807000000000001e-05 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995402+0000", 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41512 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.998963+0000", 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018642055000000001, 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020204822000000001, 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.175 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41512 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998963+0000", 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998963+0000", 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998964+0000", 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9800000000000003e-07 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.998981+0000", 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6801000000000001e-05 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999003+0000", 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2116999999999998e-05 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999010+0000", 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7989999999999996e-06 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41548 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.002200+0000", 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.015405349, 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016993492999999998, 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41548 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.179 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002200+0000", 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002200+0000", 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002305+0000", 2024-09-14T08:40:12.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010516799999999999 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002309+0000", 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.873e-06 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002315+0000", 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.648e-06 2024-09-14T08:40:12.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002319+0000", 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9149999999999998e-06 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41593 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.005418+0000", 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012186917, 2024-09-14T08:40:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013801195, 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41593 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005418+0000", 2024-09-14T08:40:12.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005418+0000", 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005730+0000", 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00031162600000000001 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005735+0000", 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3170000000000001e-06 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005744+0000", 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5709999999999998e-06 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005751+0000", 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.64e-06 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41670 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.008822+0000", 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0087833000000000008, 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010421859, 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41670 2024-09-14T08:40:12.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008822+0000", 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008822+0000", 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008823+0000", 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0100000000000005e-07 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008826+0000", 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.608e-06 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008835+0000", 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1579999999999994e-06 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008842+0000", 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1859999999999997e-06 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41051 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986523+0000", 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.031082892000000001, 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032749718999999997, 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41051 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986523+0000", 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986523+0000", 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986523+0000", 2024-09-14T08:40:12.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2399999999999999e-07 2024-09-14T08:40:12.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986524+0000", 2024-09-14T08:40:12.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.054e-06 2024-09-14T08:40:12.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986527+0000", 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1259999999999998e-06 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986529+0000", 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4559999999999999e-06 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41195 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987216+0000", 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030389360000000001, 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032080800999999999, 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41195 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987216+0000", 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987216+0000", 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987216+0000", 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987217+0000", 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.043e-06 2024-09-14T08:40:12.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987221+0000", 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8990000000000003e-06 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987224+0000", 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4480000000000001e-06 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.196 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41263 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988523+0000", 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029082337999999999, 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030799602999999998, 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.198 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41263 2024-09-14T08:40:12.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.198 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988523+0000", 2024-09-14T08:40:12.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988523+0000", 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988523+0000", 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4200000000000002e-07 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988525+0000", 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.319e-06 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988530+0000", 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8940000000000001e-06 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988532+0000", 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.785e-06 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41334 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.989733+0000", 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027872872, 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029614306999999999, 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.201 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41334 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989733+0000", 2024-09-14T08:40:12.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989733+0000", 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989733+0000", 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:40:12.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989742+0000", 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7679999999999997e-06 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989746+0000", 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1999999999999996e-06 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989751+0000", 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9989999999999999e-06 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41514 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.999022+0000", 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018583476000000002, 2024-09-14T08:40:12.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020350697000000001, 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41514 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999022+0000", 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999022+0000", 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999023+0000", 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7199999999999999e-07 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999025+0000", 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6299999999999998e-06 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999032+0000", 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999037+0000", 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41595 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.005763+0000", 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011842315000000001, 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013633596, 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.209 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41595 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005763+0000", 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005763+0000", 2024-09-14T08:40:12.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005764+0000", 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005766+0000", 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0959999999999999e-06 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005772+0000", 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3099999999999997e-06 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005777+0000", 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.212 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41672 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.008869+0000", 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0087365930000000008, 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010553507, 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41672 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008869+0000", 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008869+0000", 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008869+0000", 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2900000000000004e-07 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008872+0000", 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4480000000000001e-06 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008878+0000", 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4269999999999996e-06 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008883+0000", 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.215 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41714 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.013011+0000", 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0045939759999999996, 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0064350500000000003, 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41714 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013011+0000", 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013011+0000", 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013012+0000", 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013014+0000", 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013020+0000", 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9699999999999996e-06 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013024+0000", 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3869999999999997e-06 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41053 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986550+0000", 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.031055306000000001, 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032923209000000002, 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.219 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41053 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986550+0000", 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986550+0000", 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986550+0000", 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7500000000000001e-07 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986552+0000", 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5099999999999999e-06 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986558+0000", 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5269999999999998e-06 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986560+0000", 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8399999999999999e-06 2024-09-14T08:40:12.222 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41197 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987227+0000", 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030378263999999999, 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032270726, 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.223 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41197 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987227+0000", 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987227+0000", 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987227+0000", 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.16e-07 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987228+0000", 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.048e-06 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987233+0000", 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987241+0000", 2024-09-14T08:40:12.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7419999999999997e-06 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41265 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988537+0000", 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029068757000000001, 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030986705, 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.227 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.228 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.228 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41265 2024-09-14T08:40:12.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.228 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988537+0000", 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988537+0000", 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988574+0000", 2024-09-14T08:40:12.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7052999999999999e-05 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988576+0000", 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4490000000000002e-06 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988583+0000", 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-14T08:40:12.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988587+0000", 2024-09-14T08:40:12.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7600000000000002e-06 2024-09-14T08:40:12.231 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.231 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.231 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.231 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41336 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.232 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.989758+0000", 2024-09-14T08:40:12.232 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027847661999999999, 2024-09-14T08:40:12.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029797673, 2024-09-14T08:40:12.232 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.232 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.232 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.232 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.232 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.232 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.232 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41336 2024-09-14T08:40:12.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.233 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989758+0000", 2024-09-14T08:40:12.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989758+0000", 2024-09-14T08:40:12.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989758+0000", 2024-09-14T08:40:12.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-14T08:40:12.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989760+0000", 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.187e-06 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989766+0000", 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989771+0000", 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7609999999999998e-06 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.235 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41385 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.992920+0000", 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.024685720000000001, 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.026660164, 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41385 2024-09-14T08:40:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992920+0000", 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992920+0000", 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993066+0000", 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014672700000000001 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993069+0000", 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993078+0000", 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5529999999999993e-06 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993085+0000", 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4900000000000003e-06 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41417 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.995563+0000", 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.022042570000000001, 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024043011999999999, 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.239 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41417 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995563+0000", 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995563+0000", 2024-09-14T08:40:12.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995563+0000", 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6100000000000001e-07 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995566+0000", 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7810000000000001e-06 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995572+0000", 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2650000000000002e-06 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995575+0000", 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9629999999999998e-06 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41516 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.999045+0000", 2024-09-14T08:40:12.242 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018560816000000001, 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020585429999999998, 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41516 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999045+0000", 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999045+0000", 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999045+0000", 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8400000000000005e-07 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999047+0000", 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2699999999999999e-06 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999055+0000", 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.216e-06 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999060+0000", 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.245 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41550 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.002349+0000", 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.015256865999999999, 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017307214000000001, 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41550 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002349+0000", 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002349+0000", 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002540+0000", 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000191325 2024-09-14T08:40:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002543+0000", 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5590000000000001e-06 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002551+0000", 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7470000000000005e-06 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002557+0000", 2024-09-14T08:40:12.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0279999999999997e-06 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41597 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.005783+0000", 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011822037000000001, 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013896477000000001, 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41597 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005783+0000", 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005783+0000", 2024-09-14T08:40:12.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005784+0000", 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6800000000000001e-07 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005786+0000", 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8509999999999999e-06 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005791+0000", 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7339999999999996e-06 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005796+0000", 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4479999999999996e-06 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41674 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.008891+0000", 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0087140280000000004, 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010815177, 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.253 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41674 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008891+0000", 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008891+0000", 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008892+0000", 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3300000000000002e-07 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008894+0000", 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0999999999999998e-06 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008900+0000", 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0129999999999999e-06 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008904+0000", 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4710000000000001e-06 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.256 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41055 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986588+0000", 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.031017276, 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033144092999999999, 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.257 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41055 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986588+0000", 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986588+0000", 2024-09-14T08:40:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986588+0000", 2024-09-14T08:40:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4999999999999999e-07 2024-09-14T08:40:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986590+0000", 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986594+0000", 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6e-06 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986597+0000", 2024-09-14T08:40:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7350000000000001e-06 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41199 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987282+0000", 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030323449999999998, 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032479447000000002, 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41199 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987282+0000", 2024-09-14T08:40:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987282+0000", 2024-09-14T08:40:12.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987282+0000", 2024-09-14T08:40:12.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6800000000000001e-07 2024-09-14T08:40:12.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987284+0000", 2024-09-14T08:40:12.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1009999999999999e-06 2024-09-14T08:40:12.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987291+0000", 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1090000000000003e-06 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987295+0000", 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5260000000000004e-06 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.266 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41267 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.266 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988595+0000", 2024-09-14T08:40:12.266 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029010266, 2024-09-14T08:40:12.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031213090999999998, 2024-09-14T08:40:12.266 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.266 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.266 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.266 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.266 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.266 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41267 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988595+0000", 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988595+0000", 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988596+0000", 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6899999999999998e-07 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988598+0000", 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0899999999999999e-06 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988602+0000", 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8670000000000002e-06 2024-09-14T08:40:12.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988606+0000", 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5540000000000002e-06 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41338 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.989778+0000", 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027827705000000001, 2024-09-14T08:40:12.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030078931, 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41338 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989778+0000", 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989778+0000", 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989805+0000", 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7064999999999999e-05 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989808+0000", 2024-09-14T08:40:12.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.881e-06 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989812+0000", 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.403e-06 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989815+0000", 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2959999999999999e-06 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.273 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41418 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.273 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.995589+0000", 2024-09-14T08:40:12.273 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.022016887999999998, 2024-09-14T08:40:12.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024296725000000002, 2024-09-14T08:40:12.273 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.273 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.273 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.273 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.273 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41418 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995589+0000", 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995589+0000", 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995958+0000", 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00036901600000000001 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995961+0000", 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.999e-06 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995967+0000", 2024-09-14T08:40:12.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1970000000000001e-06 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995971+0000", 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1760000000000003e-06 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41518 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.999067+0000", 2024-09-14T08:40:12.276 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018538217999999999, 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020903587000000001, 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41518 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999067+0000", 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999067+0000", 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999068+0000", 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3799999999999998e-07 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999070+0000", 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0549999999999998e-06 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999076+0000", 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7649999999999996e-06 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999083+0000", 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1550000000000004e-06 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.279 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41599 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.005802+0000", 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011803642, 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014217231, 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41599 2024-09-14T08:40:12.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005802+0000", 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005802+0000", 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005905+0000", 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103657 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005909+0000", 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.157e-06 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005917+0000", 2024-09-14T08:40:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5769999999999994e-06 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005923+0000", 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0939999999999996e-06 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41676 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.008911+0000", 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0086941280000000006, 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011159373, 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41676 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008911+0000", 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008911+0000", 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008912+0000", 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4400000000000001e-07 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008914+0000", 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.996e-06 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008920+0000", 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1179999999999997e-06 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008925+0000", 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9699999999999998e-06 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41716 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.013054+0000", 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.004550943, 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0070657280000000003, 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41716 2024-09-14T08:40:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013054+0000", 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013054+0000", 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013055+0000", 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013070+0000", 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4956999999999999e-05 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013077+0000", 2024-09-14T08:40:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0129999999999996e-06 2024-09-14T08:40:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013082+0000", 2024-09-14T08:40:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.485e-06 2024-09-14T08:40:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41140 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986601+0000", 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.031004568999999999, 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033571906999999998, 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41140 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986601+0000", 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986601+0000", 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986601+0000", 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2399999999999999e-07 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986602+0000", 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0950000000000001e-06 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986605+0000", 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0309999999999999e-06 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986608+0000", 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4260000000000002e-06 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41201 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987311+0000", 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030294219000000001, 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032914868999999999, 2024-09-14T08:40:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41201 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987311+0000", 2024-09-14T08:40:12.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987311+0000", 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987311+0000", 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4299999999999999e-07 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987313+0000", 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4079999999999999e-06 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987318+0000", 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7740000000000004e-06 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987320+0000", 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7310000000000002e-06 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41269 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988610+0000", 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028995323, 2024-09-14T08:40:12.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031664641, 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41269 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988610+0000", 2024-09-14T08:40:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988610+0000", 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988666+0000", 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6347000000000001e-05 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988668+0000", 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7570000000000001e-06 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988672+0000", 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2560000000000004e-06 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988678+0000", 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8510000000000004e-06 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.303 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41340 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.989821+0000", 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027784462999999999, 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030506444000000001, 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41340 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989821+0000", 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989821+0000", 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989873+0000", 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2293999999999998e-05 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989876+0000", 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5919999999999999e-06 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989883+0000", 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0330000000000003e-06 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989888+0000", 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6809999999999997e-06 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41387 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.993117+0000", 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.024487998, 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.027257446000000001, 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.307 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41387 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993117+0000", 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993117+0000", 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993243+0000", 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012563599999999999 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993255+0000", 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1629e-05 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993263+0000", 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9310000000000008e-06 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993272+0000", 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7510000000000003e-06 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41520 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.310 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.999090+0000", 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018515568, 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021341255, 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41520 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999090+0000", 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999090+0000", 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999179+0000", 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9580999999999995e-05 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999183+0000", 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5760000000000002e-06 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999204+0000", 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0809e-05 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999211+0000", 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7839999999999998e-06 2024-09-14T08:40:12.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41552 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.002597+0000", 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.015008240000000001, 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017886239000000002, 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41552 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002597+0000", 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002597+0000", 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002852+0000", 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025465200000000001 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002858+0000", 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6499999999999999e-06 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002864+0000", 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8440000000000003e-06 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002873+0000", 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5450000000000003e-06 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41601 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.005933+0000", 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011672078000000001, 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014602093, 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41601 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.318 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005933+0000", 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005933+0000", 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005934+0000", 2024-09-14T08:40:12.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2899999999999999e-07 2024-09-14T08:40:12.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005936+0000", 2024-09-14T08:40:12.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9379999999999999e-06 2024-09-14T08:40:12.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005942+0000", 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9970000000000004e-06 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.005946+0000", 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7230000000000004e-06 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41678 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.008931+0000", 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0086740819999999996, 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011652996000000001, 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.322 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41678 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008931+0000", 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.008931+0000", 2024-09-14T08:40:12.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010389+0000", 2024-09-14T08:40:12.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001457411 2024-09-14T08:40:12.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010393+0000", 2024-09-14T08:40:12.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6550000000000003e-06 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010403+0000", 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9639999999999998e-06 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010410+0000", 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7100000000000001e-06 2024-09-14T08:40:12.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41142 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986651+0000", 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030954061000000001, 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033993250000000003, 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41142 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986651+0000", 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986651+0000", 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986652+0000", 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.79e-07 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986653+0000", 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1659999999999999e-06 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986658+0000", 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8210000000000001e-06 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986660+0000", 2024-09-14T08:40:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.632e-06 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41203 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987348+0000", 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030257526, 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033338985000000002, 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.330 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41203 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987348+0000", 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987348+0000", 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987348+0000", 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3699999999999999e-07 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987352+0000", 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7270000000000001e-06 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987364+0000", 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2381000000000001e-05 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987367+0000", 2024-09-14T08:40:12.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8480000000000001e-06 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41270 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988686+0000", 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028919065000000001, 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032053051999999999, 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.334 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41270 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988686+0000", 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988686+0000", 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988687+0000", 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6399999999999998e-07 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988688+0000", 2024-09-14T08:40:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3170000000000001e-06 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988692+0000", 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1829999999999996e-06 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988701+0000", 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5939999999999994e-06 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41342 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.989893+0000", 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027712278, 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030897391999999999, 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41342 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989893+0000", 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989893+0000", 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989894+0000", 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8799999999999998e-07 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989895+0000", 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.206e-06 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989898+0000", 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-06 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989901+0000", 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5770000000000001e-06 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41420 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.995998+0000", 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.021607110999999998, 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024848582000000001, 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.341 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41420 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995998+0000", 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995998+0000", 2024-09-14T08:40:12.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995999+0000", 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6800000000000002e-07 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.996000+0000", 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.316e-06 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.996004+0000", 2024-09-14T08:40:12.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7780000000000001e-06 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.996007+0000", 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6490000000000001e-06 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41680 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.010422+0000", 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0071831450000000002, 2024-09-14T08:40:12.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010473965, 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41680 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010422+0000", 2024-09-14T08:40:12.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010422+0000", 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010423+0000", 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9900000000000001e-07 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010425+0000", 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010432+0000", 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3500000000000002e-06 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010437+0000", 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1270000000000002e-06 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41718 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.013137+0000", 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0044680839999999998, 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078161680000000001, 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.348 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41718 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013137+0000", 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013137+0000", 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013138+0000", 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3900000000000004e-07 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013140+0000", 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0480000000000001e-06 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013146+0000", 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3419999999999996e-06 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013151+0000", 2024-09-14T08:40:12.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8590000000000004e-06 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41144 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986664+0000", 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030941257, 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034345603000000002, 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.352 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41144 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986664+0000", 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986664+0000", 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986664+0000", 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1500000000000001e-07 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986665+0000", 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.108e-06 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986668+0000", 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.016e-06 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986671+0000", 2024-09-14T08:40:12.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.43e-06 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41206 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987371+0000", 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030234226999999999, 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033687931999999997, 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.356 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41206 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987371+0000", 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987371+0000", 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987371+0000", 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4999999999999999e-07 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987373+0000", 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6899999999999999e-06 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987386+0000", 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3124e-05 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987392+0000", 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8889999999999999e-06 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41273 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988730+0000", 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028875318000000001, 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032372172999999997, 2024-09-14T08:40:12.360 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41273 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988730+0000", 2024-09-14T08:40:12.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988730+0000", 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988731+0000", 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988733+0000", 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2539999999999999e-06 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988739+0000", 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1480000000000003e-06 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988744+0000", 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8509999999999998e-06 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41344 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.989904+0000", 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027701384999999999, 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031224437000000001, 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.364 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41344 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989904+0000", 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989904+0000", 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989966+0000", 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2113000000000007e-05 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989968+0000", 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.934e-06 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989973+0000", 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.203e-06 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989977+0000", 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3230000000000002e-06 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41389 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.993314+0000", 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.024291538000000001, 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.027850542999999998, 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41389 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993314+0000", 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.993314+0000", 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994340+0000", 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010264709999999999 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994345+0000", 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3590000000000001e-06 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994354+0000", 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9339999999999995e-06 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994360+0000", 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4200000000000004e-06 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41422 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.996011+0000", 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.021594093000000002, 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025203812999999999, 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41422 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.996011+0000", 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.996011+0000", 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.996012+0000", 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3300000000000001e-07 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.996013+0000", 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2529999999999999e-06 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.996016+0000", 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1779999999999999e-06 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.996019+0000", 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6110000000000001e-06 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.374 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41522 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.999269+0000", 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018336087000000001, 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021998561999999999, 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41522 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.375 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999269+0000", 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999269+0000", 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999536+0000", 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026709200000000002 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999541+0000", 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1350000000000002e-06 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999554+0000", 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3174e-05 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999561+0000", 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6539999999999999e-06 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.379 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41554 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.379 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.002911+0000", 2024-09-14T08:40:12.379 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.014694194000000001, 2024-09-14T08:40:12.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018414288000000001, 2024-09-14T08:40:12.379 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.379 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.379 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41554 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002911+0000", 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002911+0000", 2024-09-14T08:40:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002912+0000", 2024-09-14T08:40:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3200000000000005e-07 2024-09-14T08:40:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002914+0000", 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7039999999999999e-06 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002921+0000", 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2149999999999998e-06 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002925+0000", 2024-09-14T08:40:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6929999999999998e-06 2024-09-14T08:40:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41682 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.010444+0000", 2024-09-14T08:40:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0071612220000000001, 2024-09-14T08:40:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010932854000000001, 2024-09-14T08:40:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41682 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010444+0000", 2024-09-14T08:40:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010444+0000", 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010445+0000", 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1600000000000002e-07 2024-09-14T08:40:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010447+0000", 2024-09-14T08:40:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2230000000000001e-06 2024-09-14T08:40:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010453+0000", 2024-09-14T08:40:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.682e-06 2024-09-14T08:40:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010458+0000", 2024-09-14T08:40:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5829999999999997e-06 2024-09-14T08:40:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41147 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986683+0000", 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030922129999999999, 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034733332999999998, 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41147 2024-09-14T08:40:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986683+0000", 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986683+0000", 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986684+0000", 2024-09-14T08:40:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2500000000000001e-07 2024-09-14T08:40:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986685+0000", 2024-09-14T08:40:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.108e-06 2024-09-14T08:40:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986689+0000", 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3479999999999997e-06 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986692+0000", 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5450000000000002e-06 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41208 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987399+0000", 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030206235000000001, 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034044853999999999, 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41208 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987399+0000", 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987399+0000", 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987400+0000", 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7100000000000002e-07 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987402+0000", 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.091e-06 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987413+0000", 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1525999999999999e-05 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987418+0000", 2024-09-14T08:40:12.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9880000000000004e-06 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41275 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988785+0000", 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028820842999999999, 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032698774999999999, 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41275 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988785+0000", 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988785+0000", 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988785+0000", 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4699999999999998e-07 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988786+0000", 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4500000000000001e-06 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988794+0000", 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5639999999999999e-06 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988797+0000", 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8550000000000002e-06 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41346 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.989982+0000", 2024-09-14T08:40:12.398 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027623465999999999, 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031530441999999999, 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41346 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989982+0000", 2024-09-14T08:40:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.989982+0000", 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990143+0000", 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000161118 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990146+0000", 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2059999999999999e-06 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990159+0000", 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2286999999999999e-05 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990165+0000", 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4899999999999997e-06 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.401 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41684 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.010465+0000", 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.007140708, 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011071882999999999, 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41684 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010465+0000", 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010465+0000", 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010465+0000", 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6100000000000001e-07 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010467+0000", 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0640000000000001e-06 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010475+0000", 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3930000000000002e-06 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010480+0000", 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2769999999999996e-06 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41720 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.013180+0000", 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0044258259999999999, 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0084000800000000007, 2024-09-14T08:40:12.405 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41720 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013180+0000", 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013180+0000", 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013180+0000", 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0500000000000003e-07 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013182+0000", 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0559999999999999e-06 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013188+0000", 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0059999999999998e-06 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013193+0000", 2024-09-14T08:40:12.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.843e-06 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41150 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986702+0000", 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030903535999999999, 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034929267999999999, 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.410 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.410 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.410 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.410 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.410 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41150 2024-09-14T08:40:12.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.410 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986702+0000", 2024-09-14T08:40:12.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986702+0000", 2024-09-14T08:40:12.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986702+0000", 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.41e-07 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986703+0000", 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.209e-06 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986708+0000", 2024-09-14T08:40:12.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.425e-06 2024-09-14T08:40:12.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986710+0000", 2024-09-14T08:40:12.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.65e-06 2024-09-14T08:40:12.413 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.413 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.413 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41210 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987439+0000", 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030166844000000002, 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034246701999999997, 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.414 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41210 2024-09-14T08:40:12.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.415 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987439+0000", 2024-09-14T08:40:12.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987439+0000", 2024-09-14T08:40:12.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987439+0000", 2024-09-14T08:40:12.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5400000000000002e-07 2024-09-14T08:40:12.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987440+0000", 2024-09-14T08:40:12.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1960000000000001e-06 2024-09-14T08:40:12.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987448+0000", 2024-09-14T08:40:12.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2570000000000007e-06 2024-09-14T08:40:12.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987451+0000", 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8109999999999999e-06 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41277 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988801+0000", 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028804051000000001, 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032933130999999997, 2024-09-14T08:40:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41277 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988801+0000", 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988801+0000", 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988811+0000", 2024-09-14T08:40:12.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:12.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988813+0000", 2024-09-14T08:40:12.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0099999999999998e-06 2024-09-14T08:40:12.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988817+0000", 2024-09-14T08:40:12.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8380000000000001e-06 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988820+0000", 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9359999999999999e-06 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41348 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.990174+0000", 2024-09-14T08:40:12.422 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027431114999999999, 2024-09-14T08:40:12.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031598726000000001, 2024-09-14T08:40:12.423 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.423 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.423 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.423 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41348 2024-09-14T08:40:12.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.423 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990174+0000", 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990174+0000", 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990175+0000", 2024-09-14T08:40:12.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990177+0000", 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1900000000000002e-06 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990184+0000", 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4089999999999997e-06 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990191+0000", 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7619999999999998e-06 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41391 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.994395+0000", 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.023210462000000001, 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.027405613999999998, 2024-09-14T08:40:12.426 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41391 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994395+0000", 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994395+0000", 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994395+0000", 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.34e-07 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994398+0000", 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1280000000000002e-06 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994404+0000", 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4869999999999999e-06 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994409+0000", 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1050000000000003e-06 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41524 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.999600+0000", 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018005744000000001, 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.02222501, 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41524 2024-09-14T08:40:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999600+0000", 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999600+0000", 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999600+0000", 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9699999999999996e-07 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999602+0000", 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2409999999999998e-06 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999609+0000", 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7379999999999997e-06 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999614+0000", 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8799999999999999e-06 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41556 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.002979+0000", 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.014626581, 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018872676000000001, 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.433 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41556 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002979+0000", 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.002979+0000", 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003247+0000", 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026856599999999998 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003250+0000", 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7159999999999999e-06 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003256+0000", 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6239999999999999e-06 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003260+0000", 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2749999999999997e-06 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.436 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41686 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.010486+0000", 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0071190410000000004, 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011389477, 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41686 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010486+0000", 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010486+0000", 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010487+0000", 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:40:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010489+0000", 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0609999999999998e-06 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010496+0000", 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.010501+0000", 2024-09-14T08:40:12.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0629999999999996e-06 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41152 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986714+0000", 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030891049, 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035187214000000001, 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41152 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986714+0000", 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986714+0000", 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986715+0000", 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.28e-07 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986716+0000", 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7000000000000003e-07 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986719+0000", 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8999999999999999e-06 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986722+0000", 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5809999999999999e-06 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41212 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.443 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987455+0000", 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030150366000000001, 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034470724000000001, 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41212 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987455+0000", 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987455+0000", 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987464+0000", 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:40:12.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987467+0000", 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2809999999999998e-06 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987472+0000", 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987475+0000", 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7549999999999999e-06 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41350 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.990198+0000", 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027407427000000002, 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031766458999999997, 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41350 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990198+0000", 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990198+0000", 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990370+0000", 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017233600000000001 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990373+0000", 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9119999999999998e-06 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990379+0000", 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.383e-06 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990383+0000", 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0899999999999998e-06 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41688 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.450 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011136+0000", 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0064695229999999996, 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010876277, 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41688 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011136+0000", 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011136+0000", 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011137+0000", 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6899999999999996e-07 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011141+0000", 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0810000000000004e-06 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011154+0000", 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2948e-05 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011161+0000", 2024-09-14T08:40:12.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5610000000000001e-06 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41722 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.013219+0000", 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0043860779999999999, 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0088449949999999996, 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.454 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41722 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013219+0000", 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013219+0000", 2024-09-14T08:40:12.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013220+0000", 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5899999999999996e-07 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013222+0000", 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013228+0000", 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5860000000000004e-06 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013232+0000", 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9899999999999997e-06 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41153 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.457 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986725+0000", 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030880037999999999, 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035387689, 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41153 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986725+0000", 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986725+0000", 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986726+0000", 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2399999999999999e-07 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986727+0000", 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0049999999999999e-06 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986729+0000", 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8880000000000001e-06 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986732+0000", 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.294e-06 2024-09-14T08:40:12.460 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41214 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987491+0000", 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030114044999999999, 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034676609999999997, 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41214 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987491+0000", 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987491+0000", 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987533+0000", 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1786999999999998e-05 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987535+0000", 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.764e-06 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987539+0000", 2024-09-14T08:40:12.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3669999999999999e-06 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987542+0000", 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0800000000000002e-06 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41351 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.990390+0000", 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027215013999999999, 2024-09-14T08:40:12.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031817036999999999, 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41351 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990390+0000", 2024-09-14T08:40:12.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990390+0000", 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990446+0000", 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5902000000000001e-05 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990448+0000", 2024-09-14T08:40:12.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.793e-06 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990453+0000", 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6020000000000002e-06 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990456+0000", 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2949999999999998e-06 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41393 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.994438+0000", 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.023167674999999999, 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.027798426000000001, 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41393 2024-09-14T08:40:12.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994438+0000", 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994438+0000", 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994438+0000", 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7899999999999999e-07 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994440+0000", 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8759999999999999e-06 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994446+0000", 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4829999999999996e-06 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994451+0000", 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8330000000000001e-06 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41526 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.999643+0000", 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017961919999999999, 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022639889999999999, 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41526 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999643+0000", 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999643+0000", 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999870+0000", 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022658800000000001 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999874+0000", 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0130000000000004e-06 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999885+0000", 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0794e-05 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999892+0000", 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0679999999999999e-06 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.474 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41558 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.003301+0000", 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.014304427999999999, 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019023470000000001, 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41558 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003301+0000", 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003301+0000", 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003302+0000", 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4899999999999995e-07 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003304+0000", 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2869999999999999e-06 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003310+0000", 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2469999999999997e-06 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003317+0000", 2024-09-14T08:40:12.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0249999999999997e-06 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41689 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011175+0000", 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0064307690000000002, 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01120462, 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41689 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011175+0000", 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011175+0000", 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011175+0000", 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9400000000000005e-07 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011178+0000", 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.492e-06 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011185+0000", 2024-09-14T08:40:12.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.849e-06 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011190+0000", 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4260000000000002e-06 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41155 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986735+0000", 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030870272000000001, 2024-09-14T08:40:12.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035698757999999997, 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41155 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986735+0000", 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986735+0000", 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986735+0000", 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1799999999999999e-07 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986736+0000", 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986739+0000", 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8789999999999999e-06 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986742+0000", 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.357e-06 2024-09-14T08:40:12.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41216 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987549+0000", 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030056535999999998, 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034937054000000002, 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41216 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987549+0000", 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987549+0000", 2024-09-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987576+0000", 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7535e-05 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987579+0000", 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5670000000000002e-06 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987585+0000", 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2339999999999999e-06 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987591+0000", 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6799999999999998e-06 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41353 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.990462+0000", 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027143453000000001, 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032070764000000002, 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41353 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990462+0000", 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990462+0000", 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990613+0000", 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000150929 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990616+0000", 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990623+0000", 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8240000000000002e-06 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990630+0000", 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2080000000000003e-06 2024-09-14T08:40:12.491 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41691 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011198+0000", 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0064070380000000003, 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011379286000000001, 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.492 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41691 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011198+0000", 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011198+0000", 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011199+0000", 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.63e-07 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011207+0000", 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5580000000000001e-06 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011214+0000", 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9949999999999999e-06 2024-09-14T08:40:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011219+0000", 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0340000000000004e-06 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41724 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.013545+0000", 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0040601270000000002, 2024-09-14T08:40:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0090686159999999998, 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41724 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013545+0000", 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013545+0000", 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013546+0000", 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0399999999999996e-07 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013548+0000", 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5689999999999999e-06 2024-09-14T08:40:12.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013556+0000", 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.204e-06 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013562+0000", 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.178e-06 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41157 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986784+0000", 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030821214, 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035880615999999997, 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41157 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986784+0000", 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986784+0000", 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986784+0000", 2024-09-14T08:40:12.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4499999999999998e-07 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986786+0000", 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.102e-06 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986791+0000", 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2719999999999997e-06 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986793+0000", 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6259999999999999e-06 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41217 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987615+0000", 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029990131, 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035096446000000003, 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.502 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41217 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987615+0000", 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987615+0000", 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987616+0000", 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0499999999999999e-07 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987617+0000", 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6759999999999999e-06 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987622+0000", 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7559999999999999e-06 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987625+0000", 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8499999999999998e-06 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.505 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41355 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.990639+0000", 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.026966054999999999, 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032151299000000001, 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41355 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990639+0000", 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990639+0000", 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990668+0000", 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8656000000000001e-05 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990671+0000", 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8590000000000001e-06 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990678+0000", 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3030000000000002e-06 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990684+0000", 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.716e-06 2024-09-14T08:40:12.508 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41395 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.994481+0000", 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.023124419, 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.028363481999999999, 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.509 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41395 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994481+0000", 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994481+0000", 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994482+0000", 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9999999999999997e-07 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994484+0000", 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0619999999999999e-06 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994490+0000", 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0580000000000003e-06 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994495+0000", 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9180000000000002e-06 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41528 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.512 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.999940+0000", 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017665401000000001, 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022958433, 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41528 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999940+0000", 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999940+0000", 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999941+0000", 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2200000000000004e-07 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999950+0000", 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1160000000000005e-06 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999958+0000", 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2300000000000008e-06 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.999963+0000", 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5910000000000003e-06 2024-09-14T08:40:12.515 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41560 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.003520+0000", 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.014085141000000001, 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019427294000000001, 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.516 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41560 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003520+0000", 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003520+0000", 2024-09-14T08:40:12.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003521+0000", 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003522+0000", 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3319999999999999e-06 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003525+0000", 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5540000000000002e-06 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003528+0000", 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6070000000000002e-06 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41692 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011229+0000", 2024-09-14T08:40:12.519 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0063760070000000004, 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011773127, 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41692 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011229+0000", 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011229+0000", 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011230+0000", 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0999999999999999e-07 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011232+0000", 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.554e-06 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011239+0000", 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6599999999999998e-06 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011244+0000", 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6480000000000002e-06 2024-09-14T08:40:12.522 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41159 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986797+0000", 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030808077999999999, 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036241870000000002, 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.523 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41159 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986797+0000", 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986797+0000", 2024-09-14T08:40:12.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986798+0000", 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986801+0000", 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6260000000000001e-06 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986805+0000", 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579999999999998e-06 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986808+0000", 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.835e-06 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41220 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.526 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987629+0000", 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029976467999999999, 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035577867999999999, 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41220 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987629+0000", 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987629+0000", 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987636+0000", 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6810000000000001e-06 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987638+0000", 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1900000000000002e-06 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987643+0000", 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8609999999999997e-06 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987646+0000", 2024-09-14T08:40:12.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.909e-06 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41357 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.990693+0000", 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.026912743999999999, 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032563902999999998, 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41357 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990693+0000", 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990693+0000", 2024-09-14T08:40:12.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990831+0000", 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013846900000000001 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990840+0000", 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7360000000000007e-06 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990845+0000", 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1989999999999997e-06 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990849+0000", 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9519999999999996e-06 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41694 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011249+0000", 2024-09-14T08:40:12.533 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0063563350000000003, 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012058708, 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41694 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011249+0000", 2024-09-14T08:40:12.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011249+0000", 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011249+0000", 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.01e-07 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011251+0000", 2024-09-14T08:40:12.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.432e-06 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011254+0000", 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.529e-06 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011257+0000", 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41726 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.013603+0000", 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0040027780000000002, 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097492450000000001, 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41726 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013603+0000", 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013603+0000", 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013649+0000", 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6465000000000003e-05 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013652+0000", 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.393e-06 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013661+0000", 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5869999999999993e-06 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013668+0000", 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.494e-06 2024-09-14T08:40:12.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41161 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986856+0000", 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030749802, 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036527820000000003, 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41161 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986856+0000", 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986856+0000", 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986856+0000", 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2000000000000001e-07 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986857+0000", 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1510000000000001e-06 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986861+0000", 2024-09-14T08:40:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2910000000000001e-06 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986864+0000", 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6390000000000001e-06 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41222 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987652+0000", 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029953423999999999, 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035772843999999998, 2024-09-14T08:40:12.543 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41222 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987652+0000", 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987652+0000", 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987702+0000", 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9971e-05 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987704+0000", 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.934e-06 2024-09-14T08:40:12.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987709+0000", 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.147e-06 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987712+0000", 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0479999999999999e-06 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41359 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.990856+0000", 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.026748977, 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032605548999999998, 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41359 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990856+0000", 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990856+0000", 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990900+0000", 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3503e-05 2024-09-14T08:40:12.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990902+0000", 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9999999999999999e-06 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990907+0000", 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7500000000000003e-06 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990910+0000", 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4699999999999998e-06 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41397 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.994523+0000", 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.023082472999999999, 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.028967008999999998, 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.550 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41397 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994523+0000", 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994523+0000", 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994523+0000", 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994525+0000", 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9400000000000001e-06 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994531+0000", 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1800000000000001e-06 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994538+0000", 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1850000000000001e-06 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41530 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.000265+0000", 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017340438, 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023259754000000001, 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41530 2024-09-14T08:40:12.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000265+0000", 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000265+0000", 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000266+0000", 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1500000000000004e-07 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000269+0000", 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0319999999999999e-06 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000277+0000", 2024-09-14T08:40:12.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9789999999999993e-06 2024-09-14T08:40:12.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000282+0000", 2024-09-14T08:40:12.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8880000000000002e-06 2024-09-14T08:40:12.557 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.557 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.557 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41562 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.003872+0000", 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013733501, 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019701891999999999, 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.559 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41562 2024-09-14T08:40:12.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.559 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003872+0000", 2024-09-14T08:40:12.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003872+0000", 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003872+0000", 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8099999999999998e-07 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003874+0000", 2024-09-14T08:40:12.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7069999999999999e-06 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003878+0000", 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3120000000000004e-06 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003881+0000", 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1360000000000001e-06 2024-09-14T08:40:12.561 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41163 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986868+0000", 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.03073758, 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036754224000000002, 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.562 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41163 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986868+0000", 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986868+0000", 2024-09-14T08:40:12.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986868+0000", 2024-09-14T08:40:12.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:40:12.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986869+0000", 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0240000000000001e-06 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986872+0000", 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9660000000000001e-06 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986875+0000", 2024-09-14T08:40:12.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4880000000000001e-06 2024-09-14T08:40:12.566 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.566 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.566 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.566 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41224 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.566 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987718+0000", 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029887026000000001, 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035946596999999997, 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41224 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987718+0000", 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987718+0000", 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987752+0000", 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3337999999999998e-05 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987753+0000", 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5540000000000001e-06 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987761+0000", 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.763e-06 2024-09-14T08:40:12.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987766+0000", 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1109999999999999e-06 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41361 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.990916+0000", 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.026689560000000001, 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032774249999999998, 2024-09-14T08:40:12.570 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41361 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990916+0000", 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.990916+0000", 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991026+0000", 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011012 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991028+0000", 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8169999999999999e-06 2024-09-14T08:40:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991033+0000", 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2379999999999997e-06 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991036+0000", 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3519999999999998e-06 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41696 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011275+0000", 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0063308779999999999, 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012441928, 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41696 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011275+0000", 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011275+0000", 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011275+0000", 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6100000000000002e-07 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011277+0000", 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0849999999999999e-06 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011284+0000", 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2679999999999997e-06 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011289+0000", 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6770000000000003e-06 2024-09-14T08:40:12.576 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41728 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.013864+0000", 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.003741103, 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0098772349999999998, 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41728 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013864+0000", 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013864+0000", 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013865+0000", 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7599999999999997e-07 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013880+0000", 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4844000000000001e-05 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013887+0000", 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.013893+0000", 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8309999999999997e-06 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41165 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986889+0000", 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030716446000000001, 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036884825000000003, 2024-09-14T08:40:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41165 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986889+0000", 2024-09-14T08:40:12.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986889+0000", 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986889+0000", 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.84e-07 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986891+0000", 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.328e-06 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986899+0000", 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1000000000000004e-06 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986902+0000", 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4180000000000001e-06 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41226 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987777+0000", 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029828345999999999, 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036037404000000002, 2024-09-14T08:40:12.584 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41226 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987777+0000", 2024-09-14T08:40:12.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987777+0000", 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987823+0000", 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5445999999999998e-05 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987824+0000", 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8759999999999999e-06 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987832+0000", 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9209999999999992e-06 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987835+0000", 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.05e-06 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41363 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.991045+0000", 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.026560113999999999, 2024-09-14T08:40:12.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032796152000000002, 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41363 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991045+0000", 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991045+0000", 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991099+0000", 2024-09-14T08:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3940999999999997e-05 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991102+0000", 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991109+0000", 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8689999999999998e-06 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991115+0000", 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9689999999999999e-06 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41399 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.994567+0000", 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.023038047999999998, 2024-09-14T08:40:12.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029299108000000001, 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41399 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994567+0000", 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994567+0000", 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994568+0000", 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9400000000000001e-07 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994574+0000", 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8510000000000004e-06 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994578+0000", 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9249999999999997e-06 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994581+0000", 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.602e-06 2024-09-14T08:40:12.595 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41532 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.000413+0000", 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017192056000000001, 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023478843999999999, 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.596 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41532 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000413+0000", 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000413+0000", 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000596+0000", 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000182194 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000600+0000", 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.143e-06 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000610+0000", 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0217000000000001e-05 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000618+0000", 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4489999999999999e-06 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41564 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.003897+0000", 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013708616999999999, 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020020748000000001, 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.599 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41564 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003897+0000", 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003897+0000", 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003913+0000", 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6396999999999999e-05 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003921+0000", 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9300000000000003e-06 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003927+0000", 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4700000000000001e-06 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.003930+0000", 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2140000000000001e-06 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41167 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986907+0000", 2024-09-14T08:40:12.602 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030698475999999999, 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037041501999999997, 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41167 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986907+0000", 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986907+0000", 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986907+0000", 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4699999999999998e-07 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986908+0000", 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1710000000000001e-06 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986912+0000", 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1769999999999998e-06 2024-09-14T08:40:12.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986914+0000", 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4959999999999999e-06 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41228 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987841+0000", 2024-09-14T08:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029764273000000001, 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036147156, 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41228 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987841+0000", 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987841+0000", 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987861+0000", 2024-09-14T08:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9494e-05 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987873+0000", 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1975e-05 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987879+0000", 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.844e-06 2024-09-14T08:40:12.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987884+0000", 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0289999999999996e-06 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41365 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.610 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.991132+0000", 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.026473907000000001, 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032881404000000003, 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41365 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.611 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991132+0000", 2024-09-14T08:40:12.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991132+0000", 2024-09-14T08:40:12.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991253+0000", 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121574 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991256+0000", 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1109999999999999e-06 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991261+0000", 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0950000000000003e-06 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991265+0000", 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9029999999999997e-06 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41698 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011318+0000", 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0062877899999999997, 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012730013, 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.615 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41698 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011318+0000", 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011318+0000", 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011318+0000", 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.34e-07 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011320+0000", 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011326+0000", 2024-09-14T08:40:12.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:40:12.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011331+0000", 2024-09-14T08:40:12.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8080000000000004e-06 2024-09-14T08:40:12.618 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.618 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.618 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41730 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.014241+0000", 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0033642170000000001, 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0098312220000000006, 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41730 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014241+0000", 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014241+0000", 2024-09-14T08:40:12.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014242+0000", 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4099999999999997e-07 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014245+0000", 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4849999999999999e-06 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014252+0000", 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014257+0000", 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3800000000000002e-06 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41170 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986953+0000", 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030652815, 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037151638000000001, 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41170 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986953+0000", 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986953+0000", 2024-09-14T08:40:12.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986953+0000", 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1600000000000002e-07 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986954+0000", 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1659999999999999e-06 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986958+0000", 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.403e-06 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986961+0000", 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6089999999999999e-06 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41232 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.626 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987893+0000", 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029712270999999998, 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036246469000000003, 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41232 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987893+0000", 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987893+0000", 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987901+0000", 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4830000000000002e-06 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987903+0000", 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.289e-06 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987909+0000", 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1469999999999998e-06 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987913+0000", 2024-09-14T08:40:12.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2490000000000003e-06 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41367 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.991273+0000", 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.026332893, 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032894001999999999, 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41367 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991273+0000", 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991273+0000", 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991340+0000", 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7099000000000003e-05 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991341+0000", 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7600000000000001e-06 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991346+0000", 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7600000000000002e-06 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991350+0000", 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.394e-06 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41401 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.994596+0000", 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.023009466999999999, 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029594993999999999, 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.633 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41401 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994596+0000", 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994596+0000", 2024-09-14T08:40:12.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994596+0000", 2024-09-14T08:40:12.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2600000000000001e-07 2024-09-14T08:40:12.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994597+0000", 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.091e-06 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994600+0000", 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9519999999999999e-06 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994603+0000", 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4210000000000002e-06 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.636 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.637 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41534 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.637 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.000655+0000", 2024-09-14T08:40:12.637 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.016950554999999999, 2024-09-14T08:40:12.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023563229000000002, 2024-09-14T08:40:12.637 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.637 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.637 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41534 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000655+0000", 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000655+0000", 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000945+0000", 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00029029499999999998 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000955+0000", 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0166999999999999e-05 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000967+0000", 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1289e-05 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.000982+0000", 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5888000000000001e-05 2024-09-14T08:40:12.640 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.641 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.641 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.641 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41566 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.641 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.004185+0000", 2024-09-14T08:40:12.641 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013420629, 2024-09-14T08:40:12.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020059034999999999, 2024-09-14T08:40:12.641 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.641 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41566 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004185+0000", 2024-09-14T08:40:12.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004185+0000", 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004185+0000", 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2500000000000001e-07 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004187+0000", 2024-09-14T08:40:12.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.375e-06 2024-09-14T08:40:12.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004190+0000", 2024-09-14T08:40:12.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7450000000000001e-06 2024-09-14T08:40:12.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004193+0000", 2024-09-14T08:40:12.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:12.645 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.645 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.645 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.645 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41172 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.645 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986965+0000", 2024-09-14T08:40:12.646 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030640549999999999, 2024-09-14T08:40:12.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037310830000000003, 2024-09-14T08:40:12.646 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.646 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.646 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.646 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.646 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.646 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.646 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41172 2024-09-14T08:40:12.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986965+0000", 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986965+0000", 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986965+0000", 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2600000000000001e-07 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986966+0000", 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.085e-06 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986969+0000", 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986972+0000", 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6589999999999999e-06 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41234 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987931+0000", 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029674300000000001, 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036383032000000003, 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.650 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41234 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987931+0000", 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987931+0000", 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987984+0000", 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2604e-05 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987986+0000", 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.041e-06 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987992+0000", 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3230000000000003e-06 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988006+0000", 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3509000000000001e-05 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41369 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.991355+0000", 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.026250144, 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032987068000000001, 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.653 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41369 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991355+0000", 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991355+0000", 2024-09-14T08:40:12.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991498+0000", 2024-09-14T08:40:12.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000142659 2024-09-14T08:40:12.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991501+0000", 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7650000000000002e-06 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991508+0000", 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6229999999999997e-06 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991514+0000", 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9660000000000001e-06 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41700 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011399+0000", 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0062063129999999998, 2024-09-14T08:40:12.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012967452000000001, 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41700 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011399+0000", 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011399+0000", 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011400+0000", 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011403+0000", 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8389999999999998e-06 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011411+0000", 2024-09-14T08:40:12.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011417+0000", 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9179999999999999e-06 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41732 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.661 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.014287+0000", 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0033181450000000002, 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010108279, 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41732 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.662 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014287+0000", 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014287+0000", 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014288+0000", 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014290+0000", 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0420000000000001e-06 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014296+0000", 2024-09-14T08:40:12.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5479999999999998e-06 2024-09-14T08:40:12.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014302+0000", 2024-09-14T08:40:12.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8250000000000001e-06 2024-09-14T08:40:12.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.665 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.666 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41175 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.666 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986975+0000", 2024-09-14T08:40:12.666 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030630323000000001, 2024-09-14T08:40:12.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037450837000000001, 2024-09-14T08:40:12.666 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.666 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.666 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.667 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41175 2024-09-14T08:40:12.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.667 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986975+0000", 2024-09-14T08:40:12.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986975+0000", 2024-09-14T08:40:12.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986975+0000", 2024-09-14T08:40:12.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2100000000000001e-07 2024-09-14T08:40:12.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986976+0000", 2024-09-14T08:40:12.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.037e-06 2024-09-14T08:40:12.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986980+0000", 2024-09-14T08:40:12.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8399999999999997e-06 2024-09-14T08:40:12.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986983+0000", 2024-09-14T08:40:12.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9909999999999998e-06 2024-09-14T08:40:12.670 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.671 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.671 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41235 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.671 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988018+0000", 2024-09-14T08:40:12.671 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029587341, 2024-09-14T08:40:12.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036443660000000003, 2024-09-14T08:40:12.672 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.672 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.672 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.672 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.672 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.672 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.672 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41235 2024-09-14T08:40:12.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.673 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988018+0000", 2024-09-14T08:40:12.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988018+0000", 2024-09-14T08:40:12.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988019+0000", 2024-09-14T08:40:12.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7000000000000005e-07 2024-09-14T08:40:12.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988021+0000", 2024-09-14T08:40:12.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.108e-06 2024-09-14T08:40:12.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988027+0000", 2024-09-14T08:40:12.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.071e-06 2024-09-14T08:40:12.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988032+0000", 2024-09-14T08:40:12.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2530000000000004e-06 2024-09-14T08:40:12.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.677 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.677 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.677 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41371 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.677 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.991524+0000", 2024-09-14T08:40:12.677 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.026081533, 2024-09-14T08:40:12.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032966071, 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41371 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991524+0000", 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991524+0000", 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991551+0000", 2024-09-14T08:40:12.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7384000000000001e-05 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991554+0000", 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.864e-06 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991561+0000", 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8279999999999997e-06 2024-09-14T08:40:12.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991567+0000", 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8730000000000004e-06 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41403 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.681 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.994617+0000", 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.022988492999999999, 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029908324, 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41403 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994617+0000", 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994617+0000", 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994617+0000", 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1e-07 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994618+0000", 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1459999999999999e-06 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994621+0000", 2024-09-14T08:40:12.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.909e-06 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994624+0000", 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4679999999999999e-06 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.685 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41536 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.001022+0000", 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.016583463, 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023530491000000001, 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41536 2024-09-14T08:40:12.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001022+0000", 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001022+0000", 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001022+0000", 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3600000000000004e-07 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001025+0000", 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0760000000000001e-06 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001031+0000", 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480000000000004e-06 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001035+0000", 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8840000000000002e-06 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41568 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.004217+0000", 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013388163, 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020360599, 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41568 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004217+0000", 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004217+0000", 2024-09-14T08:40:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004338+0000", 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012078699999999999 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004341+0000", 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9840000000000001e-06 2024-09-14T08:40:12.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004348+0000", 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.878e-06 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004355+0000", 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.221e-06 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.693 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.694 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.694 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41178 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.694 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.986987+0000", 2024-09-14T08:40:12.694 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030618902999999999, 2024-09-14T08:40:12.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037624468000000001, 2024-09-14T08:40:12.694 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.694 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.694 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.695 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41178 2024-09-14T08:40:12.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.695 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986987+0000", 2024-09-14T08:40:12.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986987+0000", 2024-09-14T08:40:12.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986987+0000", 2024-09-14T08:40:12.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1799999999999999e-07 2024-09-14T08:40:12.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986988+0000", 2024-09-14T08:40:12.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1689999999999999e-06 2024-09-14T08:40:12.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986993+0000", 2024-09-14T08:40:12.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9089999999999999e-06 2024-09-14T08:40:12.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.986995+0000", 2024-09-14T08:40:12.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5189999999999999e-06 2024-09-14T08:40:12.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.699 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.699 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41237 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.699 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988039+0000", 2024-09-14T08:40:12.699 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029566140000000001, 2024-09-14T08:40:12.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036612054999999998, 2024-09-14T08:40:12.700 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.700 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.700 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.700 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41237 2024-09-14T08:40:12.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.701 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988039+0000", 2024-09-14T08:40:12.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988039+0000", 2024-09-14T08:40:12.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988040+0000", 2024-09-14T08:40:12.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3700000000000001e-07 2024-09-14T08:40:12.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988041+0000", 2024-09-14T08:40:12.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8390000000000001e-06 2024-09-14T08:40:12.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988049+0000", 2024-09-14T08:40:12.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:40:12.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988053+0000", 2024-09-14T08:40:12.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2649999999999998e-06 2024-09-14T08:40:12.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.704 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.705 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41372 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.705 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.991577+0000", 2024-09-14T08:40:12.705 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.026028025, 2024-09-14T08:40:12.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033100946999999999, 2024-09-14T08:40:12.705 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.706 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.706 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.706 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41372 2024-09-14T08:40:12.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.706 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991577+0000", 2024-09-14T08:40:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991577+0000", 2024-09-14T08:40:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991708+0000", 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013107099999999999 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991712+0000", 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1099999999999999e-06 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991720+0000", 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8869999999999998e-06 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991728+0000", 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9969999999999998e-06 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41570 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.004364+0000", 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013240919, 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020338908999999999, 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.710 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41570 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004364+0000", 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004364+0000", 2024-09-14T08:40:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004520+0000", 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000155515 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004523+0000", 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:40:12.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004529+0000", 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.438e-06 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004536+0000", 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.241e-06 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41702 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011450+0000", 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0061553099999999998, 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013279114, 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.714 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41702 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011450+0000", 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011450+0000", 2024-09-14T08:40:12.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011451+0000", 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2800000000000002e-07 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011453+0000", 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0600000000000002e-06 2024-09-14T08:40:12.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011459+0000", 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6229999999999999e-06 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011464+0000", 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7269999999999998e-06 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41734 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.014374+0000", 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.003231505, 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010379744999999999, 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41734 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014374+0000", 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014374+0000", 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014374+0000", 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.06e-07 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014377+0000", 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3989999999999998e-06 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014383+0000", 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3820000000000001e-06 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.014388+0000", 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-14T08:40:12.721 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41181 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987019+0000", 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030585998, 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037765601000000003, 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.722 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41181 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987019+0000", 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987019+0000", 2024-09-14T08:40:12.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987020+0000", 2024-09-14T08:40:12.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8099999999999999e-07 2024-09-14T08:40:12.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987021+0000", 2024-09-14T08:40:12.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.17e-06 2024-09-14T08:40:12.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987024+0000", 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3900000000000002e-06 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987027+0000", 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4549999999999998e-06 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.727 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41239 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.727 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988060+0000", 2024-09-14T08:40:12.727 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029545472, 2024-09-14T08:40:12.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036760451, 2024-09-14T08:40:12.727 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.727 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.727 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.728 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.728 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41239 2024-09-14T08:40:12.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.728 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988060+0000", 2024-09-14T08:40:12.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988060+0000", 2024-09-14T08:40:12.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988060+0000", 2024-09-14T08:40:12.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5800000000000001e-07 2024-09-14T08:40:12.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988061+0000", 2024-09-14T08:40:12.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.296e-06 2024-09-14T08:40:12.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988066+0000", 2024-09-14T08:40:12.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4889999999999997e-06 2024-09-14T08:40:12.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988073+0000", 2024-09-14T08:40:12.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7399999999999998e-06 2024-09-14T08:40:12.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.731 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.732 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41405 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.732 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.994640+0000", 2024-09-14T08:40:12.732 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.022965692999999999, 2024-09-14T08:40:12.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030209249000000001, 2024-09-14T08:40:12.732 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.732 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.733 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.733 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.733 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.733 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.733 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41405 2024-09-14T08:40:12.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.733 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994640+0000", 2024-09-14T08:40:12.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994640+0000", 2024-09-14T08:40:12.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994640+0000", 2024-09-14T08:40:12.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:40:12.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994641+0000", 2024-09-14T08:40:12.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.08e-06 2024-09-14T08:40:12.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994644+0000", 2024-09-14T08:40:12.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0010000000000002e-06 2024-09-14T08:40:12.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994647+0000", 2024-09-14T08:40:12.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5289999999999998e-06 2024-09-14T08:40:12.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.737 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.738 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41538 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.738 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.001075+0000", 2024-09-14T08:40:12.738 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.016530784, 2024-09-14T08:40:12.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023798524000000001, 2024-09-14T08:40:12.738 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.738 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.738 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.739 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.739 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41538 2024-09-14T08:40:12.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.739 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001075+0000", 2024-09-14T08:40:12.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001075+0000", 2024-09-14T08:40:12.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001356+0000", 2024-09-14T08:40:12.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000281451 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001360+0000", 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8530000000000002e-06 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001375+0000", 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5569e-05 2024-09-14T08:40:12.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001382+0000", 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4529999999999999e-06 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41572 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.742 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.004544+0000", 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013061323999999999, 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020357475, 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41572 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004544+0000", 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004544+0000", 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004544+0000", 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3299999999999998e-07 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004546+0000", 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.409e-06 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004549+0000", 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4750000000000002e-06 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004552+0000", 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8030000000000001e-06 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.746 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41184 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987043+0000", 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030562728000000001, 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037890015999999999, 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41184 2024-09-14T08:40:12.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987043+0000", 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987043+0000", 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987043+0000", 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9799999999999999e-07 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987044+0000", 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.232e-06 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987049+0000", 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3409999999999996e-06 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987051+0000", 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9349999999999999e-06 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.750 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41241 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988077+0000", 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029528569000000001, 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036890695000000001, 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41241 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.751 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988077+0000", 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988077+0000", 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988104+0000", 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7633000000000001e-05 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988107+0000", 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4059999999999999e-06 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988113+0000", 2024-09-14T08:40:12.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9730000000000002e-06 2024-09-14T08:40:12.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988118+0000", 2024-09-14T08:40:12.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.758e-06 2024-09-14T08:40:12.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.754 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.755 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41374 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.755 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.991829+0000", 2024-09-14T08:40:12.755 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.025776034999999999, 2024-09-14T08:40:12.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033165832999999999, 2024-09-14T08:40:12.755 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.755 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.756 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.756 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41374 2024-09-14T08:40:12.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.756 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991829+0000", 2024-09-14T08:40:12.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991829+0000", 2024-09-14T08:40:12.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991970+0000", 2024-09-14T08:40:12.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000140994 2024-09-14T08:40:12.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991975+0000", 2024-09-14T08:40:12.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6299999999999997e-06 2024-09-14T08:40:12.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991986+0000", 2024-09-14T08:40:12.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1049e-05 2024-09-14T08:40:12.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.991993+0000", 2024-09-14T08:40:12.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3989999999999998e-06 2024-09-14T08:40:12.760 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.760 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.760 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.760 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41574 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.760 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.004556+0000", 2024-09-14T08:40:12.761 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.013049503, 2024-09-14T08:40:12.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020463885000000001, 2024-09-14T08:40:12.761 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.761 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.761 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.761 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.761 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.761 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.761 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41574 2024-09-14T08:40:12.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.762 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004556+0000", 2024-09-14T08:40:12.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004556+0000", 2024-09-14T08:40:12.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004839+0000", 2024-09-14T08:40:12.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00028308599999999999 2024-09-14T08:40:12.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004842+0000", 2024-09-14T08:40:12.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7779999999999999e-06 2024-09-14T08:40:12.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004850+0000", 2024-09-14T08:40:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0409999999999998e-06 2024-09-14T08:40:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004854+0000", 2024-09-14T08:40:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0929999999999996e-06 2024-09-14T08:40:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41704 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011491+0000", 2024-09-14T08:40:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0061140020000000003, 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013554101000000001, 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41704 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011491+0000", 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011491+0000", 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011492+0000", 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.99e-07 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011501+0000", 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1749999999999994e-06 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011508+0000", 2024-09-14T08:40:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7139999999999996e-06 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011513+0000", 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0810000000000001e-06 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.770 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41736 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.018482+0000", 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9991241, 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0065904750000000002, 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41736 2024-09-14T08:40:12.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.772 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018482+0000", 2024-09-14T08:40:12.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018482+0000", 2024-09-14T08:40:12.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018482+0000", 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5700000000000002e-07 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018485+0000", 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5830000000000001e-06 2024-09-14T08:40:12.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018492+0000", 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1169999999999998e-06 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018497+0000", 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5809999999999996e-06 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.774 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41186 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987060+0000", 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030544994999999998, 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038043209000000001, 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.775 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41186 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987060+0000", 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987060+0000", 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987061+0000", 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4400000000000001e-07 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987062+0000", 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.161e-06 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987068+0000", 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6209999999999998e-06 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987072+0000", 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0750000000000002e-06 2024-09-14T08:40:12.778 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41243 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988155+0000", 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029450206, 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036986290999999998, 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.779 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41243 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988155+0000", 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988155+0000", 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988155+0000", 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.41e-07 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988157+0000", 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3510000000000001e-06 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988166+0000", 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9109999999999999e-06 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988170+0000", 2024-09-14T08:40:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0579999999999999e-06 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41407 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.994660+0000", 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.022945632000000001, 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030511424999999998, 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41407 2024-09-14T08:40:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994660+0000", 2024-09-14T08:40:12.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.994660+0000", 2024-09-14T08:40:12.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995099+0000", 2024-09-14T08:40:12.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00043898800000000002 2024-09-14T08:40:12.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995103+0000", 2024-09-14T08:40:12.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.765e-06 2024-09-14T08:40:12.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995111+0000", 2024-09-14T08:40:12.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1149999999999994e-06 2024-09-14T08:40:12.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995117+0000", 2024-09-14T08:40:12.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2750000000000001e-06 2024-09-14T08:40:12.788 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.788 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.788 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.788 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41540 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.788 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.001414+0000", 2024-09-14T08:40:12.788 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.016191434000000001, 2024-09-14T08:40:12.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023781999000000002, 2024-09-14T08:40:12.788 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.789 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.789 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.789 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.789 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.789 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.789 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41540 2024-09-14T08:40:12.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.789 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001414+0000", 2024-09-14T08:40:12.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001414+0000", 2024-09-14T08:40:12.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001414+0000", 2024-09-14T08:40:12.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.63e-07 2024-09-14T08:40:12.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001422+0000", 2024-09-14T08:40:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3429999999999998e-06 2024-09-14T08:40:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001430+0000", 2024-09-14T08:40:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0090000000000007e-06 2024-09-14T08:40:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001435+0000", 2024-09-14T08:40:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0479999999999998e-06 2024-09-14T08:40:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41576 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.004874+0000", 2024-09-14T08:40:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012731513999999999, 2024-09-14T08:40:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020348071999999998, 2024-09-14T08:40:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41576 2024-09-14T08:40:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004874+0000", 2024-09-14T08:40:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004874+0000", 2024-09-14T08:40:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004874+0000", 2024-09-14T08:40:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6100000000000001e-07 2024-09-14T08:40:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004876+0000", 2024-09-14T08:40:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6169999999999999e-06 2024-09-14T08:40:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004880+0000", 2024-09-14T08:40:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9339999999999999e-06 2024-09-14T08:40:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004883+0000", 2024-09-14T08:40:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.836e-06 2024-09-14T08:40:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41187 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987075+0000", 2024-09-14T08:40:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030530155999999999, 2024-09-14T08:40:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038177146000000002, 2024-09-14T08:40:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41187 2024-09-14T08:40:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987075+0000", 2024-09-14T08:40:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987075+0000", 2024-09-14T08:40:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987075+0000", 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2499999999999999e-07 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987079+0000", 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8240000000000001e-06 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987083+0000", 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1849999999999997e-06 2024-09-14T08:40:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987086+0000", 2024-09-14T08:40:12.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7879999999999998e-06 2024-09-14T08:40:12.803 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.803 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.803 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.803 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41245 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.804 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988176+0000", 2024-09-14T08:40:12.804 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029429364, 2024-09-14T08:40:12.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037115781, 2024-09-14T08:40:12.804 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.804 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.804 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.804 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.804 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.804 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.804 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41245 2024-09-14T08:40:12.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.805 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988176+0000", 2024-09-14T08:40:12.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988176+0000", 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988177+0000", 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7000000000000005e-07 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988178+0000", 2024-09-14T08:40:12.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.835e-06 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988183+0000", 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5839999999999996e-06 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988186+0000", 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.83e-06 2024-09-14T08:40:12.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41376 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.992047+0000", 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.025558506000000002, 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033270280999999999, 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.808 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41376 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992047+0000", 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992047+0000", 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992132+0000", 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4596000000000001e-05 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992135+0000", 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7639999999999999e-06 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992146+0000", 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0859000000000001e-05 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.992153+0000", 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6409999999999996e-06 2024-09-14T08:40:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41578 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.004887+0000", 2024-09-14T08:40:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.012718185, 2024-09-14T08:40:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020476154, 2024-09-14T08:40:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41578 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004887+0000", 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004887+0000", 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004887+0000", 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6e-07 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004889+0000", 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1009999999999999e-06 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004892+0000", 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0410000000000002e-06 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004894+0000", 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5270000000000001e-06 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41706 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.011543+0000", 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0060629020000000002, 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013861943999999999, 2024-09-14T08:40:12.816 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41706 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011543+0000", 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011543+0000", 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011543+0000", 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:40:12.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011545+0000", 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011551+0000", 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.879e-06 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.011555+0000", 2024-09-14T08:40:12.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.335e-06 2024-09-14T08:40:12.820 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.820 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.820 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.820 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41738 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.821 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.018533+0000", 2024-09-14T08:40:12.821 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9990726, 2024-09-14T08:40:12.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0069176439999999997, 2024-09-14T08:40:12.821 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.821 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.821 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.821 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.821 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.821 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.821 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41738 2024-09-14T08:40:12.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.822 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018533+0000", 2024-09-14T08:40:12.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018533+0000", 2024-09-14T08:40:12.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018534+0000", 2024-09-14T08:40:12.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2e-07 2024-09-14T08:40:12.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018536+0000", 2024-09-14T08:40:12.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.402e-06 2024-09-14T08:40:12.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018543+0000", 2024-09-14T08:40:12.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7939999999999997e-06 2024-09-14T08:40:12.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.018548+0000", 2024-09-14T08:40:12.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:12.825 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.825 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.825 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.825 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41188 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.826 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.987090+0000", 2024-09-14T08:40:12.826 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.030515525000000002, 2024-09-14T08:40:12.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038404466999999998, 2024-09-14T08:40:12.826 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.826 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.826 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.827 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41188 2024-09-14T08:40:12.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.827 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987090+0000", 2024-09-14T08:40:12.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987090+0000", 2024-09-14T08:40:12.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987090+0000", 2024-09-14T08:40:12.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3300000000000001e-07 2024-09-14T08:40:12.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987091+0000", 2024-09-14T08:40:12.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.141e-06 2024-09-14T08:40:12.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987099+0000", 2024-09-14T08:40:12.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2450000000000001e-06 2024-09-14T08:40:12.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.987101+0000", 2024-09-14T08:40:12.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.909e-06 2024-09-14T08:40:12.830 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.830 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.831 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.831 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41247 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.831 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.988205+0000", 2024-09-14T08:40:12.831 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.029400056000000001, 2024-09-14T08:40:12.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037328658000000001, 2024-09-14T08:40:12.831 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.831 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.832 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.832 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.832 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.832 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.832 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41247 2024-09-14T08:40:12.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.832 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988205+0000", 2024-09-14T08:40:12.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988205+0000", 2024-09-14T08:40:12.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988234+0000", 2024-09-14T08:40:12.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8371999999999999e-05 2024-09-14T08:40:12.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988236+0000", 2024-09-14T08:40:12.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.43e-06 2024-09-14T08:40:12.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988248+0000", 2024-09-14T08:40:12.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1348e-05 2024-09-14T08:40:12.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.988253+0000", 2024-09-14T08:40:12.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2100000000000001e-06 2024-09-14T08:40:12.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.836 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41409 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:11.995148+0000", 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.022457339999999999, 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030432727999999999, 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.837 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41409 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995148+0000", 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995148+0000", 2024-09-14T08:40:12.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995148+0000", 2024-09-14T08:40:12.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2300000000000002e-07 2024-09-14T08:40:12.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995150+0000", 2024-09-14T08:40:12.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995156+0000", 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0270000000000001e-06 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:11.995161+0000", 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5689999999999998e-06 2024-09-14T08:40:12.840 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41542 3.6 3.8223ad06 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.001516+0000", 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.016089895999999999, 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024110432000000001, 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.841 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41542 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001516+0000", 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001516+0000", 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001544+0000", 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8220000000000001e-05 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001546+0000", 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2869999999999999e-06 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001557+0000", 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1e-05 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.001561+0000", 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6160000000000002e-06 2024-09-14T08:40:12.844 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:41580 3.6 3.453655c6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e53)", 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:12.004898+0000", 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.01270775, 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020756699, 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:12.845 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 41580 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004898+0000", 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004898+0000", 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004898+0000", 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4299999999999999e-07 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004899+0000", 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.063e-06 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004902+0000", 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0769999999999999e-06 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:12.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:12.004904+0000", 2024-09-14T08:40:12.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3709999999999998e-06 2024-09-14T08:40:12.849 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.849 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:12.849 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.849 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:12.849 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:12.849 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 212 2024-09-14T08:40:12.849 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:12.851 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:12.851 INFO:teuthology.orchestra.run.smithi188.stdout:706 read 0xb322400 thru 0xb331131 (0xed32 bytes) 2024-09-14T08:40:12.851 INFO:teuthology.orchestra.run.smithi188.stdout:707 read 0x1da2000 thru 0x1da88ca (0x68cb bytes) 2024-09-14T08:40:12.852 INFO:teuthology.orchestra.run.smithi188.stdout:709 trunc from 0xc717600 to 0x8d83800 2024-09-14T08:40:12.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:12.853 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:12.854 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:12.854 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:12.854 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:12.855 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:12.855 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:12.855 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:12.856 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:12.856 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:12.855+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:12.857 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:12.857 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:12.858 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:12.858 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:12.945 INFO:teuthology.orchestra.run.smithi188.stdout:710 trunc from 0x8d83800 to 0x2572600 2024-09-14T08:40:12.951 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:12.952+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:13.047 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:13.047 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:13.052 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:13.052+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:13.067 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:13.153 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:13.155+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:13.254 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:13.255+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:13.283 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:13.283 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:13.301 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:13.400 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:13.399+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:13.456 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:13.459+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:13.520 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:13.520 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:13.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:13.582 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:13.583+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:13.657 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:13.659+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:13.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:40:13.741 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:13.741 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:13.758 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:13.759+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:13.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:13.858 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:13.863+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:13.920 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:13.921 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:13.940 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:13.986 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:13.991+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:14.061 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:14.063+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:14.079 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:14.079 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:14.093 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:14.161 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:14.163+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:14.262 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:14.267+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:14.289 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:14.290 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:14.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:14.394 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:14.399+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:14.464 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:14.467+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:14.500 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:14.500 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:14.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:14.607 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:14.611+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:14.665 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:14.667+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:14.666 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:40:14.666 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:40:14.666 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T08:40:14.666 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.135640 2024-09-14T08:40:14.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0.13564005537364654 2024-09-14T08:40:14.677 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:14.678 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:14.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:14.693 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:40:14.707 INFO:teuthology.orchestra.run.smithi188.stdout:711 read 0x20d1c00 thru 0x20d6ab5 (0x4eb6 bytes) 2024-09-14T08:40:14.711 INFO:teuthology.orchestra.run.smithi188.stdout:714 read 0x996200 thru 0x998229 (0x202a bytes) 2024-09-14T08:40:14.749 INFO:teuthology.orchestra.run.smithi188.stdout:715 write 0x9b23200 thru 0x9b27f97 (0x4d98 bytes) 2024-09-14T08:40:14.750 INFO:teuthology.orchestra.run.smithi188.stdout:718 punch from 0x7808800 to 0x780fe00, (0x7600 bytes) 2024-09-14T08:40:14.757 INFO:teuthology.orchestra.run.smithi188.stdout:719 trunc from 0x9b28000 to 0x61f0600 2024-09-14T08:40:14.783 INFO:teuthology.orchestra.run.smithi188.stdout:722 read 0x3c3ca00 thru 0x3c4bdef (0xf3f0 bytes) 2024-09-14T08:40:14.783 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:14.787+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:14.786 INFO:teuthology.orchestra.run.smithi188.stdout:727 read 0x4a3ce00 thru 0x4a47f22 (0xb123 bytes) 2024-09-14T08:40:14.789 INFO:teuthology.orchestra.run.smithi188.stdout:728 read 0x4982c00 thru 0x4991b99 (0xef9a bytes) 2024-09-14T08:40:14.803 INFO:teuthology.orchestra.run.smithi188.stdout:729 write 0x6648e00 thru 0x6655061 (0xc262 bytes) 2024-09-14T08:40:14.804 INFO:teuthology.orchestra.run.smithi188.stdout:731 read 0x1854200 thru 0x1854f46 (0xd47 bytes) 2024-09-14T08:40:14.839 INFO:teuthology.orchestra.run.smithi188.stdout:736 write 0xcaf5c00 thru 0xcaf79ec (0x1ded bytes) 2024-09-14T08:40:14.840 INFO:teuthology.orchestra.run.smithi188.stdout:737 read 0xab77e00 thru 0xab84079 (0xc27a bytes) 2024-09-14T08:40:14.840 INFO:teuthology.orchestra.run.smithi188.stdout:738 read 0x6fd1200 thru 0x6fde8b8 (0xd6b9 bytes) 2024-09-14T08:40:14.841 INFO:teuthology.orchestra.run.smithi188.stdout:741 read 0x4cfe800 thru 0x4d01043 (0x2844 bytes) 2024-09-14T08:40:14.841 INFO:teuthology.orchestra.run.smithi188.stdout:747 write 0xc019800 thru 0xc01a1dc (0x9dd bytes) 2024-09-14T08:40:14.841 INFO:teuthology.orchestra.run.smithi188.stdout:748 read 0x858200 thru 0x85a04f (0x1e50 bytes) 2024-09-14T08:40:14.843 INFO:teuthology.orchestra.run.smithi188.stdout:749 read 0x83d4200 thru 0x83dbd6e (0x7b6f bytes) 2024-09-14T08:40:14.843 INFO:teuthology.orchestra.run.smithi188.stdout:753 trunc from 0xcaf7a00 to 0xc988a00 2024-09-14T08:40:14.860 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:14.867 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:14.871+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:14.870 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:14.871 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:14.875 INFO:teuthology.orchestra.run.smithi188.stdout:754 write 0xbee00 thru 0xc0087 (0x1288 bytes) 2024-09-14T08:40:14.879 INFO:teuthology.orchestra.run.smithi188.stdout:755 write 0xc0b2c00 thru 0xc0bca0f (0x9e10 bytes) 2024-09-14T08:40:14.880 INFO:teuthology.orchestra.run.smithi188.stdout:757 read 0x64de00 thru 0x6525f8 (0x47f9 bytes) 2024-09-14T08:40:14.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:14.919 INFO:teuthology.orchestra.run.smithi188.stdout:759 write 0xe357e00 thru 0xe363bd5 (0xbdd6 bytes) 2024-09-14T08:40:14.931 INFO:teuthology.orchestra.run.smithi188.stdout:760 trunc from 0xe363c00 to 0x9506a00 2024-09-14T08:40:14.962 INFO:teuthology.orchestra.run.smithi188.stdout:762 read 0x65bb800 thru 0x65c28ee (0x70ef bytes) 2024-09-14T08:40:14.963 INFO:teuthology.orchestra.run.smithi188.stdout:764 read 0x71a1a00 thru 0x71adc6b (0xc26c bytes) 2024-09-14T08:40:14.963 INFO:teuthology.orchestra.run.smithi188.stdout:765 read 0x3972600 thru 0x397d644 (0xb045 bytes) 2024-09-14T08:40:14.974 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:14.974 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:14.979+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:14.986 INFO:teuthology.orchestra.run.smithi188.stdout:766 write 0xc54a000 thru 0xc55703e (0xd03f bytes) 2024-09-14T08:40:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:14.991 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:14.994 INFO:teuthology.orchestra.run.smithi188.stdout:768 trunc from 0xc557200 to 0x9b39400 2024-09-14T08:40:15.007 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:15.007 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:15.021 INFO:teuthology.orchestra.run.smithi188.stdout:769 write 0x74ce800 thru 0x74ced04 (0x505 bytes) 2024-09-14T08:40:15.025 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:15.025 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:15.025 INFO:teuthology.orchestra.run.smithi188.stdout:770 read 0x3db4400 thru 0x3db7096 (0x2c97 bytes) 2024-09-14T08:40:15.026 INFO:teuthology.orchestra.run.smithi188.stdout:771 read 0x71a5a00 thru 0x71b3a74 (0xe075 bytes) 2024-09-14T08:40:15.042 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:15.042 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:15.048 INFO:teuthology.orchestra.run.smithi188.stdout:773 write 0xd1d3c00 thru 0xd1e3477 (0xf878 bytes) 2024-09-14T08:40:15.049 INFO:teuthology.orchestra.run.smithi188.stdout:774 punch from 0xa1c5c00 to 0xa1d5400, (0xf800 bytes) 2024-09-14T08:40:15.050 INFO:teuthology.orchestra.run.smithi188.stdout:775 read 0xc7c8200 thru 0xc7c9f1f (0x1d20 bytes) 2024-09-14T08:40:15.050 INFO:teuthology.orchestra.run.smithi188.stdout:777 write 0x22c9200 thru 0x22d5cd2 (0xcad3 bytes) 2024-09-14T08:40:15.050 INFO:teuthology.orchestra.run.smithi188.stdout:778 read 0x3dfcc00 thru 0x3e069bb (0x9dbc bytes) 2024-09-14T08:40:15.052 INFO:teuthology.orchestra.run.smithi188.stdout:779 punch from 0x5169a00 to 0x516f400, (0x5a00 bytes) 2024-09-14T08:40:15.053 INFO:teuthology.orchestra.run.smithi188.stdout:780 read 0x20f600 thru 0x21dc00 (0xe601 bytes) 2024-09-14T08:40:15.058 INFO:teuthology.orchestra.run.smithi188.stdout:781 write 0x1144400 thru 0x114d376 (0x8f77 bytes) 2024-09-14T08:40:15.059 INFO:teuthology.orchestra.run.smithi188.stdout:782 read 0xabe8000 thru 0xabe8257 (0x258 bytes) 2024-09-14T08:40:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:15.060 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:15.060 INFO:teuthology.orchestra.run.smithi188.stdout:783 read 0xcae2600 thru 0xcaf043f (0xde40 bytes) 2024-09-14T08:40:15.060 INFO:teuthology.orchestra.run.smithi188.stdout:786 punch from 0x9580c00 to 0x9581200, (0x600 bytes) 2024-09-14T08:40:15.061 INFO:teuthology.orchestra.run.smithi188.stdout:787 punch from 0xea6e00 to 0xeab600, (0x4800 bytes) 2024-09-14T08:40:15.061 INFO:teuthology.orchestra.run.smithi188.stdout:788 read 0xa46b000 thru 0xa478b33 (0xdb34 bytes) 2024-09-14T08:40:15.061 INFO:teuthology.orchestra.run.smithi188.stdout:790 read 0x71d9c00 thru 0x71dcb9f (0x2fa0 bytes) 2024-09-14T08:40:15.062 INFO:teuthology.orchestra.run.smithi188.stdout:792 read 0x940e400 thru 0x9410d4a (0x294b bytes) 2024-09-14T08:40:15.062 INFO:teuthology.orchestra.run.smithi188.stdout:798 read 0x5524e00 thru 0x552777a (0x297b bytes) 2024-09-14T08:40:15.062 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:15.063 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:15.064 INFO:teuthology.orchestra.run.smithi188.stdout:800 trunc from 0xd1e3600 to 0xde03e00 2024-09-14T08:40:15.068 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:15.067+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:15.077 INFO:teuthology.orchestra.run.smithi188.stdout:801 write 0x54c5600 thru 0x54cabee (0x55ef bytes) 2024-09-14T08:40:15.079 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:15.079 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:15.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:15.079 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:15.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.079 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.079 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:15.079 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1964294840000003, 2024-09-14T08:40:15.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:40:15.079 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:15.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:40:15.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:40:15.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:40:15.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:40:15.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1851774490000002, 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:40:15.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.089 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1843175639999997, 2024-09-14T08:40:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:40:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:40:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:40:15.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1840109390000002, 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:40:15.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.099 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1836076039999996, 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:40:15.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1832039009999997, 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.104 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:40:15.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1828531550000001, 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.109 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:40:15.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:40:15.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:15.113 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.182466883, 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:15.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:40:15.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:40:15.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1822763500000004, 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:40:15.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.122 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.181769622, 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.18144355, 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.128 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:40:15.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1811339380000003, 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:40:15.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.180638396, 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:40:15.137 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:40:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:40:15.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1803226379999998, 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.142 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:40:15.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1798352019999996, 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.147 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1794851900000003, 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.152 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:40:15.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:40:15.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:40:15.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.156 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1786940709999998, 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:15.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:15.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1782850119999999, 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.161 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:40:15.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:40:15.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.165 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15691 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2255872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.905659+0000", 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1771024609999996, 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098156625999999997, 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15691 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905659+0000", 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905659+0000", 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.906171+0000", 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051182300000000001 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.906178+0000", 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6369999999999999e-06 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.906198+0000", 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9514e-05 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.906211+0000", 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2685e-05 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.003512+0000", 2024-09-14T08:40:15.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097301841 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.003626+0000", 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011382700000000001 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.003815+0000", 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000189299 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1756523249999997, 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.175 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:15.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:15.178 INFO:teuthology.orchestra.run.smithi188.stdout:802 write 0xc16ae00 thru 0xc17634e (0xb54f bytes) 2024-09-14T08:40:15.178 INFO:teuthology.orchestra.run.smithi188.stdout:803 write 0xe81e400 thru 0xe821b65 (0x3766 bytes) 2024-09-14T08:40:15.178 INFO:teuthology.orchestra.run.smithi188.stdout:805 read 0x1c21800 thru 0x1c307f6 (0xeff7 bytes) 2024-09-14T08:40:15.179 INFO:teuthology.orchestra.run.smithi188.stdout:806 trunc from 0xe821c00 to 0x711ec00 2024-09-14T08:40:15.179 INFO:teuthology.orchestra.run.smithi188.stdout:807 read 0x4116400 thru 0x41240ae (0xdcaf bytes) 2024-09-14T08:40:15.179 INFO:teuthology.orchestra.run.smithi188.stdout:809 trunc from 0x711ec00 to 0xc937c00 2024-09-14T08:40:15.179 INFO:teuthology.orchestra.run.smithi188.stdout:810 read 0x2112800 thru 0x2121c69 (0xf46a bytes) 2024-09-14T08:40:15.179 INFO:teuthology.orchestra.run.smithi188.stdout:813 write 0xc770200 thru 0xc775019 (0x4e1a bytes) 2024-09-14T08:40:15.179 INFO:teuthology.orchestra.run.smithi188.stdout:816 read 0x6614400 thru 0x6621a16 (0xd617 bytes) 2024-09-14T08:40:15.179 INFO:teuthology.orchestra.run.smithi188.stdout:817 trunc from 0xc937c00 to 0xd15ac00 2024-09-14T08:40:15.179 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:15.175+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:15.196 INFO:teuthology.orchestra.run.smithi188.stdout:818 trunc from 0xd15ac00 to 0xc5d5a00 2024-09-14T08:40:15.220 INFO:teuthology.orchestra.run.smithi188.stdout:819 read 0x3e99a00 thru 0x3ea79d9 (0xdfda bytes) 2024-09-14T08:40:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:820 trunc from 0xc5d5a00 to 0x46c4c00 2024-09-14T08:40:15.277 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:15.279+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:15.312 INFO:teuthology.orchestra.run.smithi188.stdout:822 write 0xc3b0200 thru 0xc3b5c02 (0x5a03 bytes) 2024-09-14T08:40:15.323 INFO:teuthology.orchestra.run.smithi188.stdout:824 trunc from 0xc3b5e00 to 0x85ae800 2024-09-14T08:40:15.350 INFO:teuthology.orchestra.run.smithi188.stdout:826 read 0xeda200 thru 0xee8026 (0xde27 bytes) 2024-09-14T08:40:15.356 INFO:teuthology.orchestra.run.smithi188.stdout:828 write 0x6f61a00 thru 0x6f6297f (0xf80 bytes) 2024-09-14T08:40:15.356 INFO:teuthology.orchestra.run.smithi188.stdout:829 read 0x51dcc00 thru 0x51e1a51 (0x4e52 bytes) 2024-09-14T08:40:15.367 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:15.367 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:15.367 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:15.367 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:15.378 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:15.379+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:15.381 INFO:teuthology.orchestra.run.smithi188.stdout:830 trunc from 0x85ae800 to 0x674800 2024-09-14T08:40:15.382 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:15.449 INFO:teuthology.orchestra.run.smithi188.stdout:834 trunc from 0x674800 to 0x5fae600 2024-09-14T08:40:15.468 INFO:teuthology.orchestra.run.smithi188.stdout:835 read 0xbb9000 thru 0xbbce1a (0x3e1b bytes) 2024-09-14T08:40:15.470 INFO:teuthology.orchestra.run.smithi188.stdout:836 punch from 0x5e6800 to 0x5eaa00, (0x4200 bytes) 2024-09-14T08:40:15.471 INFO:teuthology.orchestra.run.smithi188.stdout:839 trunc from 0x5fae600 to 0x597ac00 2024-09-14T08:40:15.479 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:15.483+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:15.494 INFO:teuthology.orchestra.run.smithi188.stdout:840 read 0x2efd400 thru 0x2f003da (0x2fdb bytes) 2024-09-14T08:40:15.510 INFO:teuthology.orchestra.run.smithi188.stdout:841 trunc from 0x597ac00 to 0xaed0e00 2024-09-14T08:40:15.526 INFO:teuthology.orchestra.run.smithi188.stdout:842 write 0x95f5200 thru 0x95f7cb4 (0x2ab5 bytes) 2024-09-14T08:40:15.528 INFO:teuthology.orchestra.run.smithi188.stdout:843 read 0x74cd000 thru 0x74d9a91 (0xca92 bytes) 2024-09-14T08:40:15.528 INFO:teuthology.orchestra.run.smithi188.stdout:844 write 0x201d600 thru 0x2028f7c (0xb97d bytes) 2024-09-14T08:40:15.530 INFO:teuthology.orchestra.run.smithi188.stdout:845 read 0x64fc000 thru 0x65068c2 (0xa8c3 bytes) 2024-09-14T08:40:15.530 INFO:teuthology.orchestra.run.smithi188.stdout:848 write 0x2df9600 thru 0x2e0135d (0x7d5e bytes) 2024-09-14T08:40:15.532 INFO:teuthology.orchestra.run.smithi188.stdout:850 punch from 0x149c200 to 0x149f800, (0x3600 bytes) 2024-09-14T08:40:15.533 INFO:teuthology.orchestra.run.smithi188.stdout:851 read 0x38da00 thru 0x395364 (0x7965 bytes) 2024-09-14T08:40:15.538 INFO:teuthology.orchestra.run.smithi188.stdout:852 read 0x2474800 thru 0x2478b7a (0x437b bytes) 2024-09-14T08:40:15.565 INFO:teuthology.orchestra.run.smithi188.stdout:854 write 0xda6c600 thru 0xda7a7bc (0xe1bd bytes) 2024-09-14T08:40:15.570 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:15.570 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:15.579 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:15.579+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:15.585 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:15.589 INFO:teuthology.orchestra.run.smithi188.stdout:857 trunc from 0xda7a800 to 0x711200 2024-09-14T08:40:15.623 INFO:teuthology.orchestra.run.smithi188.stdout:859 read 0x3ea200 thru 0x3f9032 (0xee33 bytes) 2024-09-14T08:40:15.625 INFO:teuthology.orchestra.run.smithi188.stdout:861 punch from 0x336400 to 0x344800, (0xe400 bytes) 2024-09-14T08:40:15.650 INFO:teuthology.orchestra.run.smithi188.stdout:863 write 0x3243400 thru 0x324dacb (0xa6cc bytes) 2024-09-14T08:40:15.654 INFO:teuthology.orchestra.run.smithi188.stdout:864 read 0x2e39e00 thru 0x2e46863 (0xca64 bytes) 2024-09-14T08:40:15.680 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:15.679+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:15.695 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.5 primary-affinity to 0.13564 (888892) 2024-09-14T08:40:15.712 INFO:teuthology.orchestra.run.smithi188.stdout:866 write 0xaf1e200 thru 0xaf2aeab (0xccac bytes) 2024-09-14T08:40:15.713 INFO:teuthology.orchestra.run.smithi188.stdout:867 read 0x66bb800 thru 0x66c9a4d (0xe24e bytes) 2024-09-14T08:40:15.727 INFO:teuthology.orchestra.run.smithi188.stdout:868 trunc from 0xaf2b000 to 0xece8600 2024-09-14T08:40:15.757 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:15.757 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:15.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:15.757 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:15.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.757 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54084 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5699584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.757 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:15.757 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681868402999999, 2024-09-14T08:40:15.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093000530999999997, 2024-09-14T08:40:15.757 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54084 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078497+0000", 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078500+0000", 2024-09-14T08:40:15.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1360000000000001e-06 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078509+0000", 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9490000000000002e-06 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078516+0000", 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.233e-06 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.170871+0000", 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092354443999999994 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171110+0000", 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000239349 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171497+0000", 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038669300000000002 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.761 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54085 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5710848~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681838399, 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093690545, 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54085 2024-09-14T08:40:15.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078527+0000", 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078530+0000", 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8660000000000002e-06 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078539+0000", 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9560000000000003e-06 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078546+0000", 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1489999999999997e-06 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171585+0000", 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093038914 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171820+0000", 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000235558 2024-09-14T08:40:15.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172217+0000", 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039639900000000002 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54086 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5722112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681808868999999, 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094383724000000002, 2024-09-14T08:40:15.766 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54086 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078557+0000", 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078560+0000", 2024-09-14T08:40:15.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-06 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078571+0000", 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0951999999999999e-05 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078579+0000", 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7760000000000003e-06 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172313+0000", 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093733343999999996 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172558+0000", 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024562199999999997 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172940+0000", 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038131999999999999 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.770 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54087 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5644288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681774849, 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095045525000000006, 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.771 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54087 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078591+0000", 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078594+0000", 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078603+0000", 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3759999999999997e-06 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078610+0000", 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0160000000000003e-06 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173032+0000", 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094421672999999998 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173265+0000", 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000233265 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173635+0000", 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037049899999999999 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54088 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5733376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681744379, 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095706712999999999, 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54088 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.776 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078621+0000", 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078624+0000", 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078633+0000", 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3950000000000007e-06 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078641+0000", 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4900000000000003e-06 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173728+0000", 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095086680000000007 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173954+0000", 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022685000000000001 2024-09-14T08:40:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174327+0000", 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037261800000000002 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681713562000001, 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:15.780 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:15.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.784 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681625465, 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.785 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:15.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681558067999999, 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.790 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:15.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681484372, 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:15.794 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681408899999999, 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681351696, 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681292812000001, 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681227886, 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681166435, 2024-09-14T08:40:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681106901, 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.681047591, 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.680975559, 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56620 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5999616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.154782511000001, 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092334608999999998, 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56620 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605583+0000", 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605586+0000", 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0060000000000001e-06 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605595+0000", 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605602+0000", 2024-09-14T08:40:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2760000000000003e-06 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697625+0000", 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092022458000000001 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697749+0000", 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124201 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697917+0000", 2024-09-14T08:40:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016798900000000001 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56621 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 6010880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.154752251, 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092668125000000004, 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56621 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605613+0000", 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605616+0000", 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.106e-06 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605627+0000", 2024-09-14T08:40:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1026000000000001e-05 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605635+0000", 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3289999999999996e-06 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697992+0000", 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092357106999999994 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698109+0000", 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117615 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698281+0000", 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017125199999999999 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56622 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 6022144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.154719791, 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092976195999999997, 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56622 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605646+0000", 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605649+0000", 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0730000000000001e-06 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605658+0000", 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9090000000000006e-06 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605667+0000", 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9160000000000007e-06 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698330+0000", 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092663841999999996 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698447+0000", 2024-09-14T08:40:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116921 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698621+0000", 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017383200000000001 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:15.849 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:15.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:15.851 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:15.854+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:15.952 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:15.954+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:15.980 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:15.980 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:15.980 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:15.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:16.053 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:16.051+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:16.118 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:16.118 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:16.118 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:16.118 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:16.118 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:16.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:16.174 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:16.175+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:16.254 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:16.255+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:16.297 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31797 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3304448~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373855545000001, 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071016060000000006, 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31797 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0699999999999997e-07 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925536+0000", 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.368e-06 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925543+0000", 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.781e-06 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925548+0000", 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996245+0000", 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070697276000000003 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996352+0000", 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107054 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996549+0000", 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000196942 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.302 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31798 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3306496~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373833524999998, 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071397830999999995, 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.303 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31798 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:16.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925558+0000", 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2069999999999998e-06 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925564+0000", 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6290000000000004e-06 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925569+0000", 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.164e-06 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996603+0000", 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071033712999999998 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996708+0000", 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010466700000000001 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996953+0000", 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000244959 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.307 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31799 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3315712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373812168000001, 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071768473999999999, 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31799 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925577+0000", 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925579+0000", 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925587+0000", 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925593+0000", 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997015+0000", 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071422484999999994 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997130+0000", 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115053 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997345+0000", 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214379 2024-09-14T08:40:16.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31800 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3326976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373788481999998, 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072113090000000005, 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31800 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:16.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925603+0000", 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925610+0000", 2024-09-14T08:40:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8029999999999997e-06 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925618+0000", 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6930000000000007e-06 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997400+0000", 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071781929999999994 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997507+0000", 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107012 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997713+0000", 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020603 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.316 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373762793000001, 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:40:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:40:16.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373740237, 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.321 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373672222, 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:40:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:40:16.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:16.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373622493999999, 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:16.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:40:16.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373571339000002, 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:40:16.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.339 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373519336000001, 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:40:16.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373456766, 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:40:16.344 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:40:16.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:40:16.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373390187999998, 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:40:16.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:16.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373312404, 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:16.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:40:16.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373259708999999, 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:16.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:40:16.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373214055999998, 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:40:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:40:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373167585000001, 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:40:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373121597000001, 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:40:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373093339, 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.373038561000001, 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:40:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.945268102, 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:40:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:40:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:40:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:40:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:40:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.391 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:16.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:16.393 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:16.395+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:16.493 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:16.494+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:16.559 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:16.560 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:16.560 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:16.560 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:16.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:16.617 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:16.619+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:16.693 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:16.694 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:16.694 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:16.694 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:16.695+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:16.709 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:16.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:40:16.755 INFO:teuthology.orchestra.run.smithi188.stdout:869 read 0x3594200 thru 0x35a0c9f (0xcaa0 bytes) 2024-09-14T08:40:16.760 INFO:teuthology.orchestra.run.smithi188.stdout:870 read 0x507ee00 thru 0x508bc11 (0xce12 bytes) 2024-09-14T08:40:16.761 INFO:teuthology.orchestra.run.smithi188.stdout:871 read 0x6f07000 thru 0x6f1174e (0xa74f bytes) 2024-09-14T08:40:16.761 INFO:teuthology.orchestra.run.smithi188.stdout:874 punch from 0xab1e600 to 0xab20e00, (0x2800 bytes) 2024-09-14T08:40:16.794 INFO:teuthology.orchestra.run.smithi188.stdout:878 trunc from 0xece8600 to 0x177b400 2024-09-14T08:40:16.795 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:16.798+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:16.864 INFO:teuthology.orchestra.run.smithi188.stdout:879 write 0x3869c00 thru 0x3875f09 (0xc30a bytes) 2024-09-14T08:40:16.870 INFO:teuthology.orchestra.run.smithi188.stdout:880 read 0x65c200 thru 0x663e4f (0x7c50 bytes) 2024-09-14T08:40:16.885 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:16.885 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:16.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:16.885 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33403 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3560448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610789028999999, 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065276109999999998, 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33403 2024-09-14T08:40:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277827+0000", 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.23e-07 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277830+0000", 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277839+0000", 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:40:16.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277846+0000", 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1590000000000004e-06 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342820+0000", 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064974064999999998 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342954+0000", 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133509 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343102+0000", 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000148539 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33404 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3571712~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.890 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610757567, 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065555713000000002, 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33404 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:16.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277861+0000", 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9790000000000002e-06 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277881+0000", 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9463999999999999e-05 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277889+0000", 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7190000000000001e-06 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343177+0000", 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065288760000000001 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343279+0000", 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101974 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343414+0000", 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013411 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33405 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610716256, 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065812103999999996, 2024-09-14T08:40:16.895 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33405 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277900+0000", 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277922+0000", 2024-09-14T08:40:16.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1540999999999999e-05 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277932+0000", 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0587999999999999e-05 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277940+0000", 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5360000000000004e-06 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343480+0000", 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065539753000000006 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343581+0000", 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101005 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343711+0000", 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013069500000000001 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610664122999999, 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.900 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610635327000001, 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:40:16.904 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:40:16.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.908 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610606508, 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.909 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:40:16.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.913 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610578179000001, 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:40:16.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:40:16.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610548979000001, 2024-09-14T08:40:16.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:40:16.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:40:16.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610516970999999, 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:40:16.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:40:16.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:40:16.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610487695, 2024-09-14T08:40:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:16.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:40:16.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610458029, 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610429486000001, 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.937 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:16.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.61040118, 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:40:16.941 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:40:16.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:40:16.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610355912999999, 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.946 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:40:16.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:16.950 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610324291000001, 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:40:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610266479, 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.955 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610198466, 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.959 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:16.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.963 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610163094000001, 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:40:16.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:40:16.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:40:16.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.610128695, 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:16.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:40:16.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:16.972 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 6.5830581419999996, 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:16.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:16.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:16.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:40:16.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:16.978 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:16.981 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:16.981 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:16.979+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:16.981 INFO:teuthology.orchestra.run.smithi188.stdout:882 trunc from 0x3876000 to 0x8c4e200 2024-09-14T08:40:16.981 INFO:teuthology.orchestra.run.smithi188.stdout:883 punch from 0x7eb7a00 to 0x7ebf400, (0x7a00 bytes) 2024-09-14T08:40:16.982 INFO:teuthology.orchestra.run.smithi188.stdout:885 trunc from 0x8c4e200 to 0xd595000 2024-09-14T08:40:16.982 INFO:teuthology.orchestra.run.smithi188.stdout:886 read 0x3228800 thru 0x3233d19 (0xb51a bytes) 2024-09-14T08:40:16.982 INFO:teuthology.orchestra.run.smithi188.stdout:887 write 0x4df5e00 thru 0x4df627d (0x47e bytes) 2024-09-14T08:40:16.982 INFO:teuthology.orchestra.run.smithi188.stdout:888 write 0xc549600 thru 0xc54c71c (0x311d bytes) 2024-09-14T08:40:16.982 INFO:teuthology.orchestra.run.smithi188.stdout:889 write 0x79bb400 thru 0x79ca189 (0xed8a bytes) 2024-09-14T08:40:16.982 INFO:teuthology.orchestra.run.smithi188.stdout:890 read 0x657ea00 thru 0x657f86f (0xe70 bytes) 2024-09-14T08:40:16.996 INFO:teuthology.orchestra.run.smithi188.stdout:893 write 0xd9fbe00 thru 0xd9fc8b3 (0xab4 bytes) 2024-09-14T08:40:16.998 INFO:teuthology.orchestra.run.smithi188.stdout:894 read 0x8246e00 thru 0x8253235 (0xc436 bytes) 2024-09-14T08:40:16.998 INFO:teuthology.orchestra.run.smithi188.stdout:897 read 0x916da00 thru 0x916f09e (0x169f bytes) 2024-09-14T08:40:17.001 INFO:teuthology.orchestra.run.smithi188.stdout:898 trunc from 0xd9fca00 to 0xe7fa800 2024-09-14T08:40:17.019 INFO:teuthology.orchestra.run.smithi188.stdout:901 read 0x142ba00 thru 0x1434c9d (0x929e bytes) 2024-09-14T08:40:17.033 INFO:teuthology.orchestra.run.smithi188.stdout:902 trunc from 0xe7fa800 to 0xad74200 2024-09-14T08:40:17.054 INFO:teuthology.orchestra.run.smithi188.stdout:903 read 0x234be00 thru 0x23556ae (0x98af bytes) 2024-09-14T08:40:17.056 INFO:teuthology.orchestra.run.smithi188.stdout:905 punch from 0x8711800 to 0x871dc00, (0xc400 bytes) 2024-09-14T08:40:17.056 INFO:teuthology.orchestra.run.smithi188.stdout:906 punch from 0x4d81a00 to 0x4d83a00, (0x2000 bytes) 2024-09-14T08:40:17.056 INFO:teuthology.orchestra.run.smithi188.stdout:908 read 0x4626000 thru 0x462d1a3 (0x71a4 bytes) 2024-09-14T08:40:17.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:17.067 INFO:teuthology.orchestra.run.smithi188.stdout:909 trunc from 0xad74200 to 0x4fd5000 2024-09-14T08:40:17.080 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:17.082+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:17.114 INFO:teuthology.orchestra.run.smithi188.stdout:911 write 0x984c600 thru 0x9859d6a (0xd76b bytes) 2024-09-14T08:40:17.121 INFO:teuthology.orchestra.run.smithi188.stdout:912 trunc from 0x9859e00 to 0x730dc00 2024-09-14T08:40:17.128 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:83164 3.a 3.ba4103ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-14T08:40:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:17.133166+0000", 2024-09-14T08:40:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00021855299999999999, 2024-09-14T08:40:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000255419, 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 83164 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133166+0000", 2024-09-14T08:40:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133166+0000", 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133166+0000", 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0200000000000002e-07 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133168+0000", 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.638e-06 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133173+0000", 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1229999999999999e-06 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133177+0000", 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5240000000000001e-06 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133420+0000", 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024322999999999999 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:83165 3.a 3.ba4103ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:17.133182+0000", 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00020227099999999999, 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000367621, 2024-09-14T08:40:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 83165 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133182+0000", 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133182+0000", 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133182+0000", 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-07 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133184+0000", 2024-09-14T08:40:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5269999999999999e-06 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133188+0000", 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8959999999999996e-06 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133191+0000", 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2789999999999999e-06 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:83166 3.a 3.ba4103ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:17.133196+0000", 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.000188677, 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00045744399999999999, 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 83166 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133196+0000", 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133196+0000", 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133196+0000", 2024-09-14T08:40:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9400000000000001e-07 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133197+0000", 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.466e-06 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133202+0000", 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133206+0000", 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1269999999999996e-06 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:4019 3.d 3:b148d192:::rbd_header.10f15d5c7697:head [call lock.lock in=76b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:17.133299+0000", 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5000000000000006e-05, 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000465301, 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 4019 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133299+0000", 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133299+0000", 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133300+0000", 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1100000000000005e-07 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133304+0000", 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3719999999999998e-06 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133314+0000", 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1800000000000002e-06 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133322+0000", 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9659999999999996e-06 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133368+0000", 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6118000000000001e-05 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:17.133421+0000", 2024-09-14T08:40:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3585000000000003e-05 2024-09-14T08:40:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:40:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 4 2024-09-14T08:40:17.143 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:17.144 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:17.155 INFO:teuthology.orchestra.run.smithi188.stdout:913 read 0x45dd800 thru 0x45e47b9 (0x6fba bytes) 2024-09-14T08:40:17.180 INFO:teuthology.orchestra.run.smithi188.stdout:915 write 0xb943400 thru 0xb94399e (0x59f bytes) 2024-09-14T08:40:17.181 INFO:teuthology.orchestra.run.smithi188.stdout:916 write 0x61df600 thru 0x61e4282 (0x4c83 bytes) 2024-09-14T08:40:17.181 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:17.179+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:17.181 INFO:teuthology.orchestra.run.smithi188.stdout:918 write 0x471200 thru 0x4793cf (0x81d0 bytes) 2024-09-14T08:40:17.191 INFO:teuthology.orchestra.run.smithi188.stdout:921 trunc from 0xb943a00 to 0x8511e00 2024-09-14T08:40:17.191 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:17.209 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:17.215 INFO:teuthology.orchestra.run.smithi188.stdout:925 read 0x4aee400 thru 0x4af1baa (0x37ab bytes) 2024-09-14T08:40:17.216 INFO:teuthology.orchestra.run.smithi188.stdout:926 read 0x495c800 thru 0x495cb08 (0x309 bytes) 2024-09-14T08:40:17.217 INFO:teuthology.orchestra.run.smithi188.stdout:927 write 0x2518a00 thru 0x251d0a6 (0x46a7 bytes) 2024-09-14T08:40:17.217 INFO:teuthology.orchestra.run.smithi188.stdout:931 read 0x5c8dc00 thru 0x5c9a2cd (0xc6ce bytes) 2024-09-14T08:40:17.225 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:17.226 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:17.231 INFO:teuthology.orchestra.run.smithi188.stdout:934 trunc from 0x8511e00 to 0x3489400 2024-09-14T08:40:17.244 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:17.244 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:17.264 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:17.264 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:17.281 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:17.282+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:17.282 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:17.282 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:17.286 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:17.286 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:17.316 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:17.316 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:17.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:17.415 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:17.418+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:17.467 INFO:teuthology.orchestra.run.smithi188.stdout:937 read 0x93fc00 thru 0x94b56a (0xb96b bytes) 2024-09-14T08:40:17.471 INFO:teuthology.orchestra.run.smithi188.stdout:938 punch from 0x1efa000 to 0x1f06400, (0xc400 bytes) 2024-09-14T08:40:17.483 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:17.483+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:17.502 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:17.502 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:17.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:17.518 INFO:teuthology.orchestra.run.smithi188.stdout:939 write 0xc510200 thru 0xc5144d3 (0x42d4 bytes) 2024-09-14T08:40:17.519 INFO:teuthology.orchestra.run.smithi188.stdout:941 write 0x1a8a000 thru 0x1a8d3ee (0x33ef bytes) 2024-09-14T08:40:17.522 INFO:teuthology.orchestra.run.smithi188.stdout:943 write 0x167c200 thru 0x168885e (0xc65f bytes) 2024-09-14T08:40:17.532 INFO:teuthology.orchestra.run.smithi188.stdout:945 trunc from 0xc514600 to 0xebf2200 2024-09-14T08:40:17.560 INFO:teuthology.orchestra.run.smithi188.stdout:948 write 0x7ab3000 thru 0x7ab35eb (0x5ec bytes) 2024-09-14T08:40:17.564 INFO:teuthology.orchestra.run.smithi188.stdout:952 punch from 0xbad3400 to 0xbadd600, (0xa200 bytes) 2024-09-14T08:40:17.564 INFO:teuthology.orchestra.run.smithi188.stdout:954 read 0x1e81200 thru 0x1e89c50 (0x8a51 bytes) 2024-09-14T08:40:17.567 INFO:teuthology.orchestra.run.smithi188.stdout:955 write 0xcc31000 thru 0xcc3dd0e (0xcd0f bytes) 2024-09-14T08:40:17.567 INFO:teuthology.orchestra.run.smithi188.stdout:956 read 0x4ae7e00 thru 0x4ae82b1 (0x4b2 bytes) 2024-09-14T08:40:17.572 INFO:teuthology.orchestra.run.smithi188.stdout:958 read 0x48dda00 thru 0x48e3708 (0x5d09 bytes) 2024-09-14T08:40:17.573 INFO:teuthology.orchestra.run.smithi188.stdout:959 read 0x7468600 thru 0x7474ab4 (0xc4b5 bytes) 2024-09-14T08:40:17.574 INFO:teuthology.orchestra.run.smithi188.stdout:960 read 0x7059000 thru 0x7060ad5 (0x7ad6 bytes) 2024-09-14T08:40:17.602 INFO:teuthology.orchestra.run.smithi188.stdout:961 trunc from 0xebf2200 to 0x4037200 2024-09-14T08:40:17.607 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:17.610+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:17.666 INFO:teuthology.orchestra.run.smithi188.stdout:963 write 0xd7b9600 thru 0xd7c2b00 (0x9501 bytes) 2024-09-14T08:40:17.668 INFO:teuthology.orchestra.run.smithi188.stdout:965 write 0xa018000 thru 0xa018603 (0x604 bytes) 2024-09-14T08:40:17.668 INFO:teuthology.orchestra.run.smithi188.stdout:966 read 0xd21f200 thru 0xd22f059 (0xfe5a bytes) 2024-09-14T08:40:17.668 INFO:teuthology.orchestra.run.smithi188.stdout:967 punch from 0xc25e400 to 0xc264a00, (0x6600 bytes) 2024-09-14T08:40:17.670 INFO:teuthology.orchestra.run.smithi188.stdout:968 trunc from 0xd7c2c00 to 0xe0c6e00 2024-09-14T08:40:17.684 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:17.683+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:17.698 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:17.699 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:17.701 INFO:teuthology.orchestra.run.smithi188.stdout:976 write 0x33aba00 thru 0x33b4eb2 (0x94b3 bytes) 2024-09-14T08:40:17.703 INFO:teuthology.orchestra.run.smithi188.stdout:977 read 0x9da3600 thru 0x9da5583 (0x1f84 bytes) 2024-09-14T08:40:17.703 INFO:teuthology.orchestra.run.smithi188.stdout:978 write 0xe5e000 thru 0xe6b00c (0xd00d bytes) 2024-09-14T08:40:17.704 INFO:teuthology.orchestra.run.smithi188.stdout:979 punch from 0x403ce00 to 0x4042600, (0x5800 bytes) 2024-09-14T08:40:17.705 INFO:teuthology.orchestra.run.smithi188.stdout:980 read 0x3b1c00 thru 0x3b82f1 (0x66f2 bytes) 2024-09-14T08:40:17.711 INFO:teuthology.orchestra.run.smithi188.stdout:982 write 0x225a00 thru 0x2302dc (0xa8dd bytes) 2024-09-14T08:40:17.713 INFO:teuthology.orchestra.run.smithi188.stdout:983 write 0x6ec0200 thru 0x6ecfbdb (0xf9dc bytes) 2024-09-14T08:40:17.714 INFO:teuthology.orchestra.run.smithi188.stdout:984 read 0xbe12e00 thru 0xbe1b0f5 (0x82f6 bytes) 2024-09-14T08:40:17.715 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:17.715 INFO:teuthology.orchestra.run.smithi188.stdout:985 read 0xb401e00 thru 0xb40d760 (0xb961 bytes) 2024-09-14T08:40:17.731 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:40:17.737 INFO:teuthology.orchestra.run.smithi188.stdout:986 trunc from 0xe0c6e00 to 0x22d9e00 2024-09-14T08:40:17.778 INFO:teuthology.orchestra.run.smithi188.stdout:990 trunc from 0x22d9e00 to 0x48b0400 2024-09-14T08:40:17.803 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:17.806+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:17.821 INFO:teuthology.orchestra.run.smithi188.stdout:991 write 0xd37bc00 thru 0xd384c60 (0x9061 bytes) 2024-09-14T08:40:17.822 INFO:teuthology.orchestra.run.smithi188.stdout:995 punch from 0x9e80200 to 0x9e85800, (0x5600 bytes) 2024-09-14T08:40:17.823 INFO:teuthology.orchestra.run.smithi188.stdout:997 write 0x8c0a600 thru 0x8c125c9 (0x7fca bytes) 2024-09-14T08:40:17.823 INFO:teuthology.orchestra.run.smithi188.stdout:1000 read 0xb56e400 thru 0xb576986 (0x8587 bytes) 2024-09-14T08:40:17.823 INFO:teuthology.orchestra.run.smithi188.stdout:1001 write 0x9b09000 thru 0x9b18eb2 (0xfeb3 bytes) 2024-09-14T08:40:17.823 INFO:teuthology.orchestra.run.smithi188.stdout:1002 write 0x1cd3200 thru 0x1cd5e18 (0x2c19 bytes) 2024-09-14T08:40:17.824 INFO:teuthology.orchestra.run.smithi188.stdout:1003 write 0x2a88600 thru 0x2a983b3 (0xfdb4 bytes) 2024-09-14T08:40:17.827 INFO:teuthology.orchestra.run.smithi188.stdout:1004 read 0xc27ec00 thru 0xc2845d9 (0x59da bytes) 2024-09-14T08:40:17.827 INFO:teuthology.orchestra.run.smithi188.stdout:1006 write 0xbbaea00 thru 0xbbaefb3 (0x5b4 bytes) 2024-09-14T08:40:17.831 INFO:teuthology.orchestra.run.smithi188.stdout:1007 trunc from 0xd384e00 to 0xaafb200 2024-09-14T08:40:17.866 INFO:teuthology.orchestra.run.smithi188.stdout:1008 trunc from 0xaafb200 to 0xdf24e00 2024-09-14T08:40:17.880 INFO:teuthology.orchestra.run.smithi188.stdout:1009 write 0x83ba200 thru 0x83c9b60 (0xf961 bytes) 2024-09-14T08:40:17.886 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:17.887+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:17.900 INFO:teuthology.orchestra.run.smithi188.stdout:1010 trunc from 0xdf24e00 to 0x6852600 2024-09-14T08:40:17.904 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:17.904 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:17.921 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:17.944 INFO:teuthology.orchestra.run.smithi188.stdout:1011 trunc from 0x6852600 to 0x315e200 2024-09-14T08:40:17.987 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:17.987+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:18.000 INFO:teuthology.orchestra.run.smithi188.stdout:1012 write 0x60ea800 thru 0x60ee0e1 (0x38e2 bytes) 2024-09-14T08:40:18.000 INFO:teuthology.orchestra.run.smithi188.stdout:1013 read 0x12f5400 thru 0x12fb57d (0x617e bytes) 2024-09-14T08:40:18.003 INFO:teuthology.orchestra.run.smithi188.stdout:1014 read 0x1422400 thru 0x142ea7c (0xc67d bytes) 2024-09-14T08:40:18.049 INFO:teuthology.orchestra.run.smithi188.stdout:1015 write 0xb9b2800 thru 0xb9bf015 (0xc816 bytes) 2024-09-14T08:40:18.049 INFO:teuthology.orchestra.run.smithi188.stdout:1016 read 0x8393400 thru 0x839b549 (0x814a bytes) 2024-09-14T08:40:18.049 INFO:teuthology.orchestra.run.smithi188.stdout:1020 write 0xb393e00 thru 0xb395f7c (0x217d bytes) 2024-09-14T08:40:18.049 INFO:teuthology.orchestra.run.smithi188.stdout:1021 read 0x47ada00 thru 0x47b12c5 (0x38c6 bytes) 2024-09-14T08:40:18.049 INFO:teuthology.orchestra.run.smithi188.stdout:1022 read 0x60ce200 thru 0x60cedda (0xbdb bytes) 2024-09-14T08:40:18.076 INFO:teuthology.orchestra.run.smithi188.stdout:1023 write 0xbb41000 thru 0xbb4e594 (0xd595 bytes) 2024-09-14T08:40:18.078 INFO:teuthology.orchestra.run.smithi188.stdout:1025 write 0x8751c00 thru 0x875ba69 (0x9e6a bytes) 2024-09-14T08:40:18.080 INFO:teuthology.orchestra.run.smithi188.stdout:1028 read 0x63e2e00 thru 0x63effde (0xd1df bytes) 2024-09-14T08:40:18.080 INFO:teuthology.orchestra.run.smithi188.stdout:1029 read 0x59eec00 thru 0x59f6da1 (0x81a2 bytes) 2024-09-14T08:40:18.080 INFO:teuthology.orchestra.run.smithi188.stdout:1030 punch from 0x99d3a00 to 0x99e1a00, (0xe000 bytes) 2024-09-14T08:40:18.088 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:18.087+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:18.093 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:18.093 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:18.108 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:18.118 INFO:teuthology.orchestra.run.smithi188.stdout:1034 write 0xd0a8c00 thru 0xd0b57d8 (0xcbd9 bytes) 2024-09-14T08:40:18.118 INFO:teuthology.orchestra.run.smithi188.stdout:1036 read 0x79a600 thru 0x7a75a2 (0xcfa3 bytes) 2024-09-14T08:40:18.121 INFO:teuthology.orchestra.run.smithi188.stdout:1040 write 0x8bc6c00 thru 0x8bca7e9 (0x3bea bytes) 2024-09-14T08:40:18.121 INFO:teuthology.orchestra.run.smithi188.stdout:1041 punch from 0xaab5000 to 0xaabc200, (0x7200 bytes) 2024-09-14T08:40:18.122 INFO:teuthology.orchestra.run.smithi188.stdout:1042 read 0xadce200 thru 0xadd69e7 (0x87e8 bytes) 2024-09-14T08:40:18.125 INFO:teuthology.orchestra.run.smithi188.stdout:1043 punch from 0x1ef5800 to 0x1f03a00, (0xe200 bytes) 2024-09-14T08:40:18.126 INFO:teuthology.orchestra.run.smithi188.stdout:1046 write 0xcfa2e00 thru 0xcfae6b3 (0xb8b4 bytes) 2024-09-14T08:40:18.126 INFO:teuthology.orchestra.run.smithi188.stdout:1047 write 0x5aaa600 thru 0x5aac3d1 (0x1dd2 bytes) 2024-09-14T08:40:18.127 INFO:teuthology.orchestra.run.smithi188.stdout:1048 read 0x909d000 thru 0x90a65dd (0x95de bytes) 2024-09-14T08:40:18.128 INFO:teuthology.orchestra.run.smithi188.stdout:1049 read 0x9db1200 thru 0x9dbabb2 (0x99b3 bytes) 2024-09-14T08:40:18.131 INFO:teuthology.orchestra.run.smithi188.stdout:1053 trunc from 0xd0b5800 to 0xd8ce000 2024-09-14T08:40:18.154 INFO:teuthology.orchestra.run.smithi188.stdout:1060 read 0x263a800 thru 0x2641884 (0x7085 bytes) 2024-09-14T08:40:18.157 INFO:teuthology.orchestra.run.smithi188.stdout:1062 write 0x9630200 thru 0x96362ac (0x60ad bytes) 2024-09-14T08:40:18.158 INFO:teuthology.orchestra.run.smithi188.stdout:1063 write 0x2d6c00 thru 0x2e6004 (0xf405 bytes) 2024-09-14T08:40:18.159 INFO:teuthology.orchestra.run.smithi188.stdout:1065 read 0x8ce6600 thru 0x8cedc15 (0x7616 bytes) 2024-09-14T08:40:18.160 INFO:teuthology.orchestra.run.smithi188.stdout:1066 read 0xbdd7600 thru 0xbdde4c3 (0x6ec4 bytes) 2024-09-14T08:40:18.161 INFO:teuthology.orchestra.run.smithi188.stdout:1068 write 0xa839800 thru 0xa84849d (0xec9e bytes) 2024-09-14T08:40:18.162 INFO:teuthology.orchestra.run.smithi188.stdout:1070 write 0xb268a00 thru 0xb271f7e (0x957f bytes) 2024-09-14T08:40:18.163 INFO:teuthology.orchestra.run.smithi188.stdout:1071 read 0x2cbb400 thru 0x2cbf915 (0x4516 bytes) 2024-09-14T08:40:18.188 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:18.190+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:18.189 INFO:teuthology.orchestra.run.smithi188.stdout:1072 trunc from 0xd8ce000 to 0xf11800 2024-09-14T08:40:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:18.247 INFO:teuthology.orchestra.run.smithi188.stdout:1073 write 0x1634800 thru 0x1635888 (0x1089 bytes) 2024-09-14T08:40:18.262 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:18.289 INFO:teuthology.orchestra.run.smithi188.stdout:1075 write 0x7093600 thru 0x7097548 (0x3f49 bytes) 2024-09-14T08:40:18.303 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:18.306+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:18.303 INFO:teuthology.orchestra.run.smithi188.stdout:1076 trunc from 0x7097600 to 0x1f70600 2024-09-14T08:40:18.388 INFO:teuthology.orchestra.run.smithi188.stdout:1077 write 0xede3e00 thru 0xedf3dd0 (0xffd1 bytes) 2024-09-14T08:40:18.390 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:18.390+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:18.403 INFO:teuthology.orchestra.run.smithi188.stdout:1078 trunc from 0xedf3e00 to 0x93c5600 2024-09-14T08:40:18.432 INFO:teuthology.orchestra.run.smithi188.stdout:1081 trunc from 0x93c5600 to 0x8968600 2024-09-14T08:40:18.446 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:18.446 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:18.451 INFO:teuthology.orchestra.run.smithi188.stdout:1083 read 0x3519000 thru 0x351a310 (0x1311 bytes) 2024-09-14T08:40:18.456 INFO:teuthology.orchestra.run.smithi188.stdout:1085 trunc from 0x8968600 to 0xa2db600 2024-09-14T08:40:18.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:18.476 INFO:teuthology.orchestra.run.smithi188.stdout:1087 trunc from 0xa2db600 to 0x8611000 2024-09-14T08:40:18.507 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:18.510+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:18.512 INFO:teuthology.orchestra.run.smithi188.stdout:1088 trunc from 0x8611000 to 0x20d6e00 2024-09-14T08:40:18.535 INFO:teuthology.orchestra.run.smithi188.stdout:1089 punch from 0x3bde00 to 0x3bf800, (0x1a00 bytes) 2024-09-14T08:40:18.582 INFO:teuthology.orchestra.run.smithi188.stdout:1090 write 0xd758200 thru 0xd76403d (0xbe3e bytes) 2024-09-14T08:40:18.585 INFO:teuthology.orchestra.run.smithi188.stdout:1093 write 0xcd71000 thru 0xcd7bccb (0xaccc bytes) 2024-09-14T08:40:18.585 INFO:teuthology.orchestra.run.smithi188.stdout:1094 read 0x8eac600 thru 0x8eb9853 (0xd254 bytes) 2024-09-14T08:40:18.585 INFO:teuthology.orchestra.run.smithi188.stdout:1096 read 0xa4bc800 thru 0xa4ca3ee (0xdbef bytes) 2024-09-14T08:40:18.586 INFO:teuthology.orchestra.run.smithi188.stdout:1097 trunc from 0xd764200 to 0xd037200 2024-09-14T08:40:18.591 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:18.594+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:18.611 INFO:teuthology.orchestra.run.smithi188.stdout:1099 write 0x2d18200 thru 0x2d1844f (0x250 bytes) 2024-09-14T08:40:18.614 INFO:teuthology.orchestra.run.smithi188.stdout:1100 read 0x89bae00 thru 0x89bd647 (0x2848 bytes) 2024-09-14T08:40:18.614 INFO:teuthology.orchestra.run.smithi188.stdout:1101 read 0x5146600 thru 0x514744a (0xe4b bytes) 2024-09-14T08:40:18.614 INFO:teuthology.orchestra.run.smithi188.stdout:1102 read 0x822e600 thru 0x8234623 (0x6024 bytes) 2024-09-14T08:40:18.615 INFO:teuthology.orchestra.run.smithi188.stdout:1103 trunc from 0xd037200 to 0xca1ce00 2024-09-14T08:40:18.641 INFO:teuthology.orchestra.run.smithi188.stdout:1106 write 0x3a23600 thru 0x3a2f253 (0xbc54 bytes) 2024-09-14T08:40:18.645 INFO:teuthology.orchestra.run.smithi188.stdout:1108 read 0x560a00 thru 0x56baa1 (0xb0a2 bytes) 2024-09-14T08:40:18.646 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:18.646 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:18.647 INFO:teuthology.orchestra.run.smithi188.stdout:1109 read 0x3e43e00 thru 0x3e45cfb (0x1efc bytes) 2024-09-14T08:40:18.648 INFO:teuthology.orchestra.run.smithi188.stdout:1110 punch from 0x525ee00 to 0x5261000, (0x2200 bytes) 2024-09-14T08:40:18.649 INFO:teuthology.orchestra.run.smithi188.stdout:1112 write 0xc8d5800 thru 0xc8e39e7 (0xe1e8 bytes) 2024-09-14T08:40:18.663 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:18.668 INFO:teuthology.orchestra.run.smithi188.stdout:1114 trunc from 0xca1ce00 to 0x1f98e00 2024-09-14T08:40:18.716 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:18.715+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:18.728 INFO:teuthology.orchestra.run.smithi188.stdout:1115 trunc from 0x1f98e00 to 0xac90000 2024-09-14T08:40:18.793 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:18.794+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:18.797 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:18.797 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:18.811 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:18.902 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:18.903+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:18.953 INFO:teuthology.orchestra.run.smithi188.stdout:1116 trunc from 0xac90000 to 0xe741800 2024-09-14T08:40:18.979 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:18.979 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:18.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:18.995 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:18.998+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:19.012 INFO:teuthology.orchestra.run.smithi188.stdout:1118 write 0xec46200 thru 0xec4b3ab (0x51ac bytes) 2024-09-14T08:40:19.014 INFO:teuthology.orchestra.run.smithi188.stdout:1119 read 0x549d200 thru 0x54a922b (0xc02c bytes) 2024-09-14T08:40:19.014 INFO:teuthology.orchestra.run.smithi188.stdout:1120 write 0x36b3000 thru 0x36b5c1a (0x2c1b bytes) 2024-09-14T08:40:19.017 INFO:teuthology.orchestra.run.smithi188.stdout:1122 write 0xe7b8800 thru 0xe7c28c1 (0xa0c2 bytes) 2024-09-14T08:40:19.018 INFO:teuthology.orchestra.run.smithi188.stdout:1124 read 0x1801200 thru 0x180ca9f (0xb8a0 bytes) 2024-09-14T08:40:19.021 INFO:teuthology.orchestra.run.smithi188.stdout:1125 read 0x7516200 thru 0x7517e7e (0x1c7f bytes) 2024-09-14T08:40:19.021 INFO:teuthology.orchestra.run.smithi188.stdout:1127 write 0x704b200 thru 0x7051a03 (0x6804 bytes) 2024-09-14T08:40:19.021 INFO:teuthology.orchestra.run.smithi188.stdout:1128 read 0xab84800 thru 0xab84bd9 (0x3da bytes) 2024-09-14T08:40:19.021 INFO:teuthology.orchestra.run.smithi188.stdout:1129 punch from 0xc2cae00 to 0xc2cc600, (0x1800 bytes) 2024-09-14T08:40:19.022 INFO:teuthology.orchestra.run.smithi188.stdout:1130 read 0x1f68a00 thru 0x1f715f3 (0x8bf4 bytes) 2024-09-14T08:40:19.023 INFO:teuthology.orchestra.run.smithi188.stdout:1133 write 0xd619c00 thru 0xd6201b8 (0x65b9 bytes) 2024-09-14T08:40:19.027 INFO:teuthology.orchestra.run.smithi188.stdout:1134 trunc from 0xec4b400 to 0xcfdd000 2024-09-14T08:40:19.064 INFO:teuthology.orchestra.run.smithi188.stdout:1135 write 0x8469e00 thru 0x846f10a (0x530b bytes) 2024-09-14T08:40:19.065 INFO:teuthology.orchestra.run.smithi188.stdout:1138 read 0xbd8000 thru 0xbe6a46 (0xea47 bytes) 2024-09-14T08:40:19.066 INFO:teuthology.orchestra.run.smithi188.stdout:1139 read 0x1830200 thru 0x183c3c4 (0xc1c5 bytes) 2024-09-14T08:40:19.070 INFO:teuthology.orchestra.run.smithi188.stdout:1142 write 0x8148000 thru 0x814cee3 (0x4ee4 bytes) 2024-09-14T08:40:19.070 INFO:teuthology.orchestra.run.smithi188.stdout:1143 write 0x62e0600 thru 0x62e85db (0x7fdc bytes) 2024-09-14T08:40:19.087 INFO:teuthology.orchestra.run.smithi188.stdout:1146 trunc from 0xcfdd000 to 0x44e3000 2024-09-14T08:40:19.095 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:19.098+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:19.132 INFO:teuthology.orchestra.run.smithi188.stdout:1150 read 0x2f05e00 thru 0x2f0e5a7 (0x87a8 bytes) 2024-09-14T08:40:19.134 INFO:teuthology.orchestra.run.smithi188.stdout:1151 punch from 0xf24e00 to 0xf28600, (0x3800 bytes) 2024-09-14T08:40:19.134 INFO:teuthology.orchestra.run.smithi188.stdout:1156 write 0x3b89e00 thru 0x3b8cb5a (0x2d5b bytes) 2024-09-14T08:40:19.138 INFO:teuthology.orchestra.run.smithi188.stdout:1158 read 0x4276400 thru 0x427c68d (0x628e bytes) 2024-09-14T08:40:19.172 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:19.173 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:19.188 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:19.189 INFO:teuthology.orchestra.run.smithi188.stdout:1161 write 0xc3d4400 thru 0xc3dc48e (0x808f bytes) 2024-09-14T08:40:19.191 INFO:teuthology.orchestra.run.smithi188.stdout:1164 read 0x5784600 thru 0x578c78e (0x818f bytes) 2024-09-14T08:40:19.195 INFO:teuthology.orchestra.run.smithi188.stdout:1165 trunc from 0xc3dc600 to 0xdc48800 2024-09-14T08:40:19.196 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:19.198+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:19.227 INFO:teuthology.orchestra.run.smithi188.stdout:1166 read 0xd651600 thru 0xd65565c (0x405d bytes) 2024-09-14T08:40:19.228 INFO:teuthology.orchestra.run.smithi188.stdout:1168 punch from 0x966fe00 to 0x9674e00, (0x5000 bytes) 2024-09-14T08:40:19.259 INFO:teuthology.orchestra.run.smithi188.stdout:1169 write 0xe398000 thru 0xe3996ae (0x16af bytes) 2024-09-14T08:40:19.264 INFO:teuthology.orchestra.run.smithi188.stdout:1170 write 0x6b81a00 thru 0x6b850d4 (0x36d5 bytes) 2024-09-14T08:40:19.265 INFO:teuthology.orchestra.run.smithi188.stdout:1174 read 0xcebfe00 thru 0xcec3424 (0x3625 bytes) 2024-09-14T08:40:19.265 INFO:teuthology.orchestra.run.smithi188.stdout:1176 read 0x5911c00 thru 0x5915260 (0x3661 bytes) 2024-09-14T08:40:19.265 INFO:teuthology.orchestra.run.smithi188.stdout:1177 punch from 0x6fc4600 to 0x6fd3400, (0xee00 bytes) 2024-09-14T08:40:19.265 INFO:teuthology.orchestra.run.smithi188.stdout:1178 write 0x4cb4600 thru 0x4cb9a23 (0x5424 bytes) 2024-09-14T08:40:19.266 INFO:teuthology.orchestra.run.smithi188.stdout:1180 punch from 0x2620000 to 0x262a800, (0xa800 bytes) 2024-09-14T08:40:19.267 INFO:teuthology.orchestra.run.smithi188.stdout:1181 punch from 0x2490800 to 0x2490e00, (0x600 bytes) 2024-09-14T08:40:19.267 INFO:teuthology.orchestra.run.smithi188.stdout:1182 write 0x9ad7200 thru 0x9ae20af (0xaeb0 bytes) 2024-09-14T08:40:19.268 INFO:teuthology.orchestra.run.smithi188.stdout:1185 clone 9 order 19 su 262144 sc 5 2024-09-14T08:40:19.287 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:19.297 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:19.298+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:19.314 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:19.314 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:19.330 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:19.398 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:19.398+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:19.412 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:19.430 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:19.431 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:19.447 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:19.447 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:19.468 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:19.468 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:19.489 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:19.496 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:19.496 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:19.496 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:19.496 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:19.496 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:19.498 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:19.502+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:19.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:19.510 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:19.511 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:19.513 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:19.514 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:19.600 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:19.602+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:19.628 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:19.628 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:19.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33403 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3560448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.352295206000001, 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065276109999999998, 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33403 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277827+0000", 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.23e-07 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277830+0000", 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277839+0000", 2024-09-14T08:40:19.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277846+0000", 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1590000000000004e-06 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342820+0000", 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064974064999999998 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342954+0000", 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133509 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343102+0000", 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000148539 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33404 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3571712~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.352263743999998, 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065555713000000002, 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33404 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.634 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277861+0000", 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9790000000000002e-06 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277881+0000", 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9463999999999999e-05 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277889+0000", 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7190000000000001e-06 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343177+0000", 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065288760000000001 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343279+0000", 2024-09-14T08:40:19.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101974 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343414+0000", 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013411 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33405 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.352222433000001, 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065812103999999996, 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33405 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277900+0000", 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277922+0000", 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1540999999999999e-05 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277932+0000", 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0587999999999999e-05 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277940+0000", 2024-09-14T08:40:19.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5360000000000004e-06 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343480+0000", 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065539753000000006 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343581+0000", 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101005 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343711+0000", 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013069500000000001 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.352170300000001, 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.643 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:19.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.352141503999999, 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.648 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:40:19.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.352112685000002, 2024-09-14T08:40:19.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:40:19.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.352084355999999, 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:19.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.352055155999999, 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:19.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:40:19.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.352023148000001, 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.666 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:19.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:40:19.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:40:19.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.351993872000001, 2024-09-14T08:40:19.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:40:19.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.351964206000002, 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:40:19.678 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.351935662999999, 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.679 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:40:19.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:40:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.351907357000002, 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:40:19.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.351862090000001, 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.688 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:40:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:40:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:40:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.351830467999999, 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:40:19.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:40:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.351772656000001, 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:40:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:40:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:40:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.351704643000001, 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.351669270999999, 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:40:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:40:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.351634871999998, 2024-09-14T08:40:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:40:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.3245643190000003, 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:40:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:40:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:19.723 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:19.724 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:19.725 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:19.726+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:19.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:40:19.825 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:19.823+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:19.857 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:19.857 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:19.857 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:19.857 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:19.872 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:19.914 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone8 from 0xe399800 (overlap 0x674800) to 0x0 2024-09-14T08:40:19.925 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:19.926+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:20.000 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:20.000 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:20.000 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:20.000 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:20.000 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:20.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:20.027 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:20.027+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:20.128 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:20.130+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:20.184 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.940447096, 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:40:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.940385082999999, 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:40:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:40:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:40:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:40:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.940318753, 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:40:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:40:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:40:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.940263293000001, 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:40:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:40:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:40:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:40:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.940203672999999, 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:40:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.940122132999999, 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:40:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.940065805, 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:40:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:40:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939994309999999, 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:40:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:40:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939921438999999, 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:40:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:40:20.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:40:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939879226999999, 2024-09-14T08:40:20.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:20.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:40:20.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939849397, 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.233 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:40:20.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.9398211, 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.238 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939780004999999, 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.243 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.247 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939750974999999, 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:20.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939722491000001, 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.252 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:40:20.256 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939694351, 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.257 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:20.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:40:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939665654999999, 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:40:20.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:40:20.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:20.266 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939636898, 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:20.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:40:20.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939608850999999, 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:20.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:40:20.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939578873999999, 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.276 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:40:20.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.280 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:20.282 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:20.282 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:20.282+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:20.383 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:20.386+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:20.456 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:20.456 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:20.456 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:20.456 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:20.470 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:20.483 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:20.483+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:20.583 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-14T08:40:20.584 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:20.586+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:20.641 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:20.642 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:20.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:20.685 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:20.683+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:20.721 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:40:20.721 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:40:20.722 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T08:40:20.722 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T08:40:20.744 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:40:20.786 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:20.786+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:20.832 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.949337652000001, 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:40:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.938085617, 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:40:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:40:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.937225732, 2024-09-14T08:40:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:40:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.936919107, 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:40:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.936515772, 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:40:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:40:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.936112069, 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:40:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.861 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.861 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:20.861 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.935761322999999, 2024-09-14T08:40:20.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:40:20.864 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.864 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.864 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.864 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:40:20.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:40:20.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.935375050999999, 2024-09-14T08:40:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:20.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:40:20.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.935184518, 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.873 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:40:20.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.877 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.93467779, 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.934351718, 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:40:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:40:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:40:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.934042106, 2024-09-14T08:40:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.933546564, 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:40:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.933230805999999, 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:40:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:40:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.901 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.932743370000001, 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:40:20.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:40:20.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:40:20.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.906 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.932393358000001, 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:40:20.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:40:20.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.931602239, 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:40:20.911 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:40:20.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:40:20.915 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.931193179999999, 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:40:20.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.928560492999999, 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:40:20.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:40:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:40:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.1020698519999996, 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:40:20.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:40:20.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:40:20.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:40:20.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:20.932 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:20.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:20.934 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:20.934+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:21.035 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:21.035+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:21.100 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:40:21.100 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:21.100 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 61, 2024-09-14T08:40:21.100 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "57b092b7-5550-41a0-8f78-531de0e7c469", 2024-09-14T08:40:21.100 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-09-14T08:38:48.610112+0000", 2024-09-14T08:40:21.100 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-09-14T08:40:20.738996+0000", 2024-09-14T08:40:21.100 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-09-14T08:39:51.541202+0000", 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-09-14T08:38:51.099971+0000", 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5806080, 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "nodeep-scrub", 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "noscrub", 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:21.101 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 5, 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 3, 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 6, 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "luminous", 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-09-14T08:40:21.102 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:00.306403+0000", 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:21.103 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:21.104 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "15", 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-09-14T08:40:21.105 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:21.106 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:21.107 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 6.059999942779541, 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 6.059999942779541, 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-09-14T08:40:21.109 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:06.370159+0000", 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:21.110 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:21.111 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 2, 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 19, 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:21.112 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:21.113 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:21.114 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.2699999809265137, 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.2699999809265137, 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.82999998331069946, 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T08:40:21.115 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "pool_client.0", 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:16.437713+0000", 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:21.116 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-09-14T08:40:21.117 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "60", 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:21.118 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 11, 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 60, 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:21.119 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:21.120 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.121 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 1.7000000476837158, 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 1.7000000476837158, 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.82999998331069946, 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:21.122 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d", 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 0, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 41, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:21.123 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6800", 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6801", 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6802", 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6803", 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6806", 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6807", 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6804", 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6805", 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:21.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6801/2282442554", 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6803/2282442554", 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6807/2282442554", 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6805/2282442554", 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: "exists" 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:40:21.128 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "09ba1390-a0d1-48a3-9342-5f5aa64e2217", 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 57, 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.129 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6808", 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6809", 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6810", 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6811", 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6814", 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6815", 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:21.132 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6812", 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6813", 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6809/2739597491", 2024-09-14T08:40:21.133 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6811/2739597491", 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6815/2739597491", 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6813/2739597491", 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "a7cd8610-d8e1-44e7-a423-4419cad90d8e", 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:21.134 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 57, 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6816", 2024-09-14T08:40:21.135 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817", 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.136 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818", 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819", 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6822", 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6823", 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:21.138 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6820", 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6821", 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.139 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6817/1157205327", 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6819/1157205327", 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6823/1157205327", 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6821/1157205327", 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "1339fb05-5d1c-4c0a-8388-314119543bb6", 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:21.140 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 57, 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6808", 2024-09-14T08:40:21.141 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6809", 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.142 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6810", 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6811", 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.143 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6814", 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6815", 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6812", 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6813", 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6809/1656791341", 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6811/1656791341", 2024-09-14T08:40:21.145 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6815/1656791341", 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6813/1656791341", 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "0cebba54-9019-47bd-870f-306664e390e1", 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:21.146 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 57, 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6816", 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:21.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6817", 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6818", 2024-09-14T08:40:21.148 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6819", 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.149 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6822", 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6823", 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.150 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6820", 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6821", 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6817/1186206237", 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6819/1186206237", 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6823/1186206237", 2024-09-14T08:40:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6821/1186206237", 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "e571e73b-0e9d-417d-b01c-59b651016763", 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0.1356353759765625, 2024-09-14T08:40:21.152 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 45, 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6800", 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6801", 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6802", 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6803", 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6806", 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:21.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6807", 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6804", 2024-09-14T08:40:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6805", 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6801/796623465", 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6803/796623465", 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6807/796623465", 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6805/796623465", 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:21.158 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.174731+0000", 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 41 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.475467+0000", 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.159 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.606174+0000", 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:21.160 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.835957+0000", 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.753547+0000", 2024-09-14T08:40:21.161 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.284212+0000", 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [ 2024-09-14T08:40:21.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "1.0", 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: 4 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: 0 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [ 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 4, 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 0 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.a", 2024-09-14T08:40:21.164 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 4, 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 1 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 5, 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 2 2024-09-14T08:40:21.165 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.166 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.166 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.13", 2024-09-14T08:40:21.166 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:21.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.166 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 3, 2024-09-14T08:40:21.168 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 0 2024-09-14T08:40:21.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.168 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.168 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:21.168 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-09-14T08:40:21.168 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [ 2024-09-14T08:40:21.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.168 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: 2 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: 5 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.169 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.13", 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: 5, 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-09-14T08:40:21.170 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-09-14T08:40:21.171 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-09-14T08:40:21.172 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-09-14T08:40:21.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.172 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:21.174 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:21.174 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:21.174 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:21.175 INFO:tasks.thrashosds.thrasher:j is {'epoch': 61, 'fsid': '57b092b7-5550-41a0-8f78-531de0e7c469', 'created': '2024-09-14T08:38:48.610112+0000', 'modified': '2024-09-14T08:40:20.738996+0000', 'last_up_change': '2024-09-14T08:39:51.541202+0000', 'last_in_change': '2024-09-14T08:38:51.099971+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T08:39:00.306403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T08:39:06.370159+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.2699999809265137, 'score_stable': 2.2699999809265137, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T08:39:16.437713+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 11, 'snap_epoch': 60, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7000000476837158, 'score_stable': 1.7000000476837158, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}], 'osds': [{'osd': 0, 'uuid': '2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 21, 'down_at': 41, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 2282442554}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 2282442554}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 2282442554}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 2282442554}]}, 'public_addr': '172.21.15.89:6801/2282442554', 'cluster_addr': '172.21.15.89:6803/2282442554', 'heartbeat_back_addr': '172.21.15.89:6807/2282442554', 'heartbeat_front_addr': '172.21.15.89:6805/2282442554', 'state': ['exists']}, {'osd': 1, 'uuid': '09ba1390-a0d1-48a3-9342-5f5aa64e2217', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6808', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6809', 'nonce': 2739597491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6810', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6811', 'nonce': 2739597491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6814', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6815', 'nonce': 2739597491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6812', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6813', 'nonce': 2739597491}]}, 'public_addr': '172.21.15.89:6809/2739597491', 'cluster_addr': '172.21.15.89:6811/2739597491', 'heartbeat_back_addr': '172.21.15.89:6815/2739597491', 'heartbeat_front_addr': '172.21.15.89:6813/2739597491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a7cd8610-d8e1-44e7-a423-4419cad90d8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6816', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6817', 'nonce': 1157205327}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6818', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 1157205327}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6822', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6823', 'nonce': 1157205327}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6820', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6821', 'nonce': 1157205327}]}, 'public_addr': '172.21.15.89:6817/1157205327', 'cluster_addr': '172.21.15.89:6819/1157205327', 'heartbeat_back_addr': '172.21.15.89:6823/1157205327', 'heartbeat_front_addr': '172.21.15.89:6821/1157205327', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1339fb05-5d1c-4c0a-8388-314119543bb6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6808', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6809', 'nonce': 1656791341}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6810', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6811', 'nonce': 1656791341}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6814', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6815', 'nonce': 1656791341}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6812', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6813', 'nonce': 1656791341}]}, 'public_addr': '172.21.15.112:6809/1656791341', 'cluster_addr': '172.21.15.112:6811/1656791341', 'heartbeat_back_addr': '172.21.15.112:6815/1656791341', 'heartbeat_front_addr': '172.21.15.112:6813/1656791341', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0cebba54-9019-47bd-870f-306664e390e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6816', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6817', 'nonce': 1186206237}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6818', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6819', 'nonce': 1186206237}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6822', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6823', 'nonce': 1186206237}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6820', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6821', 'nonce': 1186206237}]}, 'public_addr': '172.21.15.112:6817/1186206237', 'cluster_addr': '172.21.15.112:6819/1186206237', 'heartbeat_back_addr': '172.21.15.112:6823/1186206237', 'heartbeat_front_addr': '172.21.15.112:6821/1186206237', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e571e73b-0e9d-417d-b01c-59b651016763', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1356353759765625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 796623465}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 796623465}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 796623465}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 796623465}]}, 'public_addr': '172.21.15.112:6801/796623465', 'cluster_addr': '172.21.15.112:6803/796623465', 'heartbeat_back_addr': '172.21.15.112:6807/796623465', 'heartbeat_front_addr': '172.21.15.112:6805/796623465', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.174731+0000', 'dead_epoch': 41}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.475467+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.606174+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.835957+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.753547+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.284212+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '1.0', 'osds': [2, 4]}, {'pgid': '3.9', 'osds': [1, 0]}], 'pg_upmap_items': [{'pgid': '3.9', 'mappings': [{'from': 4, 'to': 0}]}, {'pgid': '3.a', 'mappings': [{'from': 4, 'to': 1}]}, {'pgid': '3.10', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.13', 'mappings': [{'from': 3, 'to': 0}]}], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '3.9', 'osds': [1, 2]}, {'pgid': '3.10', 'osds': [2, 5]}, {'pgid': '3.13', 'osds': [5, 3]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T08:40:21.175 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 1.0 2024-09-14T08:40:21.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 1.0 2024-09-14T08:40:21.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:21.176 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:21.174+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:21.274 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:21.275+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:21.343 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:21.343 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:21.361 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:21.407 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:21.410+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:21.476 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:21.478+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:21.491 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:21.491 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54084 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5699584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.415399789999999, 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093000530999999997, 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54084 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:21.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078497+0000", 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078500+0000", 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1360000000000001e-06 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078509+0000", 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9490000000000002e-06 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078516+0000", 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.233e-06 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.170871+0000", 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092354443999999994 2024-09-14T08:40:21.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171110+0000", 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000239349 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171497+0000", 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038669300000000002 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54085 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5710848~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.415369785999999, 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093690545, 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54085 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078527+0000", 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:21.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078530+0000", 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8660000000000002e-06 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078539+0000", 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9560000000000003e-06 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078546+0000", 2024-09-14T08:40:21.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1489999999999997e-06 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171585+0000", 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093038914 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171820+0000", 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000235558 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172217+0000", 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039639900000000002 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54086 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5722112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.415340256, 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094383724000000002, 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54086 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078557+0000", 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078560+0000", 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-06 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078571+0000", 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0951999999999999e-05 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078579+0000", 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7760000000000003e-06 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172313+0000", 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093733343999999996 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172558+0000", 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024562199999999997 2024-09-14T08:40:21.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172940+0000", 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038131999999999999 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54087 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5644288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.415306235999999, 2024-09-14T08:40:21.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095045525000000006, 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54087 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078591+0000", 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078594+0000", 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078603+0000", 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3759999999999997e-06 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078610+0000", 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0160000000000003e-06 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173032+0000", 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094421672999999998 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173265+0000", 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000233265 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173635+0000", 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037049899999999999 2024-09-14T08:40:21.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54088 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5733376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.415275766000001, 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095706712999999999, 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54088 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078621+0000", 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078624+0000", 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078633+0000", 2024-09-14T08:40:21.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3950000000000007e-06 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078641+0000", 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4900000000000003e-06 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173728+0000", 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095086680000000007 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173954+0000", 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022685000000000001 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174327+0000", 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037261800000000002 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.514 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.415244949000002, 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.415156851999999, 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:21.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:21.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.415089455, 2024-09-14T08:40:21.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:21.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.527 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.415015758999999, 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:21.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.414940287, 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:21.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.414883082999999, 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.537 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:21.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:21.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:21.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.414824199000002, 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:21.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.545 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.414759273000001, 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.414697822000001, 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.550 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.414638287999999, 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:21.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:21.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.414578978000002, 2024-09-14T08:40:21.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.563 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.414506945999999, 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.567 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56620 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5999616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.888313898, 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092334608999999998, 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56620 2024-09-14T08:40:21.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605583+0000", 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605586+0000", 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0060000000000001e-06 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605595+0000", 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605602+0000", 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2760000000000003e-06 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697625+0000", 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092022458000000001 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697749+0000", 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124201 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697917+0000", 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016798900000000001 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56621 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 6010880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.888283638000001, 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092668125000000004, 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.572 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56621 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605613+0000", 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605616+0000", 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.106e-06 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605627+0000", 2024-09-14T08:40:21.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1026000000000001e-05 2024-09-14T08:40:21.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605635+0000", 2024-09-14T08:40:21.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3289999999999996e-06 2024-09-14T08:40:21.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697992+0000", 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092357106999999994 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698109+0000", 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117615 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698281+0000", 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017125199999999999 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.577 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56622 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 6022144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.888251178000001, 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092976195999999997, 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:21.578 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56622 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605646+0000", 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605649+0000", 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0730000000000001e-06 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605658+0000", 2024-09-14T08:40:21.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9090000000000006e-06 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605667+0000", 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9160000000000007e-06 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698330+0000", 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092663841999999996 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698447+0000", 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116921 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698621+0000", 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017383200000000001 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:21.582 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:21.583 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:21.584 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:21.586+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:21.584 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:21.685 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:21.686+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:21.702 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:21.724 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6569 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716748+0000", 2024-09-14T08:40:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.009549887, 2024-09-14T08:40:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0095735809999999994, 2024-09-14T08:40:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6569 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716748+0000", 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716748+0000", 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716749+0000", 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4999999999999998e-07 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716751+0000", 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1160000000000002e-06 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716757+0000", 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2219999999999999e-06 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716762+0000", 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6570 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716769+0000", 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0095291939999999995, 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096247480000000007, 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6570 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716769+0000", 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716769+0000", 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716770+0000", 2024-09-14T08:40:21.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716775+0000", 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.463e-06 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716783+0000", 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716787+0000", 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6539999999999998e-06 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6571 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716807+0000", 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0094909460000000001, 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096431139999999995, 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6571 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716807+0000", 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716807+0000", 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716808+0000", 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8800000000000002e-07 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716810+0000", 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1430000000000001e-06 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716818+0000", 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1419999999999993e-06 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716823+0000", 2024-09-14T08:40:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0200000000000002e-06 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6572 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716830+0000", 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.009468443, 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096708109999999996, 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6572 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716830+0000", 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716830+0000", 2024-09-14T08:40:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716830+0000", 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.65e-07 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716832+0000", 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.756e-06 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716839+0000", 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7599999999999997e-06 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716843+0000", 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5759999999999999e-06 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6573 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716849+0000", 2024-09-14T08:40:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.009448962, 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096999540000000002, 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6573 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716849+0000", 2024-09-14T08:40:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716849+0000", 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716850+0000", 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1e-07 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716851+0000", 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6700000000000001e-06 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716857+0000", 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.852e-06 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716861+0000", 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3170000000000003e-06 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6574 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716868+0000", 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0094303900000000003, 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097295460000000004, 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6574 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716868+0000", 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716868+0000", 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716868+0000", 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1699999999999999e-07 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716870+0000", 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9089999999999998e-06 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716876+0000", 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2589999999999997e-06 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716891+0000", 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4158000000000001e-05 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6575 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716899+0000", 2024-09-14T08:40:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0093995580000000006, 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097432760000000004, 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6575 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716899+0000", 2024-09-14T08:40:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716899+0000", 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716899+0000", 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7899999999999998e-07 2024-09-14T08:40:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716902+0000", 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.305e-06 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716908+0000", 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7959999999999998e-06 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716916+0000", 2024-09-14T08:40:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5449999999999998e-06 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6576 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716923+0000", 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0093753829999999993, 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097635129999999997, 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6576 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716923+0000", 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716923+0000", 2024-09-14T08:40:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716923+0000", 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1799999999999995e-07 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716930+0000", 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9070000000000001e-06 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716937+0000", 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9460000000000001e-06 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716942+0000", 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9679999999999997e-06 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6577 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716950+0000", 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0093486750000000007, 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097636939999999998, 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6577 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716950+0000", 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716950+0000", 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716950+0000", 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.08e-07 2024-09-14T08:40:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716952+0000", 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0729999999999999e-06 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716959+0000", 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4359999999999999e-06 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716963+0000", 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7530000000000001e-06 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6578 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716970+0000", 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0093279000000000001, 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097846110000000003, 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6578 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716970+0000", 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716970+0000", 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716971+0000", 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.03e-07 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716973+0000", 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9360000000000002e-06 2024-09-14T08:40:21.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716979+0000", 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3500000000000002e-06 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716984+0000", 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6809999999999997e-06 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.760 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6579 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.760 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716990+0000", 2024-09-14T08:40:21.760 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0093079319999999997, 2024-09-14T08:40:21.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097893230000000008, 2024-09-14T08:40:21.760 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.760 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.760 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6579 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716990+0000", 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716990+0000", 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716991+0000", 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5900000000000003e-07 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716993+0000", 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9740000000000001e-06 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716999+0000", 2024-09-14T08:40:21.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2430000000000002e-06 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717004+0000", 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9230000000000001e-06 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6580 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717011+0000", 2024-09-14T08:40:21.763 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0092875240000000001, 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097929760000000001, 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6580 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717011+0000", 2024-09-14T08:40:21.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717011+0000", 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717011+0000", 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717013+0000", 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717019+0000", 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0129999999999999e-06 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717024+0000", 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7570000000000004e-06 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.766 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6581 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717031+0000", 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0092677609999999994, 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097973920000000003, 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6581 2024-09-14T08:40:21.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717031+0000", 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717031+0000", 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717031+0000", 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717033+0000", 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0150000000000002e-06 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717039+0000", 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4219999999999997e-06 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717044+0000", 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6582 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717050+0000", 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0092479669999999993, 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0098016809999999996, 2024-09-14T08:40:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6582 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717050+0000", 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717050+0000", 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717051+0000", 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.72e-07 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717057+0000", 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5490000000000003e-06 2024-09-14T08:40:21.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717066+0000", 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3739999999999998e-06 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717071+0000", 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0429999999999998e-06 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6583 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717085+0000", 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0092135940000000003, 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.009791213, 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6583 2024-09-14T08:40:21.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717085+0000", 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717085+0000", 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717085+0000", 2024-09-14T08:40:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.68e-07 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717087+0000", 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0329999999999998e-06 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717094+0000", 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2840000000000003e-06 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717104+0000", 2024-09-14T08:40:21.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9089999999999995e-06 2024-09-14T08:40:21.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.777 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.780 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6584 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.780 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717111+0000", 2024-09-14T08:40:21.780 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0091872180000000005, 2024-09-14T08:40:21.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097887319999999996, 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6584 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717111+0000", 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717111+0000", 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717112+0000", 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1699999999999998e-07 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717114+0000", 2024-09-14T08:40:21.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1090000000000001e-06 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717120+0000", 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2709999999999998e-06 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717126+0000", 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7690000000000002e-06 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6585 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717133+0000", 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0091649149999999992, 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097903939999999991, 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6585 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.784 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717133+0000", 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717133+0000", 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717134+0000", 2024-09-14T08:40:21.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4400000000000001e-07 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717136+0000", 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0059999999999999e-06 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717142+0000", 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5180000000000001e-06 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717147+0000", 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6586 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717154+0000", 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0091441119999999994, 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097965959999999994, 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6586 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717154+0000", 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717154+0000", 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717155+0000", 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8700000000000001e-07 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717156+0000", 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.889e-06 2024-09-14T08:40:21.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717163+0000", 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2160000000000003e-06 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717168+0000", 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4500000000000003e-06 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.790 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6587 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717175+0000", 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.009123094, 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097995019999999999, 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6587 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717175+0000", 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717175+0000", 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717176+0000", 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4300000000000003e-07 2024-09-14T08:40:21.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717186+0000", 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0268999999999999e-05 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717194+0000", 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717200+0000", 2024-09-14T08:40:21.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2660000000000001e-06 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6556 3.0 3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:8 [read 977920~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716392+0000", 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0099063420000000003, 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010610891000000001, 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6556 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716392+0000", 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716392+0000", 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716392+0000", 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0999999999999999e-07 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716394+0000", 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0310000000000001e-06 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716401+0000", 2024-09-14T08:40:21.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3249999999999996e-06 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716411+0000", 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8169999999999994e-06 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.726980+0000", 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010569656 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6589 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717207+0000", 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0090910339999999996, 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0098224209999999996, 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6589 2024-09-14T08:40:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717207+0000", 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717207+0000", 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717208+0000", 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717210+0000", 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717220+0000", 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0283e-05 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717225+0000", 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0289999999999996e-06 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6557 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716418+0000", 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0098805730000000001, 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010635978000000001, 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.801 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6557 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716418+0000", 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716418+0000", 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716418+0000", 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0999999999999999e-07 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716420+0000", 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0559999999999999e-06 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716430+0000", 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3889999999999994e-06 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716435+0000", 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9699999999999998e-06 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6591 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717233+0000", 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0090657979999999999, 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0098454560000000007, 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6591 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.805 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717233+0000", 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717233+0000", 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717233+0000", 2024-09-14T08:40:21.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:40:21.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717235+0000", 2024-09-14T08:40:21.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:40:21.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717241+0000", 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4729999999999997e-06 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717246+0000", 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7620000000000003e-06 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6558 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.808 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716442+0000", 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0098561949999999999, 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010659668000000001, 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6558 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716442+0000", 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716442+0000", 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716443+0000", 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999998e-07 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716448+0000", 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4029999999999998e-06 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716455+0000", 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716460+0000", 2024-09-14T08:40:21.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7180000000000004e-06 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6593 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.717253+0000", 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0090452769999999991, 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0098725540000000004, 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.812 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6593 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717253+0000", 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717253+0000", 2024-09-14T08:40:21.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717253+0000", 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717255+0000", 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8759999999999999e-06 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717261+0000", 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0870000000000003e-06 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.717266+0000", 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5990000000000004e-06 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6559 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.815 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716467+0000", 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0098313749999999998, 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010682295, 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6559 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716467+0000", 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716467+0000", 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716467+0000", 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4999999999999998e-07 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716469+0000", 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0080000000000001e-06 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716485+0000", 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5704000000000001e-05 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716491+0000", 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9399999999999999e-06 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.818 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6560 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716511+0000", 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0097871799999999995, 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662130000000001, 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.819 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6560 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716511+0000", 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716511+0000", 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716512+0000", 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716514+0000", 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716522+0000", 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8990000000000001e-06 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716527+0000", 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2379999999999997e-06 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6561 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716535+0000", 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0097631279999999994, 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010661811, 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.822 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6561 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716535+0000", 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716535+0000", 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716536+0000", 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999998e-07 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716538+0000", 2024-09-14T08:40:21.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.294e-06 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716545+0000", 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0650000000000001e-06 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716550+0000", 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.865e-06 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.825 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6562 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716559+0000", 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0097395810000000006, 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662402, 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6562 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716559+0000", 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716559+0000", 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716559+0000", 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4700000000000002e-07 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716561+0000", 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0219999999999999e-06 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716571+0000", 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4460000000000007e-06 2024-09-14T08:40:21.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716576+0000", 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2800000000000003e-06 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6563 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716599+0000", 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0096995720000000001, 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010646039, 2024-09-14T08:40:21.829 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6563 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716599+0000", 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716599+0000", 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716599+0000", 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1500000000000004e-07 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716602+0000", 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2560000000000001e-06 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716609+0000", 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.401e-06 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716614+0000", 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.361e-06 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6564 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716622+0000", 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0096760579999999995, 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010646373000000001, 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6564 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716622+0000", 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716622+0000", 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716623+0000", 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:40:21.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716625+0000", 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0030000000000001e-06 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716631+0000", 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3060000000000003e-06 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716639+0000", 2024-09-14T08:40:21.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6879999999999999e-06 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6565 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716647+0000", 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0096515079999999996, 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010646767, 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.836 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6565 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716647+0000", 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716647+0000", 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716647+0000", 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4099999999999999e-07 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716655+0000", 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6760000000000007e-06 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716666+0000", 2024-09-14T08:40:21.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0601000000000001e-05 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716676+0000", 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0105000000000001e-05 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6566 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716684+0000", 2024-09-14T08:40:21.839 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0096147030000000005, 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010636127, 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6566 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716684+0000", 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716684+0000", 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716684+0000", 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5999999999999999e-07 2024-09-14T08:40:21.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716686+0000", 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1950000000000002e-06 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716693+0000", 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.686e-06 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716698+0000", 2024-09-14T08:40:21.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9350000000000002e-06 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6567 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716705+0000", 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.009593519, 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010638684000000001, 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.843 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6567 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716705+0000", 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716705+0000", 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716705+0000", 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716707+0000", 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.88e-06 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716713+0000", 2024-09-14T08:40:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1700000000000002e-06 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716718+0000", 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:6568 3.0 3.3cac0060 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:21.716725+0000", 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0095733109999999993, 2024-09-14T08:40:21.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010648657000000001, 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6568 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716725+0000", 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716725+0000", 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716725+0000", 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.34e-07 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716727+0000", 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9920000000000002e-06 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716737+0000", 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999993e-06 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:21.716741+0000", 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7659999999999998e-06 2024-09-14T08:40:21.849 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.850 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:21.850 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.850 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:21.850 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:21.850 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 35 2024-09-14T08:40:21.850 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:21.851 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:21.851 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:21.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:21.853 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:21.853 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:21.853 INFO:teuthology.orchestra.run.smithi089.stderr:clear 1.0 pg_upmap mapping 2024-09-14T08:40:21.853 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:21.855 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:21.855 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:21.855 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:21.856 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:21.856 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:21.856 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:21.857 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:21.854+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:21.952 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:21.954+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:22.017 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:22.018 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:22.032 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:22.053 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:22.054+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:22.154 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:22.154+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:22.163 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:22.164 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:22.184 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:22.254 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:22.255+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:22.314 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:22.314 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:22.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:22.356 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:22.358+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:22.456 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:22.458+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:22.504 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:22.504 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:22.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:22.557 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:22.558+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:22.641 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:22.641 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:22.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:22.657 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:22.662+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:22.758 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:22.758+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:22.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:40:22.801 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:22.801 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:22.812 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:22.859 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:22.862+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:22.960 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:22.962+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:22.988 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:22.988 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:23.005 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:23.091 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:23.094+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:23.162 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:23.162+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:23.177 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:23.177 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:23.196 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:23.263 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:23.263+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:23.363 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:23.366+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:23.365 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:23.365 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:23.378 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:23.475 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:23.478+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:23.558 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:23.558 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:23.566 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:23.567+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:23.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:23.666 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:23.666+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:23.744 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:23.744 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:23.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:23.767 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:23.767+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:40:23.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:23.867 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:23.870+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:23.932 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:23.932 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:23.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:23.991 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:23.991 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:23.994+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:24.009 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:24.009 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:24.027 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:24.027 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:24.048 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:24.069 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:24.070+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:24.073 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:24.073 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:24.093 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:24.096 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:24.096 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:24.154 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:24.155 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:24.169 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:24.211 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:24.214+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:24.270 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:24.271+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:24.335 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:24.335 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54084 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5699584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259577660000001, 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093000530999999997, 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54084 2024-09-14T08:40:24.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078496+0000", 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078497+0000", 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2699999999999999e-07 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078500+0000", 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1360000000000001e-06 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078509+0000", 2024-09-14T08:40:24.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9490000000000002e-06 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078516+0000", 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.233e-06 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.170871+0000", 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092354443999999994 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171110+0000", 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000239349 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171497+0000", 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038669300000000002 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54085 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5710848~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.340 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259547655999999, 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093690545, 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54085 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078526+0000", 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078527+0000", 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078530+0000", 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8660000000000002e-06 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078539+0000", 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9560000000000003e-06 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078546+0000", 2024-09-14T08:40:24.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1489999999999997e-06 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171585+0000", 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093038914 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.171820+0000", 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000235558 2024-09-14T08:40:24.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172217+0000", 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039639900000000002 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54086 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5722112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259518126, 2024-09-14T08:40:24.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094383724000000002, 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54086 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:24.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078556+0000", 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078557+0000", 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078560+0000", 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-06 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078571+0000", 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0951999999999999e-05 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078579+0000", 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7760000000000003e-06 2024-09-14T08:40:24.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172313+0000", 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.093733343999999996 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172558+0000", 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024562199999999997 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.172940+0000", 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038131999999999999 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54087 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5644288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259484105999999, 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095045525000000006, 2024-09-14T08:40:24.350 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54087 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078590+0000", 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078591+0000", 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078594+0000", 2024-09-14T08:40:24.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078603+0000", 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3759999999999997e-06 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078610+0000", 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0160000000000003e-06 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173032+0000", 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094421672999999998 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173265+0000", 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000233265 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173635+0000", 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037049899999999999 2024-09-14T08:40:24.354 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54088 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5733376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259453636, 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095706712999999999, 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.355 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54088 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078620+0000", 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078621+0000", 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0999999999999998e-07 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078624+0000", 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078633+0000", 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3950000000000007e-06 2024-09-14T08:40:24.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078641+0000", 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4900000000000003e-06 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173728+0000", 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095086680000000007 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.173954+0000", 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022685000000000001 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174327+0000", 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037261800000000002 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:24.359 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259422819000001, 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:24.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:24.363 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259334721999998, 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.364 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:24.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:24.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.368 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259267325, 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.369 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:24.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:24.373 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259193628999999, 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259118157, 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.378 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:24.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.382 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259060952999999, 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:24.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:24.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.259002069000001, 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.387 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:24.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.391 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.258937143000001, 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:24.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.258875692, 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.396 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.400 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.258816157999998, 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:24.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.258756848000001, 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.405 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:24.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.258684815999999, 2024-09-14T08:40:24.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:24.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.415 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56620 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5999616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.732491767999999, 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092334608999999998, 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56620 2024-09-14T08:40:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605582+0000", 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605583+0000", 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605586+0000", 2024-09-14T08:40:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0060000000000001e-06 2024-09-14T08:40:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605595+0000", 2024-09-14T08:40:24.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605602+0000", 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2760000000000003e-06 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697625+0000", 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092022458000000001 2024-09-14T08:40:24.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697749+0000", 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124201 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697917+0000", 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016798900000000001 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.421 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56621 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 6010880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.732461508, 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092668125000000004, 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56621 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605612+0000", 2024-09-14T08:40:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605613+0000", 2024-09-14T08:40:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:40:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605616+0000", 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.106e-06 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605627+0000", 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1026000000000001e-05 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605635+0000", 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3289999999999996e-06 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.697992+0000", 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092357106999999994 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698109+0000", 2024-09-14T08:40:24.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117615 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698281+0000", 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017125199999999999 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.427 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:56622 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 6022144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.732429048, 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092976195999999997, 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56622 2024-09-14T08:40:24.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:24.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605645+0000", 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605646+0000", 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605649+0000", 2024-09-14T08:40:24.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0730000000000001e-06 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605658+0000", 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9090000000000006e-06 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.605667+0000", 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9160000000000007e-06 2024-09-14T08:40:24.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698330+0000", 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.092663841999999996 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698447+0000", 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116921 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:24.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:24.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:24.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.698621+0000", 2024-09-14T08:40:24.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017383200000000001 2024-09-14T08:40:24.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.433 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:24.433 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:24.433 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:24.435 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:24.438+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:24.435 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:24.536 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:24.535+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:24.584 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:24.585 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:24.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:24.646 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:24.647+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:24.738 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:24.738+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:24.775 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:24.775 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:24.775 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:24.775 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:24.775 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:24.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:24.839 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:24.842+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:24.927 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31797 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3304448~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.003285931000001, 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071016060000000006, 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.928 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31797 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0699999999999997e-07 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925536+0000", 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.368e-06 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925543+0000", 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.781e-06 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925548+0000", 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996245+0000", 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070697276000000003 2024-09-14T08:40:24.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996352+0000", 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107054 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996549+0000", 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000196942 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31798 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3306496~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.003263911000001, 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071397830999999995, 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31798 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.933 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925558+0000", 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2069999999999998e-06 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925564+0000", 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6290000000000004e-06 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925569+0000", 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.164e-06 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996603+0000", 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071033712999999998 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996708+0000", 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010466700000000001 2024-09-14T08:40:24.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996953+0000", 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000244959 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31799 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3315712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.003242554, 2024-09-14T08:40:24.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071768473999999999, 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31799 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:24.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925577+0000", 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925579+0000", 2024-09-14T08:40:24.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925587+0000", 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925593+0000", 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997015+0000", 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071422484999999994 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997130+0000", 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115053 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997345+0000", 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214379 2024-09-14T08:40:24.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31800 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3326976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.003218868000001, 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072113090000000005, 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31800 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925603+0000", 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925610+0000", 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8029999999999997e-06 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925618+0000", 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6930000000000007e-06 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997400+0000", 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071781929999999994 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997507+0000", 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107012 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997713+0000", 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020603 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.003193179, 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.947 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.003170622999999, 2024-09-14T08:40:24.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:40:24.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:40:24.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.003102607999999, 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:24.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:40:24.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.960 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.003052879999998, 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:40:24.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:40:24.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.003001725000001, 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.965 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.969 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.002949722, 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:40:24.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:40:24.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.002887152, 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.974 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:40:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.002820574000001, 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.002742789999999, 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.983 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:40:24.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:40:24.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.002690094999998, 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:40:24.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:40:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.002644442000001, 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:40:24.992 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:40:24.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:40:24.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:24.996 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.002597971, 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:40:24.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:24.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:40:25.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:25.001 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.002551983, 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:25.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:40:25.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.002523725, 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:40:25.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.010 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.002468947000001, 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:40:25.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:40:25.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.574698487999999, 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:40:25.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.019 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:25.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:25.022 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:25.022+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:25.122 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:25.122+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24335 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165024+0000", 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00082247099999999997, 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000874434, 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24335 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165024+0000", 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165024+0000", 2024-09-14T08:40:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165024+0000", 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5300000000000003e-07 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165027+0000", 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6769999999999999e-06 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165038+0000", 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1046000000000001e-05 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165045+0000", 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.652e-06 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.169 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24336 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165054+0000", 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00079227599999999996, 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0009797199999999999, 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24336 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165054+0000", 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165054+0000", 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165055+0000", 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2600000000000002e-07 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165057+0000", 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165065+0000", 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2560000000000002e-06 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165072+0000", 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6760000000000001e-06 2024-09-14T08:40:25.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24337 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165081+0000", 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00076542500000000002, 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001059824, 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24337 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165081+0000", 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165081+0000", 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165081+0000", 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165084+0000", 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.74e-06 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165094+0000", 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8530000000000004e-06 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165101+0000", 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7689999999999999e-06 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24338 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165111+0000", 2024-09-14T08:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00073483399999999996, 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001133909, 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24338 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165111+0000", 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165111+0000", 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165112+0000", 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3399999999999999e-07 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165115+0000", 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6860000000000002e-06 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165123+0000", 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2369999999999992e-06 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165129+0000", 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.472e-06 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24339 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165140+0000", 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00070624499999999998, 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001227398, 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24339 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165140+0000", 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165140+0000", 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165141+0000", 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4000000000000001e-07 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165143+0000", 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6429999999999999e-06 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165152+0000", 2024-09-14T08:40:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3329999999999997e-06 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165158+0000", 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.703e-06 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24340 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165167+0000", 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00067898299999999997, 2024-09-14T08:40:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013054869999999999, 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24340 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165167+0000", 2024-09-14T08:40:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165167+0000", 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165168+0000", 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8299999999999996e-07 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165170+0000", 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5399999999999998e-06 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165179+0000", 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.242e-06 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165185+0000", 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5640000000000002e-06 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24341 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165194+0000", 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000651882, 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001382732, 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24341 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165194+0000", 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165194+0000", 2024-09-14T08:40:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165195+0000", 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6700000000000002e-07 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165198+0000", 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6529999999999998e-06 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165206+0000", 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2730000000000002e-06 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165213+0000", 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.613e-06 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24342 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165222+0000", 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00062458399999999997, 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014594, 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24342 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165222+0000", 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165222+0000", 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165222+0000", 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7300000000000005e-07 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165232+0000", 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.01e-05 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165241+0000", 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6959999999999994e-06 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165248+0000", 2024-09-14T08:40:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6830000000000002e-06 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24343 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165260+0000", 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00058613299999999997, 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001525254, 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24343 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165260+0000", 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165260+0000", 2024-09-14T08:40:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165261+0000", 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5400000000000001e-07 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165263+0000", 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5730000000000002e-06 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165272+0000", 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3459999999999994e-06 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165278+0000", 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6599999999999998e-06 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24344 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165287+0000", 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00055880100000000005, 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001602897, 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24344 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165287+0000", 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165287+0000", 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165288+0000", 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9299999999999996e-07 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165291+0000", 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.723e-06 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165299+0000", 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1999999999999994e-06 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165306+0000", 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7129999999999999e-06 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24346 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165315+0000", 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00053133900000000003, 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0016757180000000001, 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24346 2024-09-14T08:40:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165315+0000", 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165315+0000", 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165315+0000", 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1900000000000002e-07 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165318+0000", 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.83e-06 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165327+0000", 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2630000000000003e-06 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165333+0000", 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4999999999999996e-06 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24347 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165342+0000", 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00050424400000000005, 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001752045, 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24347 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165342+0000", 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165342+0000", 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165343+0000", 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.06e-07 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165345+0000", 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7269999999999999e-06 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165354+0000", 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2190000000000004e-06 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165360+0000", 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5899999999999996e-06 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24348 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165369+0000", 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000477066, 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00182771, 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24348 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165369+0000", 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165369+0000", 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165370+0000", 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165372+0000", 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5660000000000001e-06 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165381+0000", 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1759999999999993e-06 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165387+0000", 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8569999999999997e-06 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24349 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165396+0000", 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00045000800000000001, 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019012339999999999, 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24349 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165396+0000", 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165396+0000", 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165397+0000", 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2699999999999999e-07 2024-09-14T08:40:25.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165400+0000", 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0230000000000001e-06 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165408+0000", 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1899999999999995e-06 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165415+0000", 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5150000000000003e-06 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24350 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165423+0000", 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00042296899999999998, 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019744340000000002, 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.215 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24350 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165423+0000", 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165423+0000", 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165424+0000", 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165426+0000", 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5969999999999999e-06 2024-09-14T08:40:25.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165435+0000", 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.276e-06 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165443+0000", 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1720000000000007e-06 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24351 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165452+0000", 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00039424099999999998, 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020502810000000002, 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24351 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.219 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165452+0000", 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165452+0000", 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165453+0000", 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165455+0000", 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8059999999999999e-06 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165466+0000", 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0339e-05 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165472+0000", 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6769999999999998e-06 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24352 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165481+0000", 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00036491699999999998, 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021251, 2024-09-14T08:40:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24352 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165481+0000", 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165481+0000", 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165482+0000", 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5700000000000001e-07 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165485+0000", 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.757e-06 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165493+0000", 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2120000000000003e-06 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165500+0000", 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6200000000000001e-06 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.225 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24353 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165509+0000", 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00033752899999999999, 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022081359999999999, 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.226 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24353 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165509+0000", 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165509+0000", 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165509+0000", 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7700000000000004e-07 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165512+0000", 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7970000000000001e-06 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165520+0000", 2024-09-14T08:40:25.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1859999999999992e-06 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165527+0000", 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5230000000000001e-06 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24354 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165536+0000", 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00031023299999999998, 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022803609999999998, 2024-09-14T08:40:25.229 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24354 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165536+0000", 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165536+0000", 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165537+0000", 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2600000000000002e-07 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165539+0000", 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7269999999999999e-06 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165547+0000", 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1389999999999995e-06 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165556+0000", 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1000000000000004e-06 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24355 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165564+0000", 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000281885, 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023570039999999998, 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24355 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165564+0000", 2024-09-14T08:40:25.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165564+0000", 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165565+0000", 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7299999999999995e-07 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165574+0000", 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0759999999999992e-06 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165583+0000", 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4700000000000002e-06 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165589+0000", 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7619999999999998e-06 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.235 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24356 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165600+0000", 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000245844, 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024210859999999998, 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24356 2024-09-14T08:40:25.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165600+0000", 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165600+0000", 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165601+0000", 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5000000000000001e-07 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165604+0000", 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7460000000000001e-06 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165612+0000", 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4300000000000006e-06 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165619+0000", 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24358 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165628+0000", 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000218299, 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024936070000000001, 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24358 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165628+0000", 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165628+0000", 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165629+0000", 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7000000000000004e-07 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165631+0000", 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5900000000000002e-06 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165641+0000", 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7089999999999997e-06 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165648+0000", 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9129999999999997e-06 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.242 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24359 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165658+0000", 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00018803799999999999, 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002565136, 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24359 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165658+0000", 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165658+0000", 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165659+0000", 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4000000000000001e-07 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165662+0000", 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8200000000000001e-06 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165670+0000", 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1990000000000006e-06 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165676+0000", 2024-09-14T08:40:25.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5769999999999999e-06 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24360 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165688+0000", 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0001582, 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002635082, 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.246 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24360 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165688+0000", 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165688+0000", 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165689+0000", 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5400000000000001e-07 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165691+0000", 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6359999999999998e-06 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165700+0000", 2024-09-14T08:40:25.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3189999999999995e-06 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165706+0000", 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4969999999999998e-06 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24361 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165730+0000", 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00011655900000000001, 2024-09-14T08:40:25.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027001210000000002, 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24361 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165730+0000", 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165730+0000", 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165731+0000", 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165733+0000", 2024-09-14T08:40:25.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9160000000000001e-06 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165742+0000", 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9700000000000005e-06 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165749+0000", 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9129999999999997e-06 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.252 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24362 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165759+0000", 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.7183999999999997e-05, 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027723959999999999, 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.253 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24362 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165759+0000", 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165759+0000", 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165760+0000", 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2300000000000001e-07 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165762+0000", 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165773+0000", 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0246e-05 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165780+0000", 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8589999999999999e-06 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24363 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165788+0000", 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7802e-05, 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028442979999999999, 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24363 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165788+0000", 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165788+0000", 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165789+0000", 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165792+0000", 2024-09-14T08:40:25.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8760000000000001e-06 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165800+0000", 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1859999999999992e-06 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165807+0000", 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6100000000000002e-06 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.259 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24365 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165818+0000", 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 2.7937999999999999e-05, 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029163449999999999, 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.260 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24365 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165818+0000", 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165818+0000", 2024-09-14T08:40:25.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165819+0000", 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7400000000000002e-07 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165822+0000", 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.756e-06 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165830+0000", 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4630000000000001e-06 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165837+0000", 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6760000000000001e-06 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.263 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24366 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165846+0000", 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.0600000000000001e-07, 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00299029, 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24366 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165846+0000", 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165846+0000", 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165847+0000", 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6000000000000003e-07 2024-09-14T08:40:25.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165849+0000", 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6860000000000002e-06 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165858+0000", 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.276e-06 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165864+0000", 2024-09-14T08:40:25.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5629999999999997e-06 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24367 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165873+0000", 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999733, 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030711139999999998, 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24367 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165873+0000", 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165873+0000", 2024-09-14T08:40:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165873+0000", 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0999999999999998e-07 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165876+0000", 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6900000000000001e-06 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165887+0000", 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0900000000000001e-05 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165896+0000", 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5259999999999999e-06 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24368 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165905+0000", 2024-09-14T08:40:25.270 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999409, 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031452329999999999, 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24368 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165905+0000", 2024-09-14T08:40:25.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165905+0000", 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165906+0000", 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165909+0000", 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.756e-06 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165917+0000", 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4770000000000003e-06 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165924+0000", 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6420000000000001e-06 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4816.0:24369 3.7 3.1077bb07 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:25.165933+0000", 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999132, 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032197020000000001, 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4816", 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24369 2024-09-14T08:40:25.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165933+0000", 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165933+0000", 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165934+0000", 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165944+0000", 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0502e-05 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165953+0000", 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8130000000000002e-06 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:25.165960+0000", 2024-09-14T08:40:25.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8600000000000004e-06 2024-09-14T08:40:25.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.277 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.277 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:25.277 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 32 2024-09-14T08:40:25.277 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:25.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:25.279 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:25.282+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:25.380 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:25.382+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:25.424 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:25.424 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:25.424 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:25.424 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:25.424 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:25.438 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:25.481 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:25.482+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:25.575 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:25.575 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33403 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3560448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300644574, 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065276109999999998, 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33403 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:25.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277827+0000", 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.23e-07 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277830+0000", 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277839+0000", 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277846+0000", 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1590000000000004e-06 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342820+0000", 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064974064999999998 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342954+0000", 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133509 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343102+0000", 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000148539 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.580 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33404 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3571712~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300613112000001, 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065555713000000002, 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33404 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:25.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277861+0000", 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9790000000000002e-06 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277881+0000", 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9463999999999999e-05 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277889+0000", 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7190000000000001e-06 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343177+0000", 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065288760000000001 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343279+0000", 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101974 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343414+0000", 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013411 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33405 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300571801, 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065812103999999996, 2024-09-14T08:40:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33405 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277900+0000", 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277922+0000", 2024-09-14T08:40:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1540999999999999e-05 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277932+0000", 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0587999999999999e-05 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277940+0000", 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5360000000000004e-06 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343480+0000", 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065539753000000006 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343581+0000", 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101005 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343711+0000", 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013069500000000001 2024-09-14T08:40:25.589 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300519668, 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.590 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:40:25.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.594 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300490872000001, 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.595 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:40:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.599 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300462053, 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:40:25.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:25.604 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300433724000001, 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:40:25.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300404524000001, 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.609 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:25.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.613 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300372515999999, 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:40:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.30034324, 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.618 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:40:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300313574, 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.623 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:25.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:25.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300285031000001, 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:40:25.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.629 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:25.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:25.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:25.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:25.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:40:25.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:40:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:40:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:40:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:40:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.633 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300256725000001, 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:25.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:25.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:40:25.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300211458, 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.639 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:40:25.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300179836000002, 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:40:25.643 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:40:25.647 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300122024, 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.648 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:25.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:40:25.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300054011, 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.657 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.300018639000001, 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:40:25.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:25.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:40:25.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:40:25.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:40:25.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:40:25.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.299984240000001, 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:40:25.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 15.272913687000001, 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:25.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:40:25.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:40:25.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:40:25.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.676 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:25.676 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:25.676 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:25.677 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:25.678 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:25.678+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:25.779 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:25.782+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:25.802 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:40:25.813 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:25.813 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:25.813 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:25.814 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:25.829 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:25.880 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:25.879+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:25.954 INFO:teuthology.orchestra.run.smithi188.stdout:1186 read 0x8eef000 thru 0x8efd366 (0xe367 bytes) 2024-09-14T08:40:25.967 INFO:teuthology.orchestra.run.smithi188.stdout:1188 write 0x3bf2e00 thru 0x3c016a9 (0xe8aa bytes) 2024-09-14T08:40:25.971 INFO:teuthology.orchestra.run.smithi188.stdout:1190 punch from 0x5eb2000 to 0x5eb4400, (0x2400 bytes) 2024-09-14T08:40:25.980 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:25.982+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:25.994 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:25.994 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:26.002 INFO:teuthology.orchestra.run.smithi188.stdout:1192 write 0xa3fe00 thru 0xa460e9 (0x62ea bytes) 2024-09-14T08:40:26.004 INFO:teuthology.orchestra.run.smithi188.stdout:1193 read 0x1253600 thru 0x125469a (0x109b bytes) 2024-09-14T08:40:26.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:26.017 INFO:teuthology.orchestra.run.smithi188.stdout:1195 trunc from 0xe399800 to 0xc021600 2024-09-14T08:40:26.055 INFO:teuthology.orchestra.run.smithi188.stdout:1196 write 0x461c00 thru 0x4656b6 (0x3ab7 bytes) 2024-09-14T08:40:26.060 INFO:teuthology.orchestra.run.smithi188.stdout:1199 read 0x90be200 thru 0x90c3a8f (0x5890 bytes) 2024-09-14T08:40:26.061 INFO:teuthology.orchestra.run.smithi188.stdout:1200 punch from 0x2a28600 to 0x2a31000, (0x8a00 bytes) 2024-09-14T08:40:26.078 INFO:teuthology.orchestra.run.smithi188.stdout:1204 trunc from 0xc021600 to 0xa3e3200 2024-09-14T08:40:26.097 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:26.099 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:26.102+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:26.128 INFO:teuthology.orchestra.run.smithi188.stdout:1206 read 0x810b600 thru 0x811893b (0xd33c bytes) 2024-09-14T08:40:26.131 INFO:teuthology.orchestra.run.smithi188.stdout:1207 punch from 0x14e9e00 to 0x14f0800, (0x6a00 bytes) 2024-09-14T08:40:26.155 INFO:teuthology.orchestra.run.smithi188.stdout:1209 trunc from 0xa3e3200 to 0x7425200 2024-09-14T08:40:26.182 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:26.186+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:26.186 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:26.186 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:26.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:26.186 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940928742000001, 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:40:26.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940866729, 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.191 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:40:26.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940800399, 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.196 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940744938999998, 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:40:26.200 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940685319, 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:40:26.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940603779, 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:26.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940547451, 2024-09-14T08:40:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:26.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.217 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940475956, 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.218 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940403085, 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.222 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.226 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940360872999999, 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:40:26.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:40:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940331043, 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:26.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:40:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:40:26.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940302746, 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:40:26.235 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940261651, 2024-09-14T08:40:26.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:40:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940232621, 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:40:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940204136999998, 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:40:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:40:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940175997000001, 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:40:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:40:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940147301, 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:40:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940118544000001, 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:40:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940090497, 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:40:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.940060519999999, 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:26.271 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:40:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:26.276 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:26.276 INFO:teuthology.orchestra.run.smithi188.stdout:1210 write 0x522c000 thru 0x5233b43 (0x7b44 bytes) 2024-09-14T08:40:26.278 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:40:26.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:26.279 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:26.279 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:26.279 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:26.280 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:26.280 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:26.300 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:26.300 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:26.319 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:26.322+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:26.321 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:26.321 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:26.339 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:26.339 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:26.344 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:26.345 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:26.386 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:26.387+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:26.449 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:26.449 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:26.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:26.478 INFO:teuthology.orchestra.run.smithi188.stdout:1212 write 0xb61e200 thru 0xb621800 (0x3601 bytes) 2024-09-14T08:40:26.478 INFO:teuthology.orchestra.run.smithi188.stdout:1213 read 0x278a600 thru 0x278ead1 (0x44d2 bytes) 2024-09-14T08:40:26.479 INFO:teuthology.orchestra.run.smithi188.stdout:1214 write 0x7ebc00 thru 0x7f394e (0x7d4f bytes) 2024-09-14T08:40:26.482 INFO:teuthology.orchestra.run.smithi188.stdout:1217 read 0x2a5ca00 thru 0x2a5f63a (0x2c3b bytes) 2024-09-14T08:40:26.483 INFO:teuthology.orchestra.run.smithi188.stdout:1219 write 0x25ac600 thru 0x25b1b43 (0x5544 bytes) 2024-09-14T08:40:26.485 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:26.483+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:26.486 INFO:teuthology.orchestra.run.smithi188.stdout:1220 punch from 0x2d99200 to 0x2d99e00, (0xc00 bytes) 2024-09-14T08:40:26.488 INFO:teuthology.orchestra.run.smithi188.stdout:1222 punch from 0xa554200 to 0xa558800, (0x4600 bytes) 2024-09-14T08:40:26.488 INFO:teuthology.orchestra.run.smithi188.stdout:1223 punch from 0xa9e9c00 to 0xa9eb400, (0x1800 bytes) 2024-09-14T08:40:26.488 INFO:teuthology.orchestra.run.smithi188.stdout:1225 read 0xa6d0000 thru 0xa6d03ab (0x3ac bytes) 2024-09-14T08:40:26.488 INFO:teuthology.orchestra.run.smithi188.stdout:1227 read 0xb569800 thru 0xb576fd6 (0xd7d7 bytes) 2024-09-14T08:40:26.488 INFO:teuthology.orchestra.run.smithi188.stdout:1231 read 0x76f0e00 thru 0x76f875f (0x7960 bytes) 2024-09-14T08:40:26.489 INFO:teuthology.orchestra.run.smithi188.stdout:1232 read 0x9cb9600 thru 0x9cbda71 (0x4472 bytes) 2024-09-14T08:40:26.489 INFO:teuthology.orchestra.run.smithi188.stdout:1234 write 0x7593e00 thru 0x759f027 (0xb228 bytes) 2024-09-14T08:40:26.489 INFO:teuthology.orchestra.run.smithi188.stdout:1236 read 0x1f60000 thru 0x1f62503 (0x2504 bytes) 2024-09-14T08:40:26.498 INFO:teuthology.orchestra.run.smithi188.stdout:1238 write 0x79e000 thru 0x7a33cd (0x53ce bytes) 2024-09-14T08:40:26.502 INFO:teuthology.orchestra.run.smithi188.stdout:1239 read 0x64bdc00 thru 0x64c2fe1 (0x53e2 bytes) 2024-09-14T08:40:26.504 INFO:teuthology.orchestra.run.smithi188.stdout:1240 read 0x31cb200 thru 0x31d4f37 (0x9d38 bytes) 2024-09-14T08:40:26.505 INFO:teuthology.orchestra.run.smithi188.stdout:1241 write 0x28b8600 thru 0x28be869 (0x626a bytes) 2024-09-14T08:40:26.507 INFO:teuthology.orchestra.run.smithi188.stdout:1244 read 0x65ed400 thru 0x65f0f72 (0x3b73 bytes) 2024-09-14T08:40:26.555 INFO:teuthology.orchestra.run.smithi188.stdout:1248 write 0xcbf6200 thru 0xcc01a6c (0xb86d bytes) 2024-09-14T08:40:26.557 INFO:teuthology.orchestra.run.smithi188.stdout:1249 write 0xaa1ee00 thru 0xaa2eb35 (0xfd36 bytes) 2024-09-14T08:40:26.569 INFO:teuthology.orchestra.run.smithi188.stdout:1251 trunc from 0xcc01c00 to 0x8a1fc00 2024-09-14T08:40:26.580 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:26.580 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:26.585 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:26.586+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:26.595 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:26.624 INFO:teuthology.orchestra.run.smithi188.stdout:1254 read 0x2588000 thru 0x258f01d (0x701e bytes) 2024-09-14T08:40:26.658 INFO:teuthology.orchestra.run.smithi188.stdout:1256 write 0xaadaa00 thru 0xaadd8c6 (0x2ec7 bytes) 2024-09-14T08:40:26.660 INFO:teuthology.orchestra.run.smithi188.stdout:1258 read 0x96ac400 thru 0x96b05c3 (0x41c4 bytes) 2024-09-14T08:40:26.687 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:26.686+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:26.707 INFO:teuthology.orchestra.run.smithi188.stdout:1259 write 0xe8f3400 thru 0xe901691 (0xe292 bytes) 2024-09-14T08:40:26.710 INFO:teuthology.orchestra.run.smithi188.stdout:1261 punch from 0xc2b8c00 to 0xc2bc000, (0x3400 bytes) 2024-09-14T08:40:26.710 INFO:teuthology.orchestra.run.smithi188.stdout:1262 punch from 0xe624200 to 0xe626400, (0x2200 bytes) 2024-09-14T08:40:26.717 INFO:teuthology.orchestra.run.smithi188.stdout:1264 trunc from 0xe901800 to 0xbe43000 2024-09-14T08:40:26.769 INFO:teuthology.orchestra.run.smithi188.stdout:1265 write 0x32b400 thru 0x32b6ef (0x2f0 bytes) 2024-09-14T08:40:26.773 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:26.773 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:26.773 INFO:teuthology.orchestra.run.smithi188.stdout:1266 read 0x4dfac00 thru 0x4dffa77 (0x4e78 bytes) 2024-09-14T08:40:26.775 INFO:teuthology.orchestra.run.smithi188.stdout:1269 punch from 0x662600 to 0x66ee00, (0xc800 bytes) 2024-09-14T08:40:26.775 INFO:teuthology.orchestra.run.smithi188.stdout:1270 read 0x219ec00 thru 0x21a07c8 (0x1bc9 bytes) 2024-09-14T08:40:26.777 INFO:teuthology.orchestra.run.smithi188.stdout:1273 write 0x1bf7200 thru 0x1c039dd (0xc7de bytes) 2024-09-14T08:40:26.788 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:26.790+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:26.789 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:26.789 INFO:teuthology.orchestra.run.smithi188.stdout:1275 trunc from 0xbe43000 to 0xe97a400 2024-09-14T08:40:26.823 INFO:teuthology.orchestra.run.smithi188.stdout:1276 punch from 0xcc40e00 to 0xcc4fc00, (0xee00 bytes) 2024-09-14T08:40:26.825 INFO:teuthology.orchestra.run.smithi188.stdout:1278 write 0x2b07200 thru 0x2b0d0a1 (0x5ea2 bytes) 2024-09-14T08:40:26.828 INFO:teuthology.orchestra.run.smithi188.stdout:1279 punch from 0xc93de00 to 0xc941400, (0x3600 bytes) 2024-09-14T08:40:26.855 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:40:26.856 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:40:26.856 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-14T08:40:26.856 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T08:40:26.856 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T08:40:26.856 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-14T08:40:26.871 INFO:teuthology.orchestra.run.smithi188.stdout:1280 trunc from 0xe97a400 to 0x389ea00 2024-09-14T08:40:26.919 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:26.922+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:26.940 INFO:teuthology.orchestra.run.smithi188.stdout:1281 read 0x81400 thru 0x83fbf (0x2bc0 bytes) 2024-09-14T08:40:26.954 INFO:teuthology.orchestra.run.smithi188.stdout:1283 trunc from 0x389ea00 to 0x8069600 2024-09-14T08:40:26.966 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:26.966 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:26.982 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:27.002 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:27.002 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T08:40:27.002 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:27.003 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:27.002+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:27.031 INFO:teuthology.orchestra.run.smithi188.stdout:1286 trunc from 0x8069600 to 0x627c00 2024-09-14T08:40:27.091 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:27.090+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:27.102 INFO:teuthology.orchestra.run.smithi188.stdout:1288 punch from 0x4d4e00 to 0x4e0600, (0xb800 bytes) 2024-09-14T08:40:27.132 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:27.132 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:27.143 INFO:teuthology.orchestra.run.smithi188.stdout:1290 write 0x3462400 thru 0x346e179 (0xbd7a bytes) 2024-09-14T08:40:27.147 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:27.149 INFO:teuthology.orchestra.run.smithi188.stdout:1291 trunc from 0x346e200 to 0x1f7b000 2024-09-14T08:40:27.191 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:27.190+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:27.196 INFO:teuthology.orchestra.run.smithi188.stdout:1298 punch from 0x1217c00 to 0x1220800, (0x8c00 bytes) 2024-09-14T08:40:27.198 INFO:teuthology.orchestra.run.smithi188.stdout:1299 read 0x1bd5600 thru 0x1bdadb1 (0x57b2 bytes) 2024-09-14T08:40:27.198 INFO:teuthology.orchestra.run.smithi188.stdout:1301 punch from 0x18aee00 to 0x18b9200, (0xa400 bytes) 2024-09-14T08:40:27.234 INFO:teuthology.orchestra.run.smithi188.stdout:1302 write 0x4ef5e00 thru 0x4ef79e0 (0x1be1 bytes) 2024-09-14T08:40:27.235 INFO:teuthology.orchestra.run.smithi188.stdout:1304 read 0x955c00 thru 0x962313 (0xc714 bytes) 2024-09-14T08:40:27.235 INFO:teuthology.orchestra.run.smithi188.stdout:1305 clone 10 order 24 su 1048576 sc 5 2024-09-14T08:40:27.274 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:27.275 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:27.289 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:27.292 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:27.294+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:27.393 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:27.394+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:27.419 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:27.420 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:27.433 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:27.494 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:27.490+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:27.552 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:27.552 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:27.566 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:27.594 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:27.598+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:27.695 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:27.698+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:27.731 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:27.731 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:27.745 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:27.796 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:27.798+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:27.868 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:27.868 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:27.882 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:27.897 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:27.902+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:27.998 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:27.998+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:28.000 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:28.000 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:28.014 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:28.099 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:28.102+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:28.182 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:28.182 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:28.195 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:28.243 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:28.246+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:28.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:40:28.330 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:28.330+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:28.332 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:28.332 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:28.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:28.347 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:28.401 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:28.398+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:28.405 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone9 from 0x4ef7a00 (overlap 0x627c00) to 0x44f000 2024-09-14T08:40:28.481 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:28.499 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:28.499 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:28.502 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:28.502+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:28.516 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:28.516 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:28.517 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:28.517 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:28.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:28.538 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:28.538 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:28.556 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:28.572 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:28.573 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:28.578 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:28.578 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:28.626 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:28.626+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:28.660 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:28.660 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:28.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:28.660 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:28.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.660 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.416137323000001, 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:40:28.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.41607531, 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:40:28.665 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:40:28.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.669 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.416008980000001, 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.670 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:28.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:28.674 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415953519999999, 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:40:28.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.4158939, 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.41581236, 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:40:28.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:40:28.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:40:28.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415756032000001, 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.688 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:28.692 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415684537000001, 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:40:28.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415611666, 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.697 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:40:28.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415569454, 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:28.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:40:28.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.706 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415539624000001, 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:28.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:40:28.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:40:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415511327000001, 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.711 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:28.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:40:28.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415470232000001, 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.716 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:40:28.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.720 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415441202, 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.721 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:40:28.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:40:28.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:40:28.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:40:28.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.725 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415412717999999, 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.726 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:28.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:40:28.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:40:28.730 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415384578000001, 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:40:28.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:40:28.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:40:28.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:40:28.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:40:28.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415355882, 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.736 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:40:28.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415327125000001, 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:40:28.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:40:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.745 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415299078, 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:40:28.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:40:28.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:40:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:40:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.750 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.415269101, 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:28.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:28.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:28.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:28.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:28.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:40:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:28.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:28.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:28.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:40:28.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:40:28.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.755 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:28.755 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:28.755 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:28.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:28.758 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:28.754+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:28.858 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:28.858+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:28.886 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:28.886 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:28.887 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:28.887 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:28.901 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:28.950 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-14T08:40:28.959 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:28.962+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:29.060 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:29.062+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:29.065 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:29.065 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:29.065 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:29.065 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:29.065 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:29.079 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:29.107 INFO:teuthology.orchestra.run.smithi188.stdout:1307 write 0xb703800 thru 0xb70f88c (0xc08d bytes) 2024-09-14T08:40:29.109 INFO:teuthology.orchestra.run.smithi188.stdout:1309 punch from 0xa535e00 to 0xa536000, (0x200 bytes) 2024-09-14T08:40:29.111 INFO:teuthology.orchestra.run.smithi188.stdout:1311 read 0x213a200 thru 0x21444c1 (0xa2c2 bytes) 2024-09-14T08:40:29.111 INFO:teuthology.orchestra.run.smithi188.stdout:1312 write 0xb3ca600 thru 0xb3d0c5d (0x665e bytes) 2024-09-14T08:40:29.111 INFO:teuthology.orchestra.run.smithi188.stdout:1313 punch from 0x7470200 to 0x7479600, (0x9400 bytes) 2024-09-14T08:40:29.112 INFO:teuthology.orchestra.run.smithi188.stdout:1314 read 0x5160000 thru 0x516d352 (0xd353 bytes) 2024-09-14T08:40:29.113 INFO:teuthology.orchestra.run.smithi188.stdout:1316 punch from 0x75bac00 to 0x75bf000, (0x4400 bytes) 2024-09-14T08:40:29.113 INFO:teuthology.orchestra.run.smithi188.stdout:1320 punch from 0xa004e00 to 0xa005200, (0x400 bytes) 2024-09-14T08:40:29.113 INFO:teuthology.orchestra.run.smithi188.stdout:1323 write 0x942dc00 thru 0x943389a (0x5c9b bytes) 2024-09-14T08:40:29.113 INFO:teuthology.orchestra.run.smithi188.stdout:1327 read 0x5977c00 thru 0x597e9fc (0x6dfd bytes) 2024-09-14T08:40:29.154 INFO:teuthology.orchestra.run.smithi188.stdout:1328 trunc from 0xb70fa00 to 0x1b3a00 2024-09-14T08:40:29.171 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:29.174+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:29.228 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:40:29.253 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:29.253 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:29.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:29.253 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:29.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.254 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.254 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:29.254 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.369423467000001, 2024-09-14T08:40:29.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:40:29.254 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.255 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.255 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.255 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:40:29.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.256 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:29.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:29.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:40:29.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:40:29.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:40:29.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:40:29.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:40:29.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:40:29.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:40:29.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:40:29.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:40:29.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:40:29.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:40:29.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:40:29.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:40:29.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:40:29.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.263 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.264 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.264 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:29.264 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.358171431999999, 2024-09-14T08:40:29.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:40:29.265 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.265 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.265 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.266 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.266 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:40:29.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.266 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:29.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:29.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:40:29.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:40:29.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:40:29.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:40:29.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:40:29.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:40:29.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:40:29.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:40:29.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:40:29.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:40:29.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:40:29.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:40:29.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:40:29.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:40:29.274 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.274 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.274 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.274 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.275 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:29.275 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.357311546999998, 2024-09-14T08:40:29.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:40:29.275 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.275 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.275 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.275 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.276 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.276 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.276 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:40:29.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.276 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:29.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:29.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:40:29.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:40:29.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:40:29.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:40:29.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:40:29.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:40:29.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:40:29.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:40:29.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:40:29.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:40:29.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:40:29.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:40:29.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:40:29.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:40:29.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.284 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.284 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.285 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:29.285 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.357004922000002, 2024-09-14T08:40:29.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:40:29.285 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.285 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.286 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.286 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:40:29.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.286 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:29.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:29.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:40:29.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:40:29.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:40:29.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:29.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:40:29.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:40:29.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:40:29.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:40:29.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:40:29.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:40:29.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:40:29.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:40:29.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:40:29.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:40:29.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.294 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.295 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.295 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:29.295 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.356601587, 2024-09-14T08:40:29.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:40:29.295 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.296 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.296 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.296 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:40:29.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.297 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:29.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:29.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:40:29.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:40:29.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:40:29.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:40:29.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:40:29.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:40:29.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:40:29.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:40:29.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:40:29.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:40:29.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:40:29.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:40:29.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:40:29.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:40:29.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.305 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.305 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:29.305 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.356197884, 2024-09-14T08:40:29.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:40:29.306 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.306 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.307 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.307 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:40:29.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.307 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:29.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:29.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:40:29.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:40:29.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:40:29.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:40:29.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:40:29.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:40:29.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:40:29.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:40:29.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.355847138000001, 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.314 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:40:29.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.355460866000001, 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.319 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.355270333, 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:40:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:40:29.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.327 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.354763604999999, 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:40:29.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:29.332 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.354437532999999, 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:29.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:40:29.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:40:29.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:40:29.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.354127921, 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.339 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.343 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.353632379, 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:40:29.347 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.353316621000001, 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:29.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.352829185000001, 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:40:29.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.352479172999999, 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.357 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:40:29.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.361 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.351688054, 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:40:29.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:40:29.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:40:29.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.351278995000001, 2024-09-14T08:40:29.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:40:29.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.348646307999999, 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:40:29.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:40:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.522155667, 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:40:29.375 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:40:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.381 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.382 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.382 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:29.384 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:29.385 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:29.386+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:29.386 INFO:teuthology.orchestra.run.smithi188.stdout:1332 write 0x9917400 thru 0x991cd75 (0x5976 bytes) 2024-09-14T08:40:29.386 INFO:teuthology.orchestra.run.smithi188.stdout:1335 flatten 2024-09-14T08:40:29.386 INFO:teuthology.orchestra.run.smithi188.stdout:1336 write 0x581f400 thru 0x5822417 (0x3018 bytes) 2024-09-14T08:40:29.386 INFO:teuthology.orchestra.run.smithi188.stdout:1337 read 0x12eca00 thru 0x12f7698 (0xac99 bytes) 2024-09-14T08:40:29.386 INFO:teuthology.orchestra.run.smithi188.stdout:1338 read 0x606b200 thru 0x606cf7e (0x1d7f bytes) 2024-09-14T08:40:29.386 INFO:teuthology.orchestra.run.smithi188.stdout:1339 punch from 0x9c2a00 to 0x9c9e00, (0x7400 bytes) 2024-09-14T08:40:29.386 INFO:teuthology.orchestra.run.smithi188.stdout:1345 read 0x6d96a00 thru 0x6da057f (0x9b80 bytes) 2024-09-14T08:40:29.386 INFO:teuthology.orchestra.run.smithi188.stdout:1346 write 0x4c2fa00 thru 0x4c3c06b (0xc66c bytes) 2024-09-14T08:40:29.386 INFO:teuthology.orchestra.run.smithi188.stdout:1347 read 0x62d3400 thru 0x62def12 (0xbb13 bytes) 2024-09-14T08:40:29.387 INFO:teuthology.orchestra.run.smithi188.stdout:1349 read 0x53a5400 thru 0x53ac1f0 (0x6df1 bytes) 2024-09-14T08:40:29.387 INFO:teuthology.orchestra.run.smithi188.stdout:1351 write 0xd17a00 thru 0xd19681 (0x1c82 bytes) 2024-09-14T08:40:29.387 INFO:teuthology.orchestra.run.smithi188.stdout:1353 punch from 0x12aaa00 to 0x12b3400, (0x8a00 bytes) 2024-09-14T08:40:29.387 INFO:teuthology.orchestra.run.smithi188.stdout:1354 read 0x5e1e00 thru 0x5efdaf (0xdfb0 bytes) 2024-09-14T08:40:29.387 INFO:teuthology.orchestra.run.smithi188.stdout:1357 read 0x15b1400 thru 0x15c05b5 (0xf1b6 bytes) 2024-09-14T08:40:29.387 INFO:teuthology.orchestra.run.smithi188.stdout:1361 read 0x8f8f400 thru 0x8f9de09 (0xea0a bytes) 2024-09-14T08:40:29.387 INFO:teuthology.orchestra.run.smithi188.stdout:1364 read 0x2c51600 thru 0x2c5a66d (0x906e bytes) 2024-09-14T08:40:29.387 INFO:teuthology.orchestra.run.smithi188.stdout:1367 read 0x12cb800 thru 0x12d01b1 (0x49b2 bytes) 2024-09-14T08:40:29.387 INFO:teuthology.orchestra.run.smithi188.stdout:1370 clone 11 order 23 su 32768 sc 7 2024-09-14T08:40:29.484 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:29.486+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:29.557 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:29.557 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:29.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:29.615 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:29.618+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:29.686 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:29.682+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:29.740 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:29.740 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:29.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:29.799 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:29.802+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:29.881 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.804499824000001, 2024-09-14T08:40:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.804411727000002, 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.804344329999999, 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.804270634000002, 2024-09-14T08:40:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.804195161999999, 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.804137957999998, 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.804079074000001, 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.804014148, 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.803952697, 2024-09-14T08:40:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.803893163000001, 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.803833853, 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.803761820999998, 2024-09-14T08:40:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24681 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3076096~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.6494269280000005, 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096091748000000005, 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24681 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233725+0000", 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.017e-06 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233735+0000", 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8430000000000005e-06 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233746+0000", 2024-09-14T08:40:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1409e-05 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233756+0000", 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5230000000000001e-06 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329376+0000", 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095619941 2024-09-14T08:40:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329544+0000", 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000168269 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329816+0000", 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027174600000000001 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24682 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.6493529819999999, 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096544940999999995, 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24682 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233799+0000", 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.08e-06 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233803+0000", 2024-09-14T08:40:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4429999999999999e-06 2024-09-14T08:40:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233816+0000", 2024-09-14T08:40:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3816e-05 2024-09-14T08:40:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233824+0000", 2024-09-14T08:40:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5859999999999999e-06 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329882+0000", 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096058344000000004 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330073+0000", 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019082999999999999 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330343+0000", 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026984200000000001 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.6493143269999999, 2024-09-14T08:40:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:40:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.6492835489999997, 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:40:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:40:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.649217846, 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:40:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:40:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.6490956749999999, 2024-09-14T08:40:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:40:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:40:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:40:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:40:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:40:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.649061444, 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.6490300189999996, 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:40:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:40:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:40:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:40:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:29.988 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:29.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:29.990 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:29.990+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:30.090 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:30.090+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:30.124 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:30.125 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:30.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:30.191 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:30.194+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:30.264 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:30.264 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:30.264 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:30.264 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:30.264 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:30.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:30.326 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:30.326+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:30.393 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:30.390+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:30.409 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31797 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3304448~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485477033000002, 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071016060000000006, 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.410 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31797 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0699999999999997e-07 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925536+0000", 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.368e-06 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925543+0000", 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.781e-06 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925548+0000", 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996245+0000", 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070697276000000003 2024-09-14T08:40:30.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996352+0000", 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107054 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996549+0000", 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000196942 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31798 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3306496~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485455012999999, 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071397830999999995, 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31798 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.415 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925558+0000", 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2069999999999998e-06 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925564+0000", 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6290000000000004e-06 2024-09-14T08:40:30.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925569+0000", 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.164e-06 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996603+0000", 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071033712999999998 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996708+0000", 2024-09-14T08:40:30.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010466700000000001 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996953+0000", 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000244959 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31799 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3315712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:30.419 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485433655999998, 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071768473999999999, 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31799 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925577+0000", 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925579+0000", 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925587+0000", 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925593+0000", 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:40:30.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997015+0000", 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071422484999999994 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997130+0000", 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115053 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997345+0000", 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214379 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31800 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3326976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485409969999999, 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072113090000000005, 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.424 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31800 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925603+0000", 2024-09-14T08:40:30.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925610+0000", 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8029999999999997e-06 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925618+0000", 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6930000000000007e-06 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997400+0000", 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071781929999999994 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997507+0000", 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107012 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997713+0000", 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020603 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485384281000002, 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:40:30.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:40:30.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485361724999997, 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:40:30.433 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:40:30.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485293710000001, 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:30.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.442 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485243982, 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:40:30.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:40:30.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485192826999999, 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.447 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:40:30.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.451 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485140823999998, 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:40:30.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485078254000001, 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:40:30.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:40:30.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:30.461 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.485011675999999, 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:40:30.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.484933892000001, 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:30.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.484881197, 2024-09-14T08:40:30.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:40:30.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:40:30.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.474 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.484835543999999, 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:40:30.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:40:30.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.484789073000002, 2024-09-14T08:40:30.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:30.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:40:30.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.484743084999998, 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.484 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:40:30.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:40:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.484714826999998, 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.489 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:30.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:40:30.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.484660048999999, 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:40:30.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:40:30.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:30.498 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.056889590000001, 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:40:30.502 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.503 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:30.503 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:30.503 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:30.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:30.505 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:30.502+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:30.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:30.605 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:30.606+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:30.675 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:30.675 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:30.675 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:30.675 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:30.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:30.720 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:30.721 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:30.718+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:30.738 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:30.738 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:30.756 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:30.756 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:30.778 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:30.778 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:30.799 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:30.799 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:30.806 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:30.806+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:30.811 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:30.811 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:30.820 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:30.820 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:30.824 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:30.825 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:30.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:30.914 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:30.914+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:30.986 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:30.987 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:31.000 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:31.047 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:31.050+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:31.110 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:31.110+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:31.131 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:31.132 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:31.145 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:31.211 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:31.210+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:31.213 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-14T08:40:31.311 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:31.314+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:31.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:31.341 INFO:teuthology.orchestra.run.smithi188.stdout:1371 read 0x4105400 thru 0x410fce4 (0xa8e5 bytes) 2024-09-14T08:40:31.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:40:31.389 INFO:teuthology.orchestra.run.smithi188.stdout:1372 trunc from 0x991ce00 to 0x1fa8a00 2024-09-14T08:40:31.419 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:31.422+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:31.513 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:31.514+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:31.537 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:31.537 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:31.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:31.617 INFO:teuthology.orchestra.run.smithi188.stdout:1373 trunc from 0x1fa8a00 to 0x5885600 2024-09-14T08:40:31.644 INFO:teuthology.orchestra.run.smithi188.stdout:1374 read 0x4bea200 thru 0x4bf87b4 (0xe5b5 bytes) 2024-09-14T08:40:31.646 INFO:teuthology.orchestra.run.smithi188.stdout:1376 read 0x16ca800 thru 0x16d1025 (0x6826 bytes) 2024-09-14T08:40:31.647 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:31.650+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:31.650 INFO:teuthology.orchestra.run.smithi188.stdout:1378 trunc from 0x5885600 to 0x67ae800 2024-09-14T08:40:31.670 INFO:teuthology.orchestra.run.smithi188.stdout:1379 read 0x90aa00 thru 0x9184bc (0xdabd bytes) 2024-09-14T08:40:31.673 INFO:teuthology.orchestra.run.smithi188.stdout:1380 punch from 0x5a45400 to 0x5a52000, (0xcc00 bytes) 2024-09-14T08:40:31.674 INFO:teuthology.orchestra.run.smithi188.stdout:1382 write 0x86a600 thru 0x86a6c3 (0xc4 bytes) 2024-09-14T08:40:31.715 INFO:teuthology.orchestra.run.smithi188.stdout:1385 write 0xa2a5400 thru 0xa2a8ade (0x36df bytes) 2024-09-14T08:40:31.715 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:31.714+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:31.716 INFO:teuthology.orchestra.run.smithi188.stdout:1386 read 0x33a000 thru 0x3419f9 (0x79fa bytes) 2024-09-14T08:40:31.718 INFO:teuthology.orchestra.run.smithi188.stdout:1387 write 0x874be00 thru 0x8759e98 (0xe099 bytes) 2024-09-14T08:40:31.719 INFO:teuthology.orchestra.run.smithi188.stdout:1389 read 0x649800 thru 0x64f545 (0x5d46 bytes) 2024-09-14T08:40:31.720 INFO:teuthology.orchestra.run.smithi188.stdout:1391 read 0x6c5000 thru 0x6ca013 (0x5014 bytes) 2024-09-14T08:40:31.721 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:31.721 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:31.736 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:31.739 INFO:teuthology.orchestra.run.smithi188.stdout:1392 trunc from 0xa2a8c00 to 0x44be400 2024-09-14T08:40:31.773 INFO:teuthology.orchestra.run.smithi188.stdout:1393 read 0x308a600 thru 0x309a548 (0xff49 bytes) 2024-09-14T08:40:31.823 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:31.826+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:31.850 INFO:teuthology.orchestra.run.smithi188.stdout:1394 write 0xc74f800 thru 0xc75ea03 (0xf204 bytes) 2024-09-14T08:40:31.852 INFO:teuthology.orchestra.run.smithi188.stdout:1397 write 0x5299400 thru 0x529f640 (0x6241 bytes) 2024-09-14T08:40:31.853 INFO:teuthology.orchestra.run.smithi188.stdout:1398 read 0x4dd7200 thru 0x4ddb92b (0x472c bytes) 2024-09-14T08:40:31.854 INFO:teuthology.orchestra.run.smithi188.stdout:1399 write 0x79b3c00 thru 0x79bdaef (0x9ef0 bytes) 2024-09-14T08:40:31.855 INFO:teuthology.orchestra.run.smithi188.stdout:1402 read 0x2ab1200 thru 0x2ab1ba2 (0x9a3 bytes) 2024-09-14T08:40:31.878 INFO:teuthology.orchestra.run.smithi188.stdout:1403 trunc from 0xc75ec00 to 0x3540a00 2024-09-14T08:40:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:31.917 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:31.914+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:31.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:31.942 INFO:teuthology.orchestra.run.smithi188.stdout:1404 trunc from 0x3540a00 to 0x8326600 2024-09-14T08:40:31.997 INFO:teuthology.orchestra.run.smithi188.stdout:1408 write 0xbf31200 thru 0xbf3e43a (0xd23b bytes) 2024-09-14T08:40:31.998 INFO:teuthology.orchestra.run.smithi188.stdout:1409 clone 12 order 19 su 32768 sc 15 2024-09-14T08:40:32.018 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:40:32.018 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:40:32.018 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T08:40:32.018 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T08:40:32.019 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:32.018+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:32.090 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:32.090 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:32.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:32.120 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:32.118+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:32.221 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:32.218+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:32.257 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:40:32.273 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:32.273 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:32.289 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:32.335 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:32.338+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:40:32.338 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 69, 2024-09-14T08:40:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "57b092b7-5550-41a0-8f78-531de0e7c469", 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-09-14T08:38:48.610112+0000", 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-09-14T08:40:32.244477+0000", 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-09-14T08:39:51.541202+0000", 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-09-14T08:38:51.099971+0000", 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5806080, 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "nodeep-scrub", 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "noscrub", 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-09-14T08:40:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 5, 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 3, 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 6, 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "luminous", 2024-09-14T08:40:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:00.306403+0000", 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "15", 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-09-14T08:40:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 5.880000114440918, 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 5.880000114440918, 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.17000000178813934, 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1, 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1, 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-09-14T08:40:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:06.370159+0000", 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 2, 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 19, 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.2699999809265137, 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.2699999809265137, 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.82999998331069946, 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "pool_client.0", 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:16.437713+0000", 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "69", 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 14, 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 69, 2024-09-14T08:40:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 1.7000000476837158, 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 1.7000000476837158, 2024-09-14T08:40:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.82999998331069946, 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d", 2024-09-14T08:40:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 0, 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 41, 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6800", 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6801", 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6802", 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6803", 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6806", 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6807", 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6804", 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6805", 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6801/2282442554", 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6803/2282442554", 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6807/2282442554", 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6805/2282442554", 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "exists" 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:40:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "09ba1390-a0d1-48a3-9342-5f5aa64e2217", 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 57, 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6808", 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6809", 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6810", 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6811", 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6814", 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6815", 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6812", 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6813", 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6809/2739597491", 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6811/2739597491", 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6815/2739597491", 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6813/2739597491", 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:40:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "a7cd8610-d8e1-44e7-a423-4419cad90d8e", 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 57, 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6816", 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817", 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818", 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819", 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6822", 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6823", 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6820", 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6821", 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6817/1157205327", 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6819/1157205327", 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6823/1157205327", 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6821/1157205327", 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "1339fb05-5d1c-4c0a-8388-314119543bb6", 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 63, 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6808", 2024-09-14T08:40:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6809", 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6810", 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6811", 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6814", 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6815", 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6812", 2024-09-14T08:40:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6813", 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6809/1656791341", 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6811/1656791341", 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6815/1656791341", 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6813/1656791341", 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "0cebba54-9019-47bd-870f-306664e390e1", 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 57, 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6816", 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6817", 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6818", 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6819", 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6822", 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6823", 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6820", 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6821", 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6817/1186206237", 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6819/1186206237", 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6823/1186206237", 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6821/1186206237", 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "e571e73b-0e9d-417d-b01c-59b651016763", 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0.1356353759765625, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 45, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6800", 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6801", 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6802", 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6803", 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6806", 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6807", 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6804", 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6805", 2024-09-14T08:40:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6801/796623465", 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6803/796623465", 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6807/796623465", 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6805/796623465", 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.174731+0000", 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 41 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:40:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.475467+0000", 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.606174+0000", 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.835957+0000", 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.753547+0000", 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.284212+0000", 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [ 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: 0 2024-09-14T08:40:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [ 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 4, 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 0 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.a", 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 4, 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 1 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 5, 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 2 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.13", 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 3, 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 0 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [ 2024-09-14T08:40:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "1.0", 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: 3, 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: 2 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: 2 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: 5 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.13", 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: 5, 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:32.407 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:32.408 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone11 from 0xbf3e600 (overlap 0x1fa8a00) to 0x1629200 2024-09-14T08:40:32.409 INFO:tasks.thrashosds.thrasher:j is {'epoch': 69, 'fsid': '57b092b7-5550-41a0-8f78-531de0e7c469', 'created': '2024-09-14T08:38:48.610112+0000', 'modified': '2024-09-14T08:40:32.244477+0000', 'last_up_change': '2024-09-14T08:39:51.541202+0000', 'last_in_change': '2024-09-14T08:38:51.099971+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T08:39:00.306403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 5.880000114440918, 'score_stable': 5.880000114440918, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T08:39:06.370159+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.2699999809265137, 'score_stable': 2.2699999809265137, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T08:39:16.437713+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 69, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7000000476837158, 'score_stable': 1.7000000476837158, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}], 'osds': [{'osd': 0, 'uuid': '2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 21, 'down_at': 41, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 2282442554}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 2282442554}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 2282442554}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 2282442554}]}, 'public_addr': '172.21.15.89:6801/2282442554', 'cluster_addr': '172.21.15.89:6803/2282442554', 'heartbeat_back_addr': '172.21.15.89:6807/2282442554', 'heartbeat_front_addr': '172.21.15.89:6805/2282442554', 'state': ['exists']}, {'osd': 1, 'uuid': '09ba1390-a0d1-48a3-9342-5f5aa64e2217', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6808', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6809', 'nonce': 2739597491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6810', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6811', 'nonce': 2739597491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6814', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6815', 'nonce': 2739597491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6812', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6813', 'nonce': 2739597491}]}, 'public_addr': '172.21.15.89:6809/2739597491', 'cluster_addr': '172.21.15.89:6811/2739597491', 'heartbeat_back_addr': '172.21.15.89:6815/2739597491', 'heartbeat_front_addr': '172.21.15.89:6813/2739597491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a7cd8610-d8e1-44e7-a423-4419cad90d8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6816', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6817', 'nonce': 1157205327}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6818', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 1157205327}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6822', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6823', 'nonce': 1157205327}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6820', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6821', 'nonce': 1157205327}]}, 'public_addr': '172.21.15.89:6817/1157205327', 'cluster_addr': '172.21.15.89:6819/1157205327', 'heartbeat_back_addr': '172.21.15.89:6823/1157205327', 'heartbeat_front_addr': '172.21.15.89:6821/1157205327', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1339fb05-5d1c-4c0a-8388-314119543bb6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6808', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6809', 'nonce': 1656791341}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6810', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6811', 'nonce': 1656791341}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6814', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6815', 'nonce': 1656791341}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6812', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6813', 'nonce': 1656791341}]}, 'public_addr': '172.21.15.112:6809/1656791341', 'cluster_addr': '172.21.15.112:6811/1656791341', 'heartbeat_back_addr': '172.21.15.112:6815/1656791341', 'heartbeat_front_addr': '172.21.15.112:6813/1656791341', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0cebba54-9019-47bd-870f-306664e390e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6816', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6817', 'nonce': 1186206237}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6818', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6819', 'nonce': 1186206237}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6822', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6823', 'nonce': 1186206237}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6820', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6821', 'nonce': 1186206237}]}, 'public_addr': '172.21.15.112:6817/1186206237', 'cluster_addr': '172.21.15.112:6819/1186206237', 'heartbeat_back_addr': '172.21.15.112:6823/1186206237', 'heartbeat_front_addr': '172.21.15.112:6821/1186206237', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e571e73b-0e9d-417d-b01c-59b651016763', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1356353759765625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 796623465}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 796623465}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 796623465}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 796623465}]}, 'public_addr': '172.21.15.112:6801/796623465', 'cluster_addr': '172.21.15.112:6803/796623465', 'heartbeat_back_addr': '172.21.15.112:6807/796623465', 'heartbeat_front_addr': '172.21.15.112:6805/796623465', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.174731+0000', 'dead_epoch': 41}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.475467+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.606174+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.835957+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.753547+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.284212+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.9', 'osds': [1, 0]}], 'pg_upmap_items': [{'pgid': '3.9', 'mappings': [{'from': 4, 'to': 0}]}, {'pgid': '3.a', 'mappings': [{'from': 4, 'to': 1}]}, {'pgid': '3.10', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.13', 'mappings': [{'from': 3, 'to': 0}]}], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '1.0', 'osds': [3, 2]}, {'pgid': '3.9', 'osds': [1, 2]}, {'pgid': '3.10', 'osds': [2, 5]}, {'pgid': '3.13', 'osds': [5, 3]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T08:40:32.409 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:40:32.419 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:32.419 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:32.434 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:32.454 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:32.454+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:32.523 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:32.526+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:32.595 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:32.595 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:32.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:32.655 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:32.658+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:32.726 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:32.726+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:32.728 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:40:32.729 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:40:32.735 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:32.735 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:32.750 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-14T08:40:32.288483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":375238946,"num_objects":568,"num_object_clones":112,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":59,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":326,"num_read":300076,"num_read_kb":361714,"num_write":3583,"num_write_kb":106190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":1472702,"num_keys_recovered":26,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3652,"ondisk_log_size":3652,"up":65,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":240268,"kb_used_data":36492,"kb_used_omap":9,"kb_used_meta":203638,"kb_avail":565990772,"statfs":{"total":579820584960,"available":579574550528,"internally_reserved":0,"allocated":37367808,"data_stored":34345310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":208525984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":38372483,"num_objects":23,"num_object_clones":10,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":11,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":8,"num_read":4062,"num_read_kb":15823,"num_write":322,"num_write_kb":2889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.069410"},"pg_stats":[{"pgid":"3.1f","version":"66'26","reported_seq":156,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:30.248600+0000","last_change":"2024-09-14T08:39:52.554986+0000","last_active":"2024-09-14T08:40:30.248600+0000","last_peered":"2024-09-14T08:40:30.248600+0000","last_clean":"2024-09-14T08:39:47.197484+0000","last_became_active":"2024-09-14T08:39:52.554986+0000","last_became_peered":"2024-09-14T08:39:52.554986+0000","last_unstale":"2024-09-14T08:40:30.248600+0000","last_undegraded":"2024-09-14T08:39:52.551188+0000","last_fullsized":"2024-09-14T08:39:52.550960+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:43.384070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001451897,"stat_sum":{"num_bytes":90,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":12,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":10,"num_read":33,"num_read_kb":12,"num_write":16,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":12}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"66'50","reported_seq":25479,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.237430+0000","last_change":"2024-09-14T08:39:20.418973+0000","last_active":"2024-09-14T08:40:30.237430+0000","last_peered":"2024-09-14T08:40:30.237430+0000","last_clean":"2024-09-14T08:40:30.237430+0000","last_became_active":"2024-09-14T08:39:18.380137+0000","last_became_peered":"2024-09-14T08:39:18.380137+0000","last_unstale":"2024-09-14T08:40:30.237430+0000","last_undegraded":"2024-09-14T08:40:30.237430+0000","last_fullsized":"2024-09-14T08:40:30.237430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:32.314594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013459450000000001,"stat_sum":{"num_bytes":11000832,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":13,"num_read":25337,"num_read_kb":21735,"num_write":39,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"65'67","reported_seq":2673,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.235588+0000","last_change":"2024-09-14T08:40:16.727831+0000","last_active":"2024-09-14T08:40:30.235588+0000","last_peered":"2024-09-14T08:40:30.235588+0000","last_clean":"2024-09-14T08:40:30.235588+0000","last_became_active":"2024-09-14T08:40:16.726695+0000","last_became_peered":"2024-09-14T08:40:16.726695+0000","last_unstale":"2024-09-14T08:40:30.235588+0000","last_undegraded":"2024-09-14T08:40:30.235588+0000","last_fullsized":"2024-09-14T08:40:30.235588+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:46.334743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003027493,"stat_sum":{"num_bytes":8785408,"num_objects":21,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":14,"num_read":2540,"num_read_kb":20745,"num_write":51,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"68'248","reported_seq":2365,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.926140+0000","last_change":"2024-09-14T08:40:16.728168+0000","last_active":"2024-09-14T08:40:30.926140+0000","last_peered":"2024-09-14T08:40:30.926140+0000","last_clean":"2024-09-14T08:40:30.926140+0000","last_became_active":"2024-09-14T08:40:16.726971+0000","last_became_peered":"2024-09-14T08:40:16.726971+0000","last_unstale":"2024-09-14T08:40:30.926140+0000","last_undegraded":"2024-09-14T08:40:30.926140+0000","last_fullsized":"2024-09-14T08:40:30.926140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:54.699434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001345691,"stat_sum":{"num_bytes":19757086,"num_objects":18,"num_object_clones":3,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":11,"num_read":2927,"num_read_kb":16404,"num_write":338,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"65'97","reported_seq":654,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:30.938237+0000","last_change":"2024-09-14T08:39:52.563176+0000","last_active":"2024-09-14T08:40:30.938237+0000","last_peered":"2024-09-14T08:40:30.938237+0000","last_clean":"2024-09-14T08:39:47.936799+0000","last_became_active":"2024-09-14T08:39:52.563176+0000","last_became_peered":"2024-09-14T08:39:52.563176+0000","last_unstale":"2024-09-14T08:40:30.938237+0000","last_undegraded":"2024-09-14T08:39:52.558992+0000","last_fullsized":"2024-09-14T08:39:52.558706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:41.824133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910279999999999,"stat_sum":{"num_bytes":799232,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":7,"num_read":1056,"num_read_kb":1326,"num_write":49,"num_write_kb":724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":13}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"68'109","reported_seq":1321,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:31.174253+0000","last_change":"2024-09-14T08:39:20.388365+0000","last_active":"2024-09-14T08:40:31.174253+0000","last_peered":"2024-09-14T08:40:31.174253+0000","last_clean":"2024-09-14T08:40:31.174253+0000","last_became_active":"2024-09-14T08:39:18.383879+0000","last_became_peered":"2024-09-14T08:39:18.383879+0000","last_unstale":"2024-09-14T08:40:31.174253+0000","last_undegraded":"2024-09-14T08:40:31.174253+0000","last_fullsized":"2024-09-14T08:40:31.174253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:02.291182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211712,"stat_sum":{"num_bytes":2961478,"num_objects":17,"num_object_clones":4,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":8,"num_read":1481,"num_read_kb":1641,"num_write":157,"num_write_kb":1743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"65'165","reported_seq":1034,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.230533+0000","last_change":"2024-09-14T08:39:20.386019+0000","last_active":"2024-09-14T08:40:30.230533+0000","last_peered":"2024-09-14T08:40:30.230533+0000","last_clean":"2024-09-14T08:40:30.230533+0000","last_became_active":"2024-09-14T08:39:18.384097+0000","last_became_peered":"2024-09-14T08:39:18.384097+0000","last_unstale":"2024-09-14T08:40:30.230533+0000","last_undegraded":"2024-09-14T08:40:30.230533+0000","last_fullsized":"2024-09-14T08:40:30.230533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:01.041812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014331750000000001,"stat_sum":{"num_bytes":3047503,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":7,"num_read":1357,"num_read_kb":4415,"num_write":234,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"65'49","reported_seq":290,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:30.237881+0000","last_change":"2024-09-14T08:39:52.548543+0000","last_active":"2024-09-14T08:40:30.237881+0000","last_peered":"2024-09-14T08:40:30.237881+0000","last_clean":"2024-09-14T08:39:50.545311+0000","last_became_active":"2024-09-14T08:39:52.548543+0000","last_became_peered":"2024-09-14T08:39:52.548543+0000","last_unstale":"2024-09-14T08:40:30.237881+0000","last_undegraded":"2024-09-14T08:39:52.547916+0000","last_fullsized":"2024-09-14T08:39:52.547825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:21.014583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922599999999997,"stat_sum":{"num_bytes":532628,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":16,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":11,"num_read":146,"num_read_kb":1399,"num_write":37,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"67'102","reported_seq":2756,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:30.244861+0000","last_change":"2024-09-14T08:39:52.560566+0000","last_active":"2024-09-14T08:40:30.244861+0000","last_peered":"2024-09-14T08:40:30.244861+0000","last_clean":"2024-09-14T08:39:44.516221+0000","last_became_active":"2024-09-14T08:39:52.560566+0000","last_became_peered":"2024-09-14T08:39:52.560566+0000","last_unstale":"2024-09-14T08:40:30.244861+0000","last_undegraded":"2024-09-14T08:39:52.556527+0000","last_fullsized":"2024-09-14T08:39:52.556283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:06.704803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862059999999999,"stat_sum":{"num_bytes":23857936,"num_objects":24,"num_object_clones":5,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":24,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":11,"num_read":2861,"num_read_kb":16038,"num_write":87,"num_write_kb":2603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":24}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"66'84","reported_seq":24477,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.248357+0000","last_change":"2024-09-14T08:40:16.720495+0000","last_active":"2024-09-14T08:40:30.248357+0000","last_peered":"2024-09-14T08:40:30.248357+0000","last_clean":"2024-09-14T08:40:30.248357+0000","last_became_active":"2024-09-14T08:40:16.719362+0000","last_became_peered":"2024-09-14T08:40:16.719362+0000","last_unstale":"2024-09-14T08:40:30.248357+0000","last_undegraded":"2024-09-14T08:40:30.248357+0000","last_fullsized":"2024-09-14T08:40:30.248357+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:18.582399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029337040000000001,"stat_sum":{"num_bytes":6948352,"num_objects":17,"num_object_clones":5,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":9,"num_read":24293,"num_read_kb":17115,"num_write":79,"num_write_kb":1645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"66'69","reported_seq":943,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:30.956898+0000","last_change":"2024-09-14T08:39:52.554928+0000","last_active":"2024-09-14T08:40:30.956898+0000","last_peered":"2024-09-14T08:40:30.956898+0000","last_clean":"2024-09-14T08:39:50.547225+0000","last_became_active":"2024-09-14T08:39:52.554928+0000","last_became_peered":"2024-09-14T08:39:52.554928+0000","last_unstale":"2024-09-14T08:40:30.956898+0000","last_undegraded":"2024-09-14T08:39:52.550685+0000","last_fullsized":"2024-09-14T08:39:52.550453+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:17.164549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018449409999999999,"stat_sum":{"num_bytes":28988513,"num_objects":15,"num_object_clones":3,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":9,"num_read":810,"num_read_kb":4816,"num_write":59,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":15}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"68'76","reported_seq":28346,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.741641+0000","last_change":"2024-09-14T08:39:20.410293+0000","last_active":"2024-09-14T08:40:30.741641+0000","last_peered":"2024-09-14T08:40:30.741641+0000","last_clean":"2024-09-14T08:40:30.741641+0000","last_became_active":"2024-09-14T08:39:18.386000+0000","last_became_peered":"2024-09-14T08:39:18.386000+0000","last_unstale":"2024-09-14T08:40:30.741641+0000","last_undegraded":"2024-09-14T08:40:30.741641+0000","last_fullsized":"2024-09-14T08:40:30.741641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:32.088660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014343330000000001,"stat_sum":{"num_bytes":29512436,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":6,"num_read":28318,"num_read_kb":24539,"num_write":90,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.249041+0000","last_change":"2024-09-14T08:39:10.710340+0000","last_active":"2024-09-14T08:40:30.249041+0000","last_peered":"2024-09-14T08:40:30.249041+0000","last_clean":"2024-09-14T08:40:30.249041+0000","last_became_active":"2024-09-14T08:39:08.202439+0000","last_became_peered":"2024-09-14T08:39:08.202439+0000","last_unstale":"2024-09-14T08:40:30.249041+0000","last_undegraded":"2024-09-14T08:40:30.249041+0000","last_fullsized":"2024-09-14T08:40:30.249041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:23.410553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001636462,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"66'96","reported_seq":45383,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:30.230531+0000","last_change":"2024-09-14T08:39:52.551765+0000","last_active":"2024-09-14T08:40:30.230531+0000","last_peered":"2024-09-14T08:40:30.230531+0000","last_clean":"2024-09-14T08:39:47.208280+0000","last_became_active":"2024-09-14T08:39:52.551765+0000","last_became_peered":"2024-09-14T08:39:52.551765+0000","last_unstale":"2024-09-14T08:40:30.230531+0000","last_undegraded":"2024-09-14T08:39:52.550793+0000","last_fullsized":"2024-09-14T08:39:52.550716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:11:32.541806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484614,"stat_sum":{"num_bytes":25133568,"num_objects":22,"num_object_clones":5,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":22,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":15,"num_read":45207,"num_read_kb":30093,"num_write":76,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":22}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.231453+0000","last_change":"2024-09-14T08:39:10.138177+0000","last_active":"2024-09-14T08:40:30.231453+0000","last_peered":"2024-09-14T08:40:30.231453+0000","last_clean":"2024-09-14T08:40:30.231453+0000","last_became_active":"2024-09-14T08:39:08.132530+0000","last_became_peered":"2024-09-14T08:39:08.132530+0000","last_unstale":"2024-09-14T08:40:30.231453+0000","last_undegraded":"2024-09-14T08:40:30.231453+0000","last_fullsized":"2024-09-14T08:40:30.231453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:17.902057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"65'107","reported_seq":42783,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.237623+0000","last_change":"2024-09-14T08:39:20.419181+0000","last_active":"2024-09-14T08:40:30.237623+0000","last_peered":"2024-09-14T08:40:30.237623+0000","last_clean":"2024-09-14T08:40:30.237623+0000","last_became_active":"2024-09-14T08:39:18.382867+0000","last_became_peered":"2024-09-14T08:39:18.382867+0000","last_unstale":"2024-09-14T08:40:30.237623+0000","last_undegraded":"2024-09-14T08:40:30.237623+0000","last_fullsized":"2024-09-14T08:40:30.237623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:48.479507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015322599999999999,"stat_sum":{"num_bytes":18399271,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":10,"num_read":42610,"num_read_kb":31784,"num_write":94,"num_write_kb":27964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-09-14T08:40:30.247835+0000","last_change":"2024-09-14T08:39:52.558040+0000","last_active":"2024-09-14T08:40:30.247835+0000","last_peered":"2024-09-14T08:40:30.247835+0000","last_clean":"2024-09-14T08:39:50.547498+0000","last_became_active":"2024-09-14T08:39:52.558040+0000","last_became_peered":"2024-09-14T08:39:52.558040+0000","last_unstale":"2024-09-14T08:40:30.247835+0000","last_undegraded":"2024-09-14T08:40:30.247835+0000","last_fullsized":"2024-09-14T08:39:52.551903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:32.236979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"68'217","reported_seq":1410,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:31.322828+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:40:31.322828+0000","last_peered":"2024-09-14T08:40:31.322828+0000","last_clean":"2024-09-14T08:40:31.322828+0000","last_became_active":"2024-09-14T08:39:18.387737+0000","last_became_peered":"2024-09-14T08:39:18.387737+0000","last_unstale":"2024-09-14T08:40:31.322828+0000","last_undegraded":"2024-09-14T08:40:31.322828+0000","last_fullsized":"2024-09-14T08:40:31.322828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.834470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010096059999999999,"stat_sum":{"num_bytes":31673381,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":9,"num_read":2152,"num_read_kb":4439,"num_write":264,"num_write_kb":17400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-09-14T08:40:30.230679+0000","last_change":"2024-09-14T08:39:52.551815+0000","last_active":"2024-09-14T08:40:30.230679+0000","last_peered":"2024-09-14T08:40:30.230679+0000","last_clean":"2024-09-14T08:39:50.569724+0000","last_became_active":"2024-09-14T08:39:52.551815+0000","last_became_peered":"2024-09-14T08:39:52.551815+0000","last_unstale":"2024-09-14T08:40:30.230679+0000","last_undegraded":"2024-09-14T08:40:30.230679+0000","last_fullsized":"2024-09-14T08:39:52.550804+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:21.879310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'335","reported_seq":497,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.517578+0000","last_change":"2024-09-14T08:40:16.717901+0000","last_active":"2024-09-14T08:40:30.517578+0000","last_peered":"2024-09-14T08:40:30.517578+0000","last_clean":"2024-09-14T08:40:30.517578+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:40:30.517578+0000","last_undegraded":"2024-09-14T08:40:30.517578+0000","last_fullsized":"2024-09-14T08:40:30.517578+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:03.871609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032365710000000002,"stat_sum":{"num_bytes":2524904,"num_objects":19,"num_object_clones":2,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":11,"num_read":1717,"num_read_kb":1451,"num_write":574,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"66'74","reported_seq":15853,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:30.234744+0000","last_change":"2024-09-14T08:39:52.566848+0000","last_active":"2024-09-14T08:40:30.234744+0000","last_peered":"2024-09-14T08:40:30.234744+0000","last_clean":"2024-09-14T08:39:50.573428+0000","last_became_active":"2024-09-14T08:39:52.566848+0000","last_became_peered":"2024-09-14T08:39:52.566848+0000","last_unstale":"2024-09-14T08:40:30.234744+0000","last_undegraded":"2024-09-14T08:39:52.559844+0000","last_fullsized":"2024-09-14T08:39:52.559536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:42.339283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599846,"stat_sum":{"num_bytes":3775488,"num_objects":25,"num_object_clones":4,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":25,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":16,"num_read":15685,"num_read_kb":9214,"num_write":58,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":25}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.231089+0000","last_change":"2024-09-14T08:40:16.717703+0000","last_active":"2024-09-14T08:40:30.231089+0000","last_peered":"2024-09-14T08:40:30.231089+0000","last_clean":"2024-09-14T08:40:30.231089+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:40:30.231089+0000","last_undegraded":"2024-09-14T08:40:30.231089+0000","last_fullsized":"2024-09-14T08:40:30.231089+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:18.988966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"65'49","reported_seq":24723,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.888626+0000","last_change":"2024-09-14T08:39:20.385113+0000","last_active":"2024-09-14T08:40:30.888626+0000","last_peered":"2024-09-14T08:40:30.888626+0000","last_clean":"2024-09-14T08:40:30.888626+0000","last_became_active":"2024-09-14T08:39:18.387585+0000","last_became_peered":"2024-09-14T08:39:18.387585+0000","last_unstale":"2024-09-14T08:40:30.888626+0000","last_undegraded":"2024-09-14T08:40:30.888626+0000","last_fullsized":"2024-09-14T08:40:30.888626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:12.225006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058750299999999996,"stat_sum":{"num_bytes":8836640,"num_objects":19,"num_object_clones":4,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":10,"num_read":24590,"num_read_kb":17245,"num_write":39,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.237293+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:40:30.237293+0000","last_peered":"2024-09-14T08:40:30.237293+0000","last_clean":"2024-09-14T08:40:30.237293+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:40:30.237293+0000","last_undegraded":"2024-09-14T08:40:30.237293+0000","last_fullsized":"2024-09-14T08:40:30.237293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"65'78","reported_seq":587,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:30.234627+0000","last_change":"2024-09-14T08:39:52.560317+0000","last_active":"2024-09-14T08:40:30.234627+0000","last_peered":"2024-09-14T08:40:30.234627+0000","last_clean":"2024-09-14T08:39:44.515729+0000","last_became_active":"2024-09-14T08:39:52.560317+0000","last_became_peered":"2024-09-14T08:39:52.560317+0000","last_unstale":"2024-09-14T08:40:30.234627+0000","last_undegraded":"2024-09-14T08:39:52.558935+0000","last_fullsized":"2024-09-14T08:39:52.558691+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:33.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047135900000000002,"stat_sum":{"num_bytes":18713600,"num_objects":10,"num_object_clones":3,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":10,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":6,"num_read":418,"num_read_kb":1551,"num_write":67,"num_write_kb":951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":10}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.246682+0000","last_change":"2024-09-14T08:39:10.709726+0000","last_active":"2024-09-14T08:40:30.246682+0000","last_peered":"2024-09-14T08:40:30.246682+0000","last_clean":"2024-09-14T08:40:30.246682+0000","last_became_active":"2024-09-14T08:39:08.129482+0000","last_became_peered":"2024-09-14T08:39:08.129482+0000","last_unstale":"2024-09-14T08:40:30.246682+0000","last_undegraded":"2024-09-14T08:40:30.246682+0000","last_fullsized":"2024-09-14T08:40:30.246682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.464996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010748229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"65'28","reported_seq":914,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.230929+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:40:30.230929+0000","last_peered":"2024-09-14T08:40:30.230929+0000","last_clean":"2024-09-14T08:40:30.230929+0000","last_became_active":"2024-09-14T08:39:18.387242+0000","last_became_peered":"2024-09-14T08:39:18.387242+0000","last_unstale":"2024-09-14T08:40:30.230929+0000","last_undegraded":"2024-09-14T08:40:30.230929+0000","last_fullsized":"2024-09-14T08:40:30.230929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:05.665897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332069,"stat_sum":{"num_bytes":5649936,"num_objects":10,"num_object_clones":1,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":6,"num_read":784,"num_read_kb":8127,"num_write":22,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":36,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.237438+0000","last_change":"2024-09-14T08:40:16.718478+0000","last_active":"2024-09-14T08:40:30.237438+0000","last_peered":"2024-09-14T08:40:30.237438+0000","last_clean":"2024-09-14T08:40:30.237438+0000","last_became_active":"2024-09-14T08:40:16.717575+0000","last_became_peered":"2024-09-14T08:40:16.717575+0000","last_unstale":"2024-09-14T08:40:30.237438+0000","last_undegraded":"2024-09-14T08:40:30.237438+0000","last_fullsized":"2024-09-14T08:40:30.237438+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:50.808473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":26,"reported_epoch":68,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:30.246668+0000","last_change":"2024-09-14T08:40:23.790351+0000","last_active":"2024-09-14T08:40:30.246668+0000","last_peered":"2024-09-14T08:40:30.246668+0000","last_clean":"2024-09-14T08:40:30.246668+0000","last_became_active":"2024-09-14T08:40:23.783250+0000","last_became_peered":"2024-09-14T08:40:23.783250+0000","last_unstale":"2024-09-14T08:40:30.246668+0000","last_undegraded":"2024-09-14T08:40:30.246668+0000","last_fullsized":"2024-09-14T08:40:30.246668+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:19.575116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[{"shards":"2,3","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"68'159","reported_seq":30151,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.920894+0000","last_change":"2024-09-14T08:39:20.418935+0000","last_active":"2024-09-14T08:40:30.920894+0000","last_peered":"2024-09-14T08:40:30.920894+0000","last_clean":"2024-09-14T08:40:30.920894+0000","last_became_active":"2024-09-14T08:39:18.382844+0000","last_became_peered":"2024-09-14T08:39:18.382844+0000","last_unstale":"2024-09-14T08:40:30.920894+0000","last_undegraded":"2024-09-14T08:40:30.920894+0000","last_fullsized":"2024-09-14T08:40:30.920894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:58.848676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013334390000000001,"stat_sum":{"num_bytes":6590525,"num_objects":19,"num_object_clones":2,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":11,"num_read":28640,"num_read_kb":20661,"num_write":96,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"66'173","reported_seq":2329,"reported_epoch":68,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:30.953626+0000","last_change":"2024-09-14T08:40:13.684553+0000","last_active":"2024-09-14T08:40:30.953626+0000","last_peered":"2024-09-14T08:40:30.953626+0000","last_clean":"2024-09-14T08:40:30.953626+0000","last_became_active":"2024-09-14T08:40:13.683804+0000","last_became_peered":"2024-09-14T08:40:13.683804+0000","last_unstale":"2024-09-14T08:40:30.953626+0000","last_undegraded":"2024-09-14T08:40:30.953626+0000","last_fullsized":"2024-09-14T08:40:30.953626+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:01:23.038099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011980249999999999,"stat_sum":{"num_bytes":16258560,"num_objects":21,"num_object_clones":6,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":21,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":12,"num_read":3632,"num_read_kb":4809,"num_write":145,"num_write_kb":2298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":97792,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":21}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"68'127","reported_seq":4510,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:31.302588+0000","last_change":"2024-09-14T08:39:55.635377+0000","last_active":"2024-09-14T08:40:31.302588+0000","last_peered":"2024-09-14T08:40:31.302588+0000","last_clean":"2024-09-14T08:40:31.302588+0000","last_became_active":"2024-09-14T08:39:55.584059+0000","last_became_peered":"2024-09-14T08:39:55.584059+0000","last_unstale":"2024-09-14T08:40:31.302588+0000","last_undegraded":"2024-09-14T08:40:31.302588+0000","last_fullsized":"2024-09-14T08:40:31.302588+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:27.930938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002911753,"stat_sum":{"num_bytes":29408768,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":8,"num_read":4888,"num_read_kb":44497,"num_write":94,"num_write_kb":33603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16384,"num_keys_recovered":15,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"66'59","reported_seq":326,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:30.230743+0000","last_change":"2024-09-14T08:39:52.551432+0000","last_active":"2024-09-14T08:40:30.230743+0000","last_peered":"2024-09-14T08:40:30.230743+0000","last_clean":"2024-09-14T08:39:50.569609+0000","last_became_active":"2024-09-14T08:39:52.551432+0000","last_became_peered":"2024-09-14T08:39:52.551432+0000","last_unstale":"2024-09-14T08:40:30.230743+0000","last_undegraded":"2024-09-14T08:39:52.550774+0000","last_fullsized":"2024-09-14T08:39:52.550674+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:32.709664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013500459999999999,"stat_sum":{"num_bytes":1140752,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":8,"num_read":167,"num_read_kb":971,"num_write":53,"num_write_kb":1141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":14}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"65'123","reported_seq":25830,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:30.244210+0000","last_change":"2024-09-14T08:39:52.561097+0000","last_active":"2024-09-14T08:40:30.244210+0000","last_peered":"2024-09-14T08:40:30.244210+0000","last_clean":"2024-09-14T08:39:50.651509+0000","last_became_active":"2024-09-14T08:39:52.561097+0000","last_became_peered":"2024-09-14T08:39:52.561097+0000","last_unstale":"2024-09-14T08:40:30.244210+0000","last_undegraded":"2024-09-14T08:39:52.557286+0000","last_fullsized":"2024-09-14T08:39:52.556541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:06.648670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652499,"stat_sum":{"num_bytes":10177575,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":13,"num_read":26365,"num_read_kb":20163,"num_write":108,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":23}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"66'278","reported_seq":2845,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.910958+0000","last_change":"2024-09-14T08:39:20.411611+0000","last_active":"2024-09-14T08:40:30.910958+0000","last_peered":"2024-09-14T08:40:30.910958+0000","last_clean":"2024-09-14T08:40:30.910958+0000","last_became_active":"2024-09-14T08:39:18.373934+0000","last_became_peered":"2024-09-14T08:39:18.373934+0000","last_unstale":"2024-09-14T08:40:30.910958+0000","last_undegraded":"2024-09-14T08:40:30.910958+0000","last_fullsized":"2024-09-14T08:40:30.910958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:26:34.244166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024901429999999998,"stat_sum":{"num_bytes":3124736,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":6,"num_read":4862,"num_read_kb":5464,"num_write":139,"num_write_kb":876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"66'41","reported_seq":753,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.234988+0000","last_change":"2024-09-14T08:40:16.728183+0000","last_active":"2024-09-14T08:40:30.234988+0000","last_peered":"2024-09-14T08:40:30.234988+0000","last_clean":"2024-09-14T08:40:30.234988+0000","last_became_active":"2024-09-14T08:40:16.727022+0000","last_became_peered":"2024-09-14T08:40:16.727022+0000","last_unstale":"2024-09-14T08:40:30.234988+0000","last_undegraded":"2024-09-14T08:40:30.234988+0000","last_fullsized":"2024-09-14T08:40:30.234988+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:35.386561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002389113,"stat_sum":{"num_bytes":5900800,"num_objects":16,"num_object_clones":2,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":11,"num_read":641,"num_read_kb":4796,"num_write":31,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"67'92","reported_seq":842,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.248609+0000","last_change":"2024-09-14T08:40:16.723453+0000","last_active":"2024-09-14T08:40:30.248609+0000","last_peered":"2024-09-14T08:40:30.248609+0000","last_clean":"2024-09-14T08:40:30.248609+0000","last_became_active":"2024-09-14T08:40:16.722386+0000","last_became_peered":"2024-09-14T08:40:16.722386+0000","last_unstale":"2024-09-14T08:40:30.248609+0000","last_undegraded":"2024-09-14T08:40:30.248609+0000","last_fullsized":"2024-09-14T08:40:30.248609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:12.763912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023917970000000002,"stat_sum":{"num_bytes":24787472,"num_objects":27,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":17,"num_read":694,"num_read_kb":4664,"num_write":73,"num_write_kb":2634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"68'93","reported_seq":393,"reported_epoch":68,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:30.687275+0000","last_change":"2024-09-14T08:39:56.643519+0000","last_active":"2024-09-14T08:40:30.687275+0000","last_peered":"2024-09-14T08:40:30.687275+0000","last_clean":"2024-09-14T08:40:30.687275+0000","last_became_active":"2024-09-14T08:39:56.593633+0000","last_became_peered":"2024-09-14T08:39:56.593633+0000","last_unstale":"2024-09-14T08:40:30.687275+0000","last_undegraded":"2024-09-14T08:40:30.687275+0000","last_fullsized":"2024-09-14T08:40:30.687275+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:21.436763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024547029999999999,"stat_sum":{"num_bytes":13418622,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":18,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":1745,"num_read_kb":14089,"num_write":93,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":177790,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[{"shards":"2,5","objects":18}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"65'111","reported_seq":913,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-14T08:40:30.246913+0000","last_change":"2024-09-14T08:39:20.410176+0000","last_active":"2024-09-14T08:40:30.246913+0000","last_peered":"2024-09-14T08:40:30.246913+0000","last_clean":"2024-09-14T08:40:30.246913+0000","last_became_active":"2024-09-14T08:39:18.385169+0000","last_became_peered":"2024-09-14T08:39:18.385169+0000","last_unstale":"2024-09-14T08:40:30.246913+0000","last_undegraded":"2024-09-14T08:40:30.246913+0000","last_fullsized":"2024-09-14T08:40:30.246913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:28.337543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001362044,"stat_sum":{"num_bytes":528896,"num_objects":21,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":14,"num_read":1506,"num_read_kb":1514,"num_write":73,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"68'141","reported_seq":2056,"reported_epoch":68,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:31.246475+0000","last_change":"2024-09-14T08:39:52.552459+0000","last_active":"2024-09-14T08:40:31.246475+0000","last_peered":"2024-09-14T08:40:31.246475+0000","last_clean":"2024-09-14T08:39:46.839527+0000","last_became_active":"2024-09-14T08:39:52.552459+0000","last_became_peered":"2024-09-14T08:39:52.552459+0000","last_unstale":"2024-09-14T08:40:31.246475+0000","last_undegraded":"2024-09-14T08:39:52.550601+0000","last_fullsized":"2024-09-14T08:39:52.550330+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:06.643161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013117140000000001,"stat_sum":{"num_bytes":3184205,"num_objects":21,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":11,"num_read":2239,"num_read_kb":4251,"num_write":98,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":21}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"66'54","reported_seq":446,"reported_epoch":68,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:30.244042+0000","last_change":"2024-09-14T08:39:56.592735+0000","last_active":"2024-09-14T08:40:30.244042+0000","last_peered":"2024-09-14T08:40:30.244042+0000","last_clean":"2024-09-14T08:40:30.244042+0000","last_became_active":"2024-09-14T08:39:56.591710+0000","last_became_peered":"2024-09-14T08:39:56.591710+0000","last_unstale":"2024-09-14T08:40:30.244042+0000","last_undegraded":"2024-09-14T08:40:30.244042+0000","last_fullsized":"2024-09-14T08:40:30.244042+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:07.039209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018326740000000001,"stat_sum":{"num_bytes":9229366,"num_objects":18,"num_object_clones":3,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":18,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":9,"num_read":309,"num_read_kb":1691,"num_write":47,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[{"shards":"3,5","objects":18}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":374648559,"num_objects":564,"num_object_clones":112,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":57,"num_objects_unfound":0,"num_objects_dirty":564,"num_whiteouts":326,"num_read":300010,"num_read_kb":361659,"num_write":3480,"num_write_kb":104560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":291966,"num_keys_recovered":26,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":31846400,"data_stored":31448993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3577,"ondisk_log_size":3577,"up":50,"acting":53,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":14,"acting":14,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":1,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38232,"kb_used_data":2880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333608,"statfs":{"total":96636764160,"available":96597614592,"internally_reserved":0,"allocated":2949120,"data_stored":2370647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46332,"kb_used_data":10984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325508,"statfs":{"total":96636764160,"available":96589320192,"internally_reserved":0,"allocated":11247616,"data_stored":10737426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39780,"kb_used_data":4432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332060,"statfs":{"total":96636764160,"available":96596029440,"internally_reserved":0,"allocated":4538368,"data_stored":4023155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":8412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":8613888,"data_stored":8077345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607574,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41228,"kb_used_data":5880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330612,"statfs":{"total":96636764160,"available":96594546688,"internally_reserved":0,"allocated":6021120,"data_stored":5515320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607567,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35092,"kb_used_data":3904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336748,"statfs":{"total":96636764160,"available":96600829952,"internally_reserved":0,"allocated":3997696,"data_stored":3621417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3571712,"data_stored":3460262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7827456,"data_stored":7765342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3162112,"data_stored":3120803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9871360,"data_stored":9835074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2166784,"data_stored":2058663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5246976,"data_stored":5208849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:40:32.752 INFO:tasks.thrashosds.thrasher:Setting 3.a to [2, 5] 2024-09-14T08:40:32.752 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.a', '2', '5'] 2024-09-14T08:40:32.752 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.a 2 5 2024-09-14T08:40:32.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:32.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:32.827 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:32.830+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:32.847 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-14T08:40:32.917 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:32.917 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:32.927 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:32.930+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:32.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:32.968 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:32.988 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:32.989 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:33.007 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:33.007 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:33.028 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:33.030+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:33.030 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:33.030 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:33.053 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:33.053 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:33.055 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:33.055 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:33.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:33.055 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:33.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.055 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31797 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3304448~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.055 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:33.055 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.132091383999999, 2024-09-14T08:40:33.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071016060000000006, 2024-09-14T08:40:33.055 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31797 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925533+0000", 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0699999999999997e-07 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925536+0000", 2024-09-14T08:40:33.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.368e-06 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925543+0000", 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.781e-06 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925548+0000", 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996245+0000", 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070697276000000003 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996352+0000", 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107054 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996549+0000", 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000196942 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31798 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3306496~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.132069364000003, 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071397830999999995, 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.060 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31798 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925555+0000", 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925558+0000", 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2069999999999998e-06 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925564+0000", 2024-09-14T08:40:33.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6290000000000004e-06 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925569+0000", 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.164e-06 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996603+0000", 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071033712999999998 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996708+0000", 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010466700000000001 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.996953+0000", 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000244959 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31799 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3315712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.132048007000002, 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071768473999999999, 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31799 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925577+0000", 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925579+0000", 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925587+0000", 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925593+0000", 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997015+0000", 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071422484999999994 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997130+0000", 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115053 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997345+0000", 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214379 2024-09-14T08:40:33.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31800 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3326976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.132024321000003, 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072113090000000005, 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31800 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925603+0000", 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925610+0000", 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8029999999999997e-06 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925618+0000", 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6930000000000007e-06 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997400+0000", 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071781929999999994 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997507+0000", 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107012 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997713+0000", 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020603 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.073 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131998631999998, 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:40:33.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131976076000001, 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.078 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:40:33.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:40:33.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131908060999997, 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131858332999997, 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:40:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:40:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:40:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131807178000003, 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:40:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:40:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131755175000002, 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:40:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:40:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131692604999998, 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131626027000003, 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:40:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131548242999997, 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:40:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:40:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131495547999997, 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131449895000003, 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:40:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131403423999998, 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131357436000002, 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:40:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131329178000001, 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:40:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.131274400000002, 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:40:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.703503941000001, 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:33.147 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:33.147 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:33.148 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:33.148 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:33.148 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:33.149 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:33.146+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:33.247 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:33.250+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:33.261 INFO:teuthology.orchestra.run.smithi089.stderr:set 3.a pg_upmap mapping to [2,5] 2024-09-14T08:40:33.336 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:33.336 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:33.336 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:33.336 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:33.348 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:33.346+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:33.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:33.449 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:33.450+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:33.513 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:33.513 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:33.513 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:33.513 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:33.513 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:33.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:33.550 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:33.550+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:33.649 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:33.649 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:33.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:33.649 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:33.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33403 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3560448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372529769000003, 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065276109999999998, 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33403 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277827+0000", 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.23e-07 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277830+0000", 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277839+0000", 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277846+0000", 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1590000000000004e-06 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342820+0000", 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064974064999999998 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342954+0000", 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133509 2024-09-14T08:40:33.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343102+0000", 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000148539 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33404 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3571712~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372498307000001, 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065555713000000002, 2024-09-14T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33404 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277861+0000", 2024-09-14T08:40:33.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9790000000000002e-06 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277881+0000", 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9463999999999999e-05 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277889+0000", 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7190000000000001e-06 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343177+0000", 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065288760000000001 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343279+0000", 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101974 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343414+0000", 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013411 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.658 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33405 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372456995999997, 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065812103999999996, 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.659 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33405 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277900+0000", 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277922+0000", 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1540999999999999e-05 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277932+0000", 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0587999999999999e-05 2024-09-14T08:40:33.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277940+0000", 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5360000000000004e-06 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343480+0000", 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065539753000000006 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343581+0000", 2024-09-14T08:40:33.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101005 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343711+0000", 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013069500000000001 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:33.663 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372404863, 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:33.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:40:33.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:40:33.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372376066999998, 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:40:33.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372347247999997, 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:33.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372318919000001, 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.677 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:40:33.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.681 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372289719000001, 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:40:33.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372257711000003, 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.686 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:40:33.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.690 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372228434999997, 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:40:33.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:40:33.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:33.695 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372198769000001, 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:33.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372170226000001, 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.700 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:40:33.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372141919999997, 2024-09-14T08:40:33.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:40:33.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.708 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372096653, 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:40:33.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:40:33.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.713 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372065030999998, 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.714 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.372007218999997, 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.718 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:33.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.722 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.371939206, 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:40:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.371903834000001, 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:40:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:40:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.371869435000001, 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.344798881999999, 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:40:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:40:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:33.742 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:33.743 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:33.743 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:33.745+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:33.844 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:33.846+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:33.875 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:33.875 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:33.875 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:33.876 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:33.889 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:33.945 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:33.946+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:34.009 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:34.009 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:34.023 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:34.067 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:34.069+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:34.146 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:34.146+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:34.147 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:34.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.903559919999999, 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.148 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:40:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.152 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.903497907000002, 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:40:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.903431576999999, 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:40:34.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.903376117000001, 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:40:34.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:40:34.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.903316496999999, 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:40:34.166 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.903234957000002, 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:40:34.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:40:34.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.903178629000003, 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:40:34.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:40:34.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.903107134000003, 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:40:34.180 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.184 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.903034263000002, 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:40:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:40:34.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902992050999998, 2024-09-14T08:40:34.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:34.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:40:34.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902962221000003, 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.194 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:34.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.198 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902933924000003, 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:40:34.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:40:34.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902892829000002, 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:40:34.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:40:34.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902863799000002, 2024-09-14T08:40:34.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:40:34.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902835314999997, 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.212 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:40:34.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902807175, 2024-09-14T08:40:34.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:40:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.220 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902778478999998, 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:40:34.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:40:34.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902749722000003, 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.225 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.229 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902721675000002, 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:40:34.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.902691697999998, 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:40:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:40:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.238 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:34.239 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:34.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:40:34.283 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:34.285+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:34.348 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:34.349+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:34.412 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:34.413 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:34.413 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:34.413 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:34.428 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:34.448 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:34.446+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:34.549 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:34.549+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:34.598 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:34.598 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:34.598 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:34.598 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:34.598 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:34.613 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:34.657 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:34.657+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:34.750 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:34.749+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:34.785 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.901829991, 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:34.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:40:34.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.890577956000001, 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.791 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:40:34.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.889718071000001, 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.795 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:34.799 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.889411446, 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:34.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.889008110999999, 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:40:34.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.888604407999999, 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:40:34.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.888253662, 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:40:34.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.88786739, 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.817 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:34.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:40:34.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.887676856999999, 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:40:34.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:40:34.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:34.826 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.887170129000001, 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:40:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.886844057000001, 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.831 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:40:34.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.886534444999999, 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:40:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.886038902999999, 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:40:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.885723145, 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:40:34.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:40:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:40:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:40:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:40:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.849 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.885235709, 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:34.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.853 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.884885697000001, 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.854 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:40:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:40:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:40:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:40:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:40:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:40:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.884094577999999, 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:40:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:40:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:40:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.883685519, 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:40:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.881052832000002, 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.054562190999999, 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:40:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:40:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:40:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:34.882 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:34.883 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:34.884 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:34.885+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:34.981 INFO:teuthology.orchestra.run.smithi188.stdout:1411 read 0x774da00 thru 0x774feb0 (0x24b1 bytes) 2024-09-14T08:40:34.983 INFO:teuthology.orchestra.run.smithi188.stdout:1412 read 0x8e4a000 thru 0x8e50524 (0x6525 bytes) 2024-09-14T08:40:34.984 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:34.985+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:34.984 INFO:teuthology.orchestra.run.smithi188.stdout:1413 punch from 0x9ab2000 to 0x9ab2200, (0x200 bytes) 2024-09-14T08:40:35.037 INFO:teuthology.orchestra.run.smithi188.stdout:1417 trunc from 0xbf3e600 to 0x5adf600 2024-09-14T08:40:35.055 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:35.056 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:35.056 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:35.056 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:35.070 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:35.085 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:35.082+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:35.136 INFO:teuthology.orchestra.run.smithi188.stdout:1418 write 0xc30ac00 thru 0xc312db2 (0x81b3 bytes) 2024-09-14T08:40:35.138 INFO:teuthology.orchestra.run.smithi188.stdout:1419 write 0x5506e00 thru 0x550be58 (0x5059 bytes) 2024-09-14T08:40:35.138 INFO:teuthology.orchestra.run.smithi188.stdout:1422 write 0x2198c00 thru 0x21a63e0 (0xd7e1 bytes) 2024-09-14T08:40:35.150 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:35.153 INFO:teuthology.orchestra.run.smithi188.stdout:1423 trunc from 0xc312e00 to 0xd80b800 2024-09-14T08:40:35.188 INFO:teuthology.orchestra.run.smithi188.stdout:1424 read 0x409ba00 thru 0x409e15a (0x275b bytes) 2024-09-14T08:40:35.190 INFO:teuthology.orchestra.run.smithi188.stdout:1426 write 0x9dbbe00 thru 0x9dc8be0 (0xcde1 bytes) 2024-09-14T08:40:35.191 INFO:teuthology.orchestra.run.smithi188.stdout:1427 read 0x5669600 thru 0x566d357 (0x3d58 bytes) 2024-09-14T08:40:35.191 INFO:teuthology.orchestra.run.smithi188.stdout:1428 read 0x5965400 thru 0x5972b25 (0xd726 bytes) 2024-09-14T08:40:35.192 INFO:teuthology.orchestra.run.smithi188.stdout:1430 read 0x5ecca00 thru 0x5ed5af5 (0x90f6 bytes) 2024-09-14T08:40:35.193 INFO:teuthology.orchestra.run.smithi188.stdout:1431 punch from 0x74f1800 to 0x74fd800, (0xc000 bytes) 2024-09-14T08:40:35.193 INFO:teuthology.orchestra.run.smithi188.stdout:1432 write 0x5502800 thru 0x5509289 (0x6a8a bytes) 2024-09-14T08:40:35.194 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:35.194+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:35.195 INFO:teuthology.orchestra.run.smithi188.stdout:1434 write 0x9a3ce00 thru 0x9a4593f (0x8b40 bytes) 2024-09-14T08:40:35.195 INFO:teuthology.orchestra.run.smithi188.stdout:1436 read 0x849e000 thru 0x84a4c3d (0x6c3e bytes) 2024-09-14T08:40:35.196 INFO:teuthology.orchestra.run.smithi188.stdout:1438 read 0x8b18000 thru 0x8b26f05 (0xef06 bytes) 2024-09-14T08:40:35.196 INFO:teuthology.orchestra.run.smithi188.stdout:1439 read 0x80c5200 thru 0x80cde6c (0x8c6d bytes) 2024-09-14T08:40:35.196 INFO:teuthology.orchestra.run.smithi188.stdout:1441 write 0xdadc00 thru 0xdbbb43 (0xdf44 bytes) 2024-09-14T08:40:35.198 INFO:teuthology.orchestra.run.smithi188.stdout:1442 flatten 2024-09-14T08:40:35.252 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:35.252 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:35.252 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:35.252 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:35.252 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:35.273 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:35.319 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:35.321+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:35.327 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:35.337 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:40:35.349 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:35.349 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:35.367 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:35.368 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:35.370 INFO:teuthology.orchestra.run.smithi188.stdout:1444 read 0x2966000 thru 0x2968238 (0x2239 bytes) 2024-09-14T08:40:35.371 INFO:teuthology.orchestra.run.smithi188.stdout:1445 write 0x3561400 thru 0x3568fd5 (0x7bd6 bytes) 2024-09-14T08:40:35.384 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:35.385 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:35.387 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:35.386+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:35.395 INFO:teuthology.orchestra.run.smithi188.stdout:1447 trunc from 0xd80b800 to 0x5569800 2024-09-14T08:40:35.402 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:35.402 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:35.423 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:35.423 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:35.426 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:35.426 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:35.426 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:35.426 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:35.442 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:35.488 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:35.489+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:35.589 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:35.589+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:35.592 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:35.592 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:35.606 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:35.690 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:35.693+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:35.726 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:35.726 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:35.740 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:35.791 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:35.793+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:35.871 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:35.871 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:35.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:35.930 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:35.930+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:35.993 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:35.993+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:36.015 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:36.015 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:36.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:36.122 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:36.122+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:36.194 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:36.193+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:36.202 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:36.202 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:36.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:36.295 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:36.297+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:36.389 INFO:teuthology.orchestra.run.smithi188.stdout:1450 write 0x4bf5a00 thru 0x4c00d51 (0xb352 bytes) 2024-09-14T08:40:36.390 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:36.390 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:36.391 INFO:teuthology.orchestra.run.smithi188.stdout:1460 punch from 0x29f8600 to 0x2a08000, (0xfa00 bytes) 2024-09-14T08:40:36.392 INFO:teuthology.orchestra.run.smithi188.stdout:1464 read 0x5292800 thru 0x52978c6 (0x50c7 bytes) 2024-09-14T08:40:36.392 INFO:teuthology.orchestra.run.smithi188.stdout:1469 punch from 0x1c2e00 to 0x1c6800, (0x3a00 bytes) 2024-09-14T08:40:36.392 INFO:teuthology.orchestra.run.smithi188.stdout:1471 write 0x670c00 thru 0x6741fb (0x35fc bytes) 2024-09-14T08:40:36.392 INFO:teuthology.orchestra.run.smithi188.stdout:1475 clone 13 order 22 su 1048576 sc 9 2024-09-14T08:40:36.396 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:36.397+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:36.409 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:36.496 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:36.494+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:36.531 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:36.531 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:36.545 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:36.597 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:36.594+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:36.667 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:36.667 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:36.681 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:36.727 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:36.729+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:36.798 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:36.797+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:36.804 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:36.804 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:36.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:36.901 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:36.902+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:36.985 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:36.985 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:36.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:37.002 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:37.002+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:37.105 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:37.102+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:37.120 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:37.120 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:37.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:37.206 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:37.206+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:37.249 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:37.249 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:37.265 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:37.310 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:37.306+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:37.362 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:40:37.387 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:37.387 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:37.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:37.410 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:37.410+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:37.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:37.513 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:37.510+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:37.523 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:37.523 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:37.539 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:37.549 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:37.566 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:37.566 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:37.585 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:37.585 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:37.606 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:37.606 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:37.614 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:37.613+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:37.625 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:37.625 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:37.644 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:37.644 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:37.647 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:37.647 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:37.665 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:37.665 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:37.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:37.665 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:37.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.665 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.589014872999996, 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:37.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588926776000001, 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.670 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588859378999999, 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:37.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:37.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588785682999998, 2024-09-14T08:40:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:37.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.683 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588710210999999, 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:37.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588653006999998, 2024-09-14T08:40:37.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:37.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:37.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.692 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588594123, 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.693 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:37.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.697 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588529197, 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:37.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588467745999999, 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.706 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588408211999997, 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:37.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:37.710 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588348902, 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.711 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:37.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:37.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:37.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 36.588276870000001, 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.719 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:37.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24681 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3076096~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:37.723 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.433941977, 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096091748000000005, 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24681 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:37.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233725+0000", 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.017e-06 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233735+0000", 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8430000000000005e-06 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233746+0000", 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1409e-05 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233756+0000", 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5230000000000001e-06 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329376+0000", 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095619941 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329544+0000", 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000168269 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329816+0000", 2024-09-14T08:40:37.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027174600000000001 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24682 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.433868030999999, 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096544940999999995, 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24682 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233799+0000", 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.08e-06 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233803+0000", 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4429999999999999e-06 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233816+0000", 2024-09-14T08:40:37.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3816e-05 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233824+0000", 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5859999999999999e-06 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329882+0000", 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096058344000000004 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330073+0000", 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019082999999999999 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330343+0000", 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026984200000000001 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:37.732 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.433829376, 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:40:37.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.433798597999999, 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.741 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.433732895, 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:40:37.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.433610723999999, 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:37.750 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.433576493, 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:40:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.433545068000001, 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:37.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:37.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:40:37.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:37.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:37.759 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:37.761 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:37.761+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:37.761 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:37.862 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:37.858+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:37.889 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:37.889 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:37.889 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:37.889 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:37.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:37.963 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:37.965+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:37.992 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-14T08:40:38.064 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:38.065+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:38.092 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:38.092 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:38.092 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:38.092 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:38.092 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:38.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:38.165 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:38.162+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:38.238 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31799 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3315712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.315183793000003, 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071768473999999999, 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.239 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31799 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:38.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925577+0000", 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925579+0000", 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925587+0000", 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925593+0000", 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997015+0000", 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071422484999999994 2024-09-14T08:40:38.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997130+0000", 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115053 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997345+0000", 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214379 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31800 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3326976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.315160106999997, 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072113090000000005, 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31800 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-14T08:40:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925603+0000", 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925610+0000", 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8029999999999997e-06 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925618+0000", 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6930000000000007e-06 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997400+0000", 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071781929999999994 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997507+0000", 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107012 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997713+0000", 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020603 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.315134418, 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.248 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:40:38.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.315111862000002, 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:40:38.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:40:38.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:38.257 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.315043846999998, 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:40:38.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314994118999998, 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.262 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:40:38.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314942963999997, 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:40:38.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:40:38.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.271 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314890961000003, 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:40:38.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314828390999999, 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:40:38.276 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314761812999997, 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:40:38.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314684028999999, 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:40:38.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:40:38.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:40:38.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:38.290 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314631333999998, 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:38.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:40:38.294 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314585680999997, 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:40:38.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:38.299 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.31453921, 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.303 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314493222000003, 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:40:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.308 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314464964000003, 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:40:38.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.314410186000003, 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.886639726999999, 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:40:38.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.8940356600000001, 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.322 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:40:38.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:40:38.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:40:38.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:40:38.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:40:38.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:40:38.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:38.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:40:38.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:40:38.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:40:38.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:40:38.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:38.331 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.8931972889999997, 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:40:38.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.336 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:38.337 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:40:38.337 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:40:38.337 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 4, 5] 2024-09-14T08:40:38.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-14T08:40:38.338 INFO:teuthology.orchestra.run.smithi188.stdout:1477 trunc from 0x5569800 to 0x68f2400 2024-09-14T08:40:38.339 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:38.337+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:38.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:38.349 INFO:teuthology.orchestra.run.smithi188.stdout:1478 trunc from 0x68f2400 to 0x11a7a00 2024-09-14T08:40:38.377 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:40:38.446 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:38.446+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:38.457 INFO:teuthology.orchestra.run.smithi188.stdout:1479 write 0x480f200 thru 0x480f5d2 (0x3d3 bytes) 2024-09-14T08:40:38.459 INFO:teuthology.orchestra.run.smithi188.stdout:1481 write 0x2d0b800 thru 0x2d14b1e (0x931f bytes) 2024-09-14T08:40:38.459 INFO:teuthology.orchestra.run.smithi188.stdout:1482 punch from 0x7c200 to 0x8a400, (0xe200 bytes) 2024-09-14T08:40:38.462 INFO:teuthology.orchestra.run.smithi188.stdout:1483 trunc from 0x480f600 to 0x3806e00 2024-09-14T08:40:38.506 INFO:teuthology.orchestra.run.smithi188.stdout:1486 punch from 0x2a1cc00 to 0x2a1d200, (0x600 bytes) 2024-09-14T08:40:38.507 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:38.507 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:38.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:38.539 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:38.541+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:38.541 INFO:teuthology.orchestra.run.smithi188.stdout:1487 write 0x41efa00 thru 0x41f394f (0x3f50 bytes) 2024-09-14T08:40:38.545 INFO:teuthology.orchestra.run.smithi188.stdout:1488 punch from 0x2eea00 to 0x2ef800, (0xe00 bytes) 2024-09-14T08:40:38.577 INFO:teuthology.orchestra.run.smithi188.stdout:1489 write 0x4d0f200 thru 0x4d1403a (0x4e3b bytes) 2024-09-14T08:40:38.640 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:38.641+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:38.690 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:38.690 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:38.690 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:38.690 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:38.690 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:38.694 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-14T08:40:38.694+0000 7f7148add640 -1 mon.a@0(leader).osd e76 definitely_dead 0 2024-09-14T08:40:38.701 INFO:teuthology.orchestra.run.smithi188.stdout:1490 write 0xdc03c00 thru 0xdc065d9 (0x29da bytes) 2024-09-14T08:40:38.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:38.705 INFO:teuthology.orchestra.run.smithi188.stdout:1493 clone 14 order 25 su 262144 sc 14 2024-09-14T08:40:38.741 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:38.741+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:38.823 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:38.823 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:38.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:38.823 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:38.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33403 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3560448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546397960999997, 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065276109999999998, 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33403 2024-09-14T08:40:38.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277826+0000", 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277827+0000", 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.23e-07 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277830+0000", 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9100000000000001e-06 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277839+0000", 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:40:38.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277846+0000", 2024-09-14T08:40:38.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1590000000000004e-06 2024-09-14T08:40:38.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342820+0000", 2024-09-14T08:40:38.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064974064999999998 2024-09-14T08:40:38.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.342954+0000", 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133509 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343102+0000", 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000148539 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33404 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3571712~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546366499000001, 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065555713000000002, 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.829 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33404 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277858+0000", 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277861+0000", 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9790000000000002e-06 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277881+0000", 2024-09-14T08:40:38.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9463999999999999e-05 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277889+0000", 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7190000000000001e-06 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343177+0000", 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065288760000000001 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343279+0000", 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101974 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343414+0000", 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013411 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.833 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33405 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546325187999997, 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065812103999999996, 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33405 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.834 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277899+0000", 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277900+0000", 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8599999999999996e-07 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277922+0000", 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1540999999999999e-05 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277932+0000", 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0587999999999999e-05 2024-09-14T08:40:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277940+0000", 2024-09-14T08:40:38.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5360000000000004e-06 2024-09-14T08:40:38.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343480+0000", 2024-09-14T08:40:38.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065539753000000006 2024-09-14T08:40:38.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343581+0000", 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101005 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343711+0000", 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013069500000000001 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546273055, 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:40:38.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:40:38.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:38.843 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546244258999998, 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546215439999997, 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:40:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:40:38.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.852 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546187111000002, 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:40:38.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:40:38.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.857 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546157911000002, 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:40:38.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:40:38.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546125902999997, 2024-09-14T08:40:38.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:38.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:38.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546096626999997, 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.867 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:38.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:40:38.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546066961000001, 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.872 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:40:38.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546038418000002, 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.877 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:38.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:40:38.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.546010111999998, 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.882 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.886 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.545964845, 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:40:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.545933222999999, 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.891 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:40:38.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:40:38.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.545875410999997, 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.896 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:38.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.545807398000001, 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:40:38.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.905 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.545772026000002, 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.906 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:40:38.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:38.910 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.545737627000001, 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:38.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:40:38.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:40:38.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.518667074, 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:38.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:40:38.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:40:38.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:38.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:38.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:38.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:40:38.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:40:38.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.921 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:38.921 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:38.921 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:38.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:38.923 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:38.926+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:39.024 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:39.026+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:39.054 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:39.054 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:39.054 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:39.055 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:39.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:39.125 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:39.125+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:39.193 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:39.193 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:39.207 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:39.251 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:39.253+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:39.327 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:39.329+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:39.382 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:39.382 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:39.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:39.382 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:39.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.382 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.382 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.136016224000002, 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:40:39.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135954210999998, 2024-09-14T08:40:39.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:40:39.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:40:39.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135887881000002, 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.396 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135832421000003, 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.397 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135772801000002, 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:40:39.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:40:39.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.406 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135691260999998, 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.407 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:40:39.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.411 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135634932999999, 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.412 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:39.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:39.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:40:39.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:40:39.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:40:39.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:40:39.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:40:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:40:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135563437999998, 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:40:39.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135490566999998, 2024-09-14T08:40:39.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:39.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:39.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:40:39.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:40:39.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:40:39.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:40:39.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:40:39.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135448355000001, 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:40:39.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.432 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135418524999999, 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:40:39.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:39.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:40:39.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:39.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:40:39.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.437 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135390227999999, 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.442 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135349132999998, 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:40:39.446 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135320102999998, 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:40:39.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.452 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.452 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:39.452 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135291619, 2024-09-14T08:40:39.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:40:39.452 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.452 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.452 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.452 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.452 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.453 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:40:39.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.453 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:39.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:40:39.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135263479000002, 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.457 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:40:39.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:40:39.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:40:39.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:40:39.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135234783000001, 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:40:39.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:40:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:40:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:40:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:40:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:40:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135206025999999, 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:39.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135177978999998, 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.473 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:39.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:40:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:40:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:40:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.135148002000001, 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:39.478 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:39.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:40:39.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:40:39.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:39.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:40:39.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:40:39.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:39.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:40:39.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:40:39.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.483 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.483 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.483 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:39.485 INFO:teuthology.orchestra.run.smithi089.stderr:marked out osd.3. 2024-09-14T08:40:39.486 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:39.486 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:39.485+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:39.586 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:39.586+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:39.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:39.661 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:39.661 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:39.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.661 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:6331 3.11 3.689aa311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-14T08:40:39.661 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:39.476449+0000", 2024-09-14T08:40:39.661 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.18972325500000001, 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.18976667999999999, 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for peered", 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 6331 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:39.476449+0000", 2024-09-14T08:40:39.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:39.476449+0000", 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:39.476451+0000", 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9659999999999999e-06 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:39.476461+0000", 2024-09-14T08:40:39.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0046e-05 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:39.476491+0000", 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0289000000000001e-05 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:39.476508+0000", 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.66e-05 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:39.476597+0000", 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9707e-05 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:39.476619+0000", 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1205000000000001e-05 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:40:39.665 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 1 2024-09-14T08:40:39.666 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:39.675 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:39.723 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:39.725+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:39.783 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:39.787 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:39.789+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:39.797 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:39.797 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:39.797 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:39.798 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:39.798 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:39.801 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:39.801 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:39.811 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:39.817 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:39.818 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:39.838 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:39.838 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:39.857 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:39.857 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:39.876 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:39.876 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:39.880 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:39.880 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:39.899 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:39.901+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:39.974 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:39.974 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:39.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:39.988 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:39.989+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:40.089 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:40.089+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:40.153 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:40.153 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:40.168 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:40.189 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:40.190+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:40.290 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:40.294+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:40.335 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:40.335 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:40.349 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:40.391 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:40.394+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:40.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:40:40.487 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:40.487 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:40.491 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:40.493+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:40.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:40.593 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:40.593+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:40.631 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:40.645 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:40.693 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:40.694+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:40.771 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:40.771 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:40.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:40.794 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:40.797+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:40.895 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:40.897+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:40.953 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:40.953 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:40.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:41.014 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:41.018+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:41.086 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:41.086 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:41.096 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:41.097+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:41.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:41.197 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:41.197+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:41.259 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:41.259 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:41.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:41.298 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:41.297+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:41.392 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:41.392 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:41.396 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:40:41.399 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:41.401+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:41.413 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:41.472 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone13 from 0xdc06600 (overlap 0x11a7a00) to 0x0 2024-09-14T08:40:41.499 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:41.501+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:41.563 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:41.563 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:41.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:41.601 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:41.602+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:41.702 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:41.701+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:41.746 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:41.746 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:41.761 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:41.804 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:41.805+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:41.881 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:41.903 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:41.905+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:41.929 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:41.929 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:41.938 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-14T08:40:41.943 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:42.022 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:42.031 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:42.033+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:42.042 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:42.042 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:42.062 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:42.063 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:42.083 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:42.084 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:42.105 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:42.105 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:42.105 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:42.105+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:42.126 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:42.127 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:42.127 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5017.0:1538 3.1a 3.a02bdeda (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-14T08:40:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:42.132271+0000", 2024-09-14T08:40:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.4739000000000003e-05, 2024-09-14T08:40:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120303, 2024-09-14T08:40:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:40:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5017", 2024-09-14T08:40:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3140758604", 2024-09-14T08:40:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1538 2024-09-14T08:40:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132271+0000", 2024-09-14T08:40:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132271+0000", 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132273+0000", 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0380000000000001e-06 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132278+0000", 2024-09-14T08:40:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4779999999999999e-06 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132291+0000", 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2892e-05 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132313+0000", 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1793e-05 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132399+0000", 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6001000000000006e-05 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5017.0:1537 3.14 3:2e89c63e:::rbd_data.10f136dd800d.0000000000000043:head [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:42.132165+0000", 2024-09-14T08:40:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.000190967, 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030468599999999998, 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5017", 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3140758604", 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1537 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132165+0000", 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132165+0000", 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132167+0000", 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3239999999999999e-06 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132173+0000", 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3849999999999999e-06 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132224+0000", 2024-09-14T08:40:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1276000000000002e-05 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132236+0000", 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1688000000000001e-05 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132346+0000", 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110368 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:42.132470+0000", 2024-09-14T08:40:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123645 2024-09-14T08:40:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:40:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 2 2024-09-14T08:40:42.137 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:42.138 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:42.138 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:42.145 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:42.205 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:42.206+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:42.306 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:42.310+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:42.329 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:42.329 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:42.329 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:42.329 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:42.329 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:42.346 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:42.407 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:42.409+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:42.468 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:42.468 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:42.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:42.469 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:42.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.469 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.469 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:42.469 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.584182534, 2024-09-14T08:40:42.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:40:42.469 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.469 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.469 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.469 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:40:42.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:40:42.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:40:42.474 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.474 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.474 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.474 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.572930499000002, 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.475 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:40:42.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:40:42.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:40:42.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:40:42.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:40:42.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:40:42.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:40:42.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:40:42.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.572070613999998, 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:40:42.480 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:42.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:42.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:40:42.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.571763988999997, 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.486 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:40:42.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.487 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:42.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:42.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:40:42.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.491 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.571360654000003, 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:40:42.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:40:42.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.570956950999999, 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.496 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:40:42.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.570606204999997, 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:40:42.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:40:42.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:40:42.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:40:42.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:40:42.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:40:42.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:42.506 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.570219932999997, 2024-09-14T08:40:42.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:40:42.507 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.507 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:40:42.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:42.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:42.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:40:42.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:40:42.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:40:42.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:40:42.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.570029400000003, 2024-09-14T08:40:42.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:42.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:42.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:40:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:40:42.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:40:42.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:40:42.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:40:42.517 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.569522671999998, 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:42.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:40:42.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:40:42.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:40:42.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:40:42.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:40:42.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:40:42.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.569196599999998, 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.524 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:40:42.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:40:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.568886988000003, 2024-09-14T08:40:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:40:42.529 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:42.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:40:42.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.568391446, 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:40:42.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:40:42.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:40:42.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.568075688, 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.540 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:40:42.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.567588252, 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.545 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.549 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.567238240000002, 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:40:42.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.566447121000003, 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.554 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:42.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:42.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:40:42.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:40:42.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:40:42.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:40:42.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:40:42.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.560 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.560 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:42.560 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.566038061999997, 2024-09-14T08:40:42.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:40:42.560 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.560 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:42.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:40:42.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:40:42.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:40:42.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:40:42.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:40:42.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:40:42.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:40:42.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:40:42.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:40:42.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.565 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.566 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:42.566 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:42.566 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.563405375000002, 2024-09-14T08:40:42.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:40:42.566 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.566 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.566 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:42.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.567 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:40:42.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.567 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:42.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.736914733999999, 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:40:42.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.573 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:42.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:42.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:42.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:42.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:42.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:40:42.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:40:42.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:42.579 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:42.580 INFO:teuthology.orchestra.run.smithi188.stdout:1494 punch from 0xcb3d800 to 0xcb3da00, (0x200 bytes) 2024-09-14T08:40:42.581 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:42.582 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:42.582+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:42.682 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:42.681+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:42.751 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:42.752 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:42.752 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:42.752 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:42.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:42.783 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:42.786+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:42.884 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:42.885+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:42.932 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:42.933 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:42.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:42.985 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:42.986+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:43.086 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:43.085+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:43.114 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:43.114 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:43.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:43.114 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:43.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.114 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.114 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.037395807999999, 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.115 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:43.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:43.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:43.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:43.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:43.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:43.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.037307710999997, 2024-09-14T08:40:43.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:43.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:43.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:43.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:43.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:43.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:43.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:43.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.037240314000002, 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.126 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:43.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:43.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:43.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.131 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.037166618000001, 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:43.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:43.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.136 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.137 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.137 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:43.137 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.037091146000002, 2024-09-14T08:40:43.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:43.137 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.137 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.137 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:43.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:43.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:43.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:43.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.142 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.037033942000001, 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:43.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.036975058000003, 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.036910132000003, 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.036848681000002, 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.036789147, 2024-09-14T08:40:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.036729837000003, 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.036657804999997, 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24681 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3076096~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.882322911999999, 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096091748000000005, 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24681 2024-09-14T08:40:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233725+0000", 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.017e-06 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233735+0000", 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8430000000000005e-06 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233746+0000", 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1409e-05 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233756+0000", 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5230000000000001e-06 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329376+0000", 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095619941 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329544+0000", 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000168269 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329816+0000", 2024-09-14T08:40:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027174600000000001 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24682 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.882248965999999, 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096544940999999995, 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24682 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233799+0000", 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.08e-06 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233803+0000", 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4429999999999999e-06 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233816+0000", 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3816e-05 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233824+0000", 2024-09-14T08:40:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5859999999999999e-06 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329882+0000", 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096058344000000004 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330073+0000", 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019082999999999999 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330343+0000", 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026984200000000001 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.882210311000001, 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:40:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.882179532999999, 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:40:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:40:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.882113830000002, 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:40:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.881991659000001, 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:40:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:40:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.881957428, 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:40:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.881926003, 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:40:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:40:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:40:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:43.219 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:43.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:43.221 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:43.221+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:43.322 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:43.322+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:43.353 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:43.353 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:43.354 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:43.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:43.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:40:43.440 INFO:teuthology.orchestra.run.smithi188.stdout:1495 punch from 0x7150800 to 0x715f200, (0xea00 bytes) 2024-09-14T08:40:43.452 INFO:teuthology.orchestra.run.smithi188.stdout:1498 punch from 0x167f400 to 0x168a600, (0xb200 bytes) 2024-09-14T08:40:43.452 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:43.421+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:43.462 INFO:teuthology.orchestra.run.smithi188.stdout:1500 read 0x75b6a00 thru 0x75c5368 (0xe969 bytes) 2024-09-14T08:40:43.462 INFO:teuthology.orchestra.run.smithi188.stdout:1501 punch from 0xaa21c00 to 0xaa2a000, (0x8400 bytes) 2024-09-14T08:40:43.473 INFO:teuthology.orchestra.run.smithi188.stdout:1502 read 0xb4cdc00 thru 0xb4d8f2a (0xb32b bytes) 2024-09-14T08:40:43.524 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:43.525+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:43.540 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:43.540 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:43.540 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:43.540 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:43.540 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:43.551 INFO:teuthology.orchestra.run.smithi188.stdout:1505 trunc from 0xdc06600 to 0x5680400 2024-09-14T08:40:43.555 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:43.624 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:43.625+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:43.630 INFO:teuthology.orchestra.run.smithi188.stdout:1506 write 0x17aae00 thru 0x17abbf5 (0xdf6 bytes) 2024-09-14T08:40:43.633 INFO:teuthology.orchestra.run.smithi188.stdout:1507 read 0xa19200 thru 0xa22c63 (0x9a64 bytes) 2024-09-14T08:40:43.634 INFO:teuthology.orchestra.run.smithi188.stdout:1511 read 0x1e91c00 thru 0x1e927ca (0xbcb bytes) 2024-09-14T08:40:43.642 INFO:teuthology.orchestra.run.smithi188.stdout:1512 trunc from 0x5680400 to 0x8186200 2024-09-14T08:40:43.658 INFO:teuthology.orchestra.run.smithi188.stdout:1513 punch from 0x1493400 to 0x149c800, (0x9400 bytes) 2024-09-14T08:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout:1516 write 0xca42000 thru 0xca4a878 (0x8879 bytes) 2024-09-14T08:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout:1520 write 0xe96ac00 thru 0xe970270 (0x5671 bytes) 2024-09-14T08:40:43.724 INFO:teuthology.orchestra.run.smithi188.stdout:1521 read 0xc76d600 thru 0xc775e72 (0x8873 bytes) 2024-09-14T08:40:43.725 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:43.726+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout:1523 write 0xa7af000 thru 0xa7bee53 (0xfe54 bytes) 2024-09-14T08:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout:1525 read 0x88d9000 thru 0x88e6ef2 (0xdef3 bytes) 2024-09-14T08:40:43.729 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:43.729 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:43.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:43.729 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:43.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.729 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31799 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3315712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.729 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:43.729 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.805199082999998, 2024-09-14T08:40:43.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071768473999999999, 2024-09-14T08:40:43.729 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.730 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.730 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.730 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.730 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.730 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.730 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31799 2024-09-14T08:40:43.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.730 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925577+0000", 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:40:43.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925579+0000", 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925587+0000", 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925593+0000", 2024-09-14T08:40:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997015+0000", 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071422484999999994 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997130+0000", 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115053 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997345+0000", 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214379 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31800 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3326976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.805175396999999, 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072113090000000005, 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.734 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31800 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925603+0000", 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925610+0000", 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8029999999999997e-06 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925618+0000", 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6930000000000007e-06 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997400+0000", 2024-09-14T08:40:43.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071781929999999994 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997507+0000", 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107012 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997713+0000", 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020603 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.805149708000002, 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.739 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:40:43.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.805127151999997, 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:40:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.805059137000001, 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:40:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.805009409, 2024-09-14T08:40:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:40:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:40:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804958253999999, 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:40:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:40:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804906250999998, 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:40:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:40:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804843681000001, 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:40:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804777102999999, 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:40:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:40:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:40:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:40:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:40:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:40:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804699319000001, 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:40:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804646624, 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804600970999999, 2024-09-14T08:40:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:40:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804554500000002, 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:40:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:40:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:40:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:40:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:40:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:40:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804508511999998, 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:40:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:40:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804480253999998, 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:40:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:40:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.804425475999999, 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:40:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:40:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.376655016999997, 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:40:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:40:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:40:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:40:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:40:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:40:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:40:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.384050950000001, 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:40:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.383212579, 2024-09-14T08:40:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:40:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:40:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:43.835 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:43.836 INFO:teuthology.orchestra.run.smithi188.stdout:1527 trunc from 0xe970400 to 0x51f600 2024-09-14T08:40:43.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:43.837 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:43.838+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:43.896 INFO:teuthology.orchestra.run.smithi188.stdout:1529 write 0x52aa000 thru 0x52aa70f (0x710 bytes) 2024-09-14T08:40:43.931 INFO:teuthology.orchestra.run.smithi188.stdout:1530 write 0xae98000 thru 0xaea2dcf (0xadd0 bytes) 2024-09-14T08:40:43.937 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:43.938+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:43.959 INFO:teuthology.orchestra.run.smithi188.stdout:1531 trunc from 0xaea2e00 to 0x65d000 2024-09-14T08:40:44.003 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:44.004 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:44.004 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:44.004 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:44.018 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:44.038 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:44.037+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:44.052 INFO:teuthology.orchestra.run.smithi188.stdout:1535 write 0xc321a00 thru 0xc32d160 (0xb761 bytes) 2024-09-14T08:40:44.063 INFO:teuthology.orchestra.run.smithi188.stdout:1537 trunc from 0xc32d200 to 0x89f3400 2024-09-14T08:40:44.098 INFO:teuthology.orchestra.run.smithi188.stdout:1538 trunc from 0x89f3400 to 0x45a6a00 2024-09-14T08:40:44.139 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:44.137+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:44.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:44.152 INFO:teuthology.orchestra.run.smithi188.stdout:1539 write 0x4e3e200 thru 0x4e3e68f (0x490 bytes) 2024-09-14T08:40:44.164 INFO:teuthology.orchestra.run.smithi188.stdout:1540 trunc from 0x4e3e800 to 0x1353800 2024-09-14T08:40:44.197 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:44.197 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:44.197 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:44.197 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:44.197 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:44.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:44.218 INFO:teuthology.orchestra.run.smithi188.stdout:1541 trunc from 0x1353800 to 0xb5f0000 2024-09-14T08:40:44.230 INFO:teuthology.orchestra.run.smithi188.stdout:1542 punch from 0x9ab5800 to 0x9aba400, (0x4c00 bytes) 2024-09-14T08:40:44.232 INFO:teuthology.orchestra.run.smithi188.stdout:1543 read 0x6808200 thru 0x68149d6 (0xc7d7 bytes) 2024-09-14T08:40:44.232 INFO:teuthology.orchestra.run.smithi188.stdout:1544 read 0x20e0600 thru 0x20ea9d2 (0xa3d3 bytes) 2024-09-14T08:40:44.240 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:44.241+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:44.257 INFO:teuthology.orchestra.run.smithi188.stdout:1547 trunc from 0xb5f0000 to 0x1aaca00 2024-09-14T08:40:44.265 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:44.284 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:44.284 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:44.290 INFO:teuthology.orchestra.run.smithi188.stdout:1549 read 0xb1d000 thru 0xb2b040 (0xe041 bytes) 2024-09-14T08:40:44.303 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:44.303 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:44.313 INFO:teuthology.orchestra.run.smithi188.stdout:1552 write 0x4cd2200 thru 0x4cded2a (0xcb2b bytes) 2024-09-14T08:40:44.318 INFO:teuthology.orchestra.run.smithi188.stdout:1553 trunc from 0x4cdee00 to 0x58c1800 2024-09-14T08:40:44.326 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:44.326 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:44.333 INFO:teuthology.orchestra.run.smithi188.stdout:1554 clone 15 order 24 su 2097152 sc 2 2024-09-14T08:40:44.340 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:44.342+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:44.341 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:44.341 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:44.346 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:44.346 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:44.355 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:44.368 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:44.368 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:44.370 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:44.371 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:44.427 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:40:44.442 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:44.441+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:44.487 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5] out_osds: [3] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:40:44.487 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:40:44.487 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-14T08:40:44.488 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T08:40:44.488 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:44.488 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:44.502 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:44.543 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:44.546+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:44.564 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone14 from 0x58c1800 (overlap 0x51f600) to 0x0 2024-09-14T08:40:44.644 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:44.646+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:44.668 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:44.668 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:44.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:44.745 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:44.746+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:44.805 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:44.805 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 82, 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "57b092b7-5550-41a0-8f78-531de0e7c469", 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-09-14T08:38:48.610112+0000", 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-09-14T08:40:44.425164+0000", 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-09-14T08:39:51.541202+0000", 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-09-14T08:40:39.381309+0000", 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5806080, 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-09-14T08:40:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "nodeep-scrub", 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "noscrub", 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 5, 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 3, 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 6, 2024-09-14T08:40:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "luminous", 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:00.306403+0000", 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-09-14T08:40:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-09-14T08:40:44.814 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:44.814 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:44.814 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:44.814 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:44.814 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:44.814 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:44.814 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:44.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.814 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "15", 2024-09-14T08:40:44.814 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:44.815 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 5.880000114440918, 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 5.880000114440918, 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.17000000178813934, 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1, 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1, 2024-09-14T08:40:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:06.370159+0000", 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-09-14T08:40:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 2, 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 19, 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.9900000095367432, 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.9900000095367432, 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.67000001668930054, 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "pool_client.0", 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:16.437713+0000", 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:40:44.826 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:40:44.827 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "82", 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 17, 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 82, 2024-09-14T08:40:44.828 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:40:44.829 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:40:44.830 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 1.8700000047683716, 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 1.8700000047683716, 2024-09-14T08:40:44.831 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.67000001668930054, 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.25, 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.25, 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:40:44.832 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d", 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 0, 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 41, 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:44.833 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6800", 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6801", 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.834 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6802", 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6803", 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6806", 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6807", 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:44.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6804", 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.837 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6805", 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6801/2282442554", 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6803/2282442554", 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6807/2282442554", 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6805/2282442554", 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: "exists" 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "09ba1390-a0d1-48a3-9342-5f5aa64e2217", 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 80, 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:44.839 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6808", 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6809", 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6810", 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6811", 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:44.841 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.842 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6814", 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6815", 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6812", 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6813", 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6809/2739597491", 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6811/2739597491", 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6815/2739597491", 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6813/2739597491", 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "a7cd8610-d8e1-44e7-a423-4419cad90d8e", 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 80, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:44.847 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6816", 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817", 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:44.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.849 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.851 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:44.851 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.851 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818", 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819", 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6822", 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6823", 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.853 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6820", 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6821", 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6817/1157205327", 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6819/1157205327", 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6823/1157205327", 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6821/1157205327", 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "1339fb05-5d1c-4c0a-8388-314119543bb6", 2024-09-14T08:40:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 0, 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0, 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 79, 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.856 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6808", 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6809", 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6810", 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6811", 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6814", 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6815", 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:44.859 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6812", 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6813", 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6809/1656791341", 2024-09-14T08:40:44.860 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6811/1656791341", 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6815/1656791341", 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6813/1656791341", 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "0cebba54-9019-47bd-870f-306664e390e1", 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:44.861 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 78, 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6816", 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:44.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6817", 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6818", 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:44.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6819", 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6822", 2024-09-14T08:40:44.864 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6823", 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.865 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6820", 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6821", 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6817/1186206237", 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6819/1186206237", 2024-09-14T08:40:44.866 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6823/1186206237", 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6821/1186206237", 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "e571e73b-0e9d-417d-b01c-59b651016763", 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:40:44.867 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0.1356353759765625, 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 78, 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6800", 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6801", 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6802", 2024-09-14T08:40:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6803", 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6806", 2024-09-14T08:40:44.870 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6807", 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.871 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6804", 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6805", 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6801/796623465", 2024-09-14T08:40:44.872 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6803/796623465", 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6807/796623465", 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6805/796623465", 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:44.873 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.174731+0000", 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 41 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:44.874 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.475467+0000", 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.606174+0000", 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:44.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 65536, 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.835957+0000", 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:40:44.876 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.753547+0000", 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:40:44.877 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.284212+0000", 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [ 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: 0 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.a", 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: 5 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [ 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 4, 2024-09-14T08:40:44.879 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 0 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.a", 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 4, 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 1 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 5, 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 2 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [ 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.881 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "1.0", 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "2.0", 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "2.5", 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: 4, 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: 2 2024-09-14T08:40:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.f", 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: 5, 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.884 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: 5 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.11", 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: 4, 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.12", 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.885 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.15", 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: 4, 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.1f", 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:40:44.886 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-09-14T08:40:44.887 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-09-14T08:40:44.888 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-09-14T08:40:44.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:44.889 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:44.891 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:44.892 INFO:tasks.thrashosds.thrasher:j is {'epoch': 82, 'fsid': '57b092b7-5550-41a0-8f78-531de0e7c469', 'created': '2024-09-14T08:38:48.610112+0000', 'modified': '2024-09-14T08:40:44.425164+0000', 'last_up_change': '2024-09-14T08:39:51.541202+0000', 'last_in_change': '2024-09-14T08:40:39.381309+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T08:39:00.306403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 5.880000114440918, 'score_stable': 5.880000114440918, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T08:39:06.370159+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T08:39:16.437713+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 82, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}], 'osds': [{'osd': 0, 'uuid': '2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 21, 'down_at': 41, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 2282442554}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 2282442554}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 2282442554}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 2282442554}]}, 'public_addr': '172.21.15.89:6801/2282442554', 'cluster_addr': '172.21.15.89:6803/2282442554', 'heartbeat_back_addr': '172.21.15.89:6807/2282442554', 'heartbeat_front_addr': '172.21.15.89:6805/2282442554', 'state': ['exists']}, {'osd': 1, 'uuid': '09ba1390-a0d1-48a3-9342-5f5aa64e2217', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 80, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6808', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6809', 'nonce': 2739597491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6810', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6811', 'nonce': 2739597491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6814', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6815', 'nonce': 2739597491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6812', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6813', 'nonce': 2739597491}]}, 'public_addr': '172.21.15.89:6809/2739597491', 'cluster_addr': '172.21.15.89:6811/2739597491', 'heartbeat_back_addr': '172.21.15.89:6815/2739597491', 'heartbeat_front_addr': '172.21.15.89:6813/2739597491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a7cd8610-d8e1-44e7-a423-4419cad90d8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 80, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6816', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6817', 'nonce': 1157205327}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6818', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 1157205327}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6822', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6823', 'nonce': 1157205327}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6820', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6821', 'nonce': 1157205327}]}, 'public_addr': '172.21.15.89:6817/1157205327', 'cluster_addr': '172.21.15.89:6819/1157205327', 'heartbeat_back_addr': '172.21.15.89:6823/1157205327', 'heartbeat_front_addr': '172.21.15.89:6821/1157205327', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1339fb05-5d1c-4c0a-8388-314119543bb6', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 79, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6808', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6809', 'nonce': 1656791341}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6810', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6811', 'nonce': 1656791341}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6814', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6815', 'nonce': 1656791341}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6812', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6813', 'nonce': 1656791341}]}, 'public_addr': '172.21.15.112:6809/1656791341', 'cluster_addr': '172.21.15.112:6811/1656791341', 'heartbeat_back_addr': '172.21.15.112:6815/1656791341', 'heartbeat_front_addr': '172.21.15.112:6813/1656791341', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0cebba54-9019-47bd-870f-306664e390e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 78, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6816', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6817', 'nonce': 1186206237}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6818', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6819', 'nonce': 1186206237}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6822', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6823', 'nonce': 1186206237}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6820', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6821', 'nonce': 1186206237}]}, 'public_addr': '172.21.15.112:6817/1186206237', 'cluster_addr': '172.21.15.112:6819/1186206237', 'heartbeat_back_addr': '172.21.15.112:6823/1186206237', 'heartbeat_front_addr': '172.21.15.112:6821/1186206237', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e571e73b-0e9d-417d-b01c-59b651016763', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1356353759765625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 78, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 796623465}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 796623465}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 796623465}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 796623465}]}, 'public_addr': '172.21.15.112:6801/796623465', 'cluster_addr': '172.21.15.112:6803/796623465', 'heartbeat_back_addr': '172.21.15.112:6807/796623465', 'heartbeat_front_addr': '172.21.15.112:6805/796623465', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.174731+0000', 'dead_epoch': 41}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.475467+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.606174+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.835957+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.753547+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.284212+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.9', 'osds': [1, 0]}, {'pgid': '3.a', 'osds': [2, 5]}], 'pg_upmap_items': [{'pgid': '3.9', 'mappings': [{'from': 4, 'to': 0}]}, {'pgid': '3.a', 'mappings': [{'from': 4, 'to': 1}]}, {'pgid': '3.10', 'mappings': [{'from': 5, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '1.0', 'osds': [1, 3]}, {'pgid': '2.0', 'osds': [1, 3]}, {'pgid': '2.5', 'osds': [4, 3]}, {'pgid': '3.9', 'osds': [1, 2]}, {'pgid': '3.f', 'osds': [5, 3]}, {'pgid': '3.10', 'osds': [2, 5]}, {'pgid': '3.11', 'osds': [4, 3]}, {'pgid': '3.12', 'osds': [1, 3]}, {'pgid': '3.15', 'osds': [4, 3]}, {'pgid': '3.1f', 'osds': [2, 3]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T08:40:44.892 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.a 2024-09-14T08:40:44.892 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 3.a 2024-09-14T08:40:44.892 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:44.890+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:44.990 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:44.994+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:45.022 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:45.022 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:45.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:45.091 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:45.089+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:45.095 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-14T08:40:45.160 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:45.160 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:45.163 INFO:teuthology.orchestra.run.smithi188.stdout:1556 write 0x3e17400 thru 0x3e1d2fd (0x5efe bytes) 2024-09-14T08:40:45.166 INFO:teuthology.orchestra.run.smithi188.stdout:1557 write 0x464b400 thru 0x465534a (0x9f4b bytes) 2024-09-14T08:40:45.174 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:45.185 INFO:teuthology.orchestra.run.smithi188.stdout:1558 trunc from 0x58c1800 to 0x45b4800 2024-09-14T08:40:45.192 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:45.194+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:45.235 INFO:teuthology.orchestra.run.smithi188.stdout:1559 write 0x3113c00 thru 0x311ba70 (0x7e71 bytes) 2024-09-14T08:40:45.268 INFO:teuthology.orchestra.run.smithi188.stdout:1560 write 0x5c67400 thru 0x5c6e5cb (0x71cc bytes) 2024-09-14T08:40:45.271 INFO:teuthology.orchestra.run.smithi188.stdout:1563 punch from 0x1c3ca00 to 0x1c45a00, (0x9000 bytes) 2024-09-14T08:40:45.272 INFO:teuthology.orchestra.run.smithi188.stdout:1566 read 0x32e7e00 thru 0x32f52d6 (0xd4d7 bytes) 2024-09-14T08:40:45.293 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:45.293+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:45.341 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:45.342 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:45.356 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:45.357 INFO:teuthology.orchestra.run.smithi188.stdout:1570 trunc from 0x5c6e600 to 0xcdc2a00 2024-09-14T08:40:45.373 INFO:teuthology.orchestra.run.smithi188.stdout:1572 write 0xe7000 thru 0xf5140 (0xe141 bytes) 2024-09-14T08:40:45.392 INFO:teuthology.orchestra.run.smithi188.stdout:1576 trunc from 0xcdc2a00 to 0x63ed200 2024-09-14T08:40:45.393 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:45.394+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:45.445 INFO:teuthology.orchestra.run.smithi089.stderr:clear 3.a pg_upmap_items mapping 2024-09-14T08:40:45.449 INFO:teuthology.orchestra.run.smithi188.stdout:1577 write 0xab4f600 thru 0xab5a259 (0xac5a bytes) 2024-09-14T08:40:45.450 INFO:teuthology.orchestra.run.smithi188.stdout:1578 write 0xa589e00 thru 0xa59089c (0x6a9d bytes) 2024-09-14T08:40:45.451 INFO:teuthology.orchestra.run.smithi188.stdout:1579 read 0x673c200 thru 0x6743b3b (0x793c bytes) 2024-09-14T08:40:45.451 INFO:teuthology.orchestra.run.smithi188.stdout:1581 punch from 0x3b43c00 to 0x3b48c00, (0x5000 bytes) 2024-09-14T08:40:45.453 INFO:teuthology.orchestra.run.smithi188.stdout:1582 trunc from 0xab5a400 to 0x9f06a00 2024-09-14T08:40:45.482 INFO:teuthology.orchestra.run.smithi188.stdout:1583 read 0x358f400 thru 0x359a89a (0xb49b bytes) 2024-09-14T08:40:45.483 INFO:teuthology.orchestra.run.smithi188.stdout:1584 write 0x5009600 thru 0x5011aa4 (0x84a5 bytes) 2024-09-14T08:40:45.493 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:45.493+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:45.517 INFO:teuthology.orchestra.run.smithi188.stdout:1585 trunc from 0x9f06a00 to 0xc27e00 2024-09-14T08:40:45.529 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:45.529 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:45.545 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:45.583 INFO:teuthology.orchestra.run.smithi188.stdout:1586 write 0x5355400 thru 0x5360943 (0xb544 bytes) 2024-09-14T08:40:45.585 INFO:teuthology.orchestra.run.smithi188.stdout:1589 read 0x119b800 thru 0x119d390 (0x1b91 bytes) 2024-09-14T08:40:45.594 INFO:teuthology.orchestra.run.smithi188.stdout:1590 trunc from 0x5360a00 to 0x2a0f000 2024-09-14T08:40:45.632 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:45.633+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:45.659 INFO:teuthology.orchestra.run.smithi188.stdout:1594 write 0xca02200 thru 0xca038e6 (0x16e7 bytes) 2024-09-14T08:40:45.660 INFO:teuthology.orchestra.run.smithi188.stdout:1596 read 0x82eee00 thru 0x82fd012 (0xe213 bytes) 2024-09-14T08:40:45.661 INFO:teuthology.orchestra.run.smithi188.stdout:1597 write 0x2501600 thru 0x2505ddd (0x47de bytes) 2024-09-14T08:40:45.661 INFO:teuthology.orchestra.run.smithi188.stdout:1599 punch from 0x357a200 to 0x357bc00, (0x1a00 bytes) 2024-09-14T08:40:45.662 INFO:teuthology.orchestra.run.smithi188.stdout:1601 write 0x88a7c00 thru 0x88ac724 (0x4b25 bytes) 2024-09-14T08:40:45.662 INFO:teuthology.orchestra.run.smithi188.stdout:1603 read 0x70a9c00 thru 0x70b686b (0xcc6c bytes) 2024-09-14T08:40:45.662 INFO:teuthology.orchestra.run.smithi188.stdout:1605 write 0x2da3c00 thru 0x2db0b6d (0xcf6e bytes) 2024-09-14T08:40:45.662 INFO:teuthology.orchestra.run.smithi188.stdout:1607 read 0x3445c00 thru 0x3447b12 (0x1f13 bytes) 2024-09-14T08:40:45.662 INFO:teuthology.orchestra.run.smithi188.stdout:1608 write 0x6925e00 thru 0x6927843 (0x1a44 bytes) 2024-09-14T08:40:45.662 INFO:teuthology.orchestra.run.smithi188.stdout:1611 punch from 0xabd7e00 to 0xabdc000, (0x4200 bytes) 2024-09-14T08:40:45.663 INFO:teuthology.orchestra.run.smithi188.stdout:1612 write 0xbee4600 thru 0xbeef713 (0xb114 bytes) 2024-09-14T08:40:45.663 INFO:teuthology.orchestra.run.smithi188.stdout:1614 write 0xa28b800 thru 0xa294e7a (0x967b bytes) 2024-09-14T08:40:45.663 INFO:teuthology.orchestra.run.smithi188.stdout:1615 read 0x199cc00 thru 0x19a70a1 (0xa4a2 bytes) 2024-09-14T08:40:45.664 INFO:teuthology.orchestra.run.smithi188.stdout:1616 write 0xb4cf800 thru 0xb4d3fcd (0x47ce bytes) 2024-09-14T08:40:45.664 INFO:teuthology.orchestra.run.smithi188.stdout:1617 write 0x7f91000 thru 0x7f97c74 (0x6c75 bytes) 2024-09-14T08:40:45.664 INFO:teuthology.orchestra.run.smithi188.stdout:1618 write 0x75b2200 thru 0x75b2d1a (0xb1b bytes) 2024-09-14T08:40:45.664 INFO:teuthology.orchestra.run.smithi188.stdout:1619 write 0x71b0200 thru 0x71b7fb8 (0x7db9 bytes) 2024-09-14T08:40:45.695 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:45.693+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:45.709 INFO:teuthology.orchestra.run.smithi188.stdout:1620 write 0xd26f200 thru 0xd271f27 (0x2d28 bytes) 2024-09-14T08:40:45.713 INFO:teuthology.orchestra.run.smithi188.stdout:1621 read 0x1526c00 thru 0x15337ad (0xcbae bytes) 2024-09-14T08:40:45.714 INFO:teuthology.orchestra.run.smithi188.stdout:1624 punch from 0x548c000 to 0x548e200, (0x2200 bytes) 2024-09-14T08:40:45.714 INFO:teuthology.orchestra.run.smithi188.stdout:1625 read 0x7a24c00 thru 0x7a31c03 (0xd004 bytes) 2024-09-14T08:40:45.716 INFO:teuthology.orchestra.run.smithi188.stdout:1629 punch from 0x7569000 to 0x756d400, (0x4400 bytes) 2024-09-14T08:40:45.716 INFO:teuthology.orchestra.run.smithi188.stdout:1631 read 0xfc1000 thru 0xfc6e72 (0x5e73 bytes) 2024-09-14T08:40:45.719 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:45.719 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:45.736 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:45.744 INFO:teuthology.orchestra.run.smithi188.stdout:1632 write 0xde6ac00 thru 0xde6e4ed (0x38ee bytes) 2024-09-14T08:40:45.747 INFO:teuthology.orchestra.run.smithi188.stdout:1634 write 0xa59600 thru 0xa59615 (0x16 bytes) 2024-09-14T08:40:45.750 INFO:teuthology.orchestra.run.smithi188.stdout:1635 trunc from 0xde6e600 to 0xcdd2400 2024-09-14T08:40:45.795 INFO:teuthology.orchestra.run.smithi188.stdout:1636 trunc from 0xcdd2400 to 0x348f400 2024-09-14T08:40:45.795 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:45.798+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:45.828 INFO:teuthology.orchestra.run.smithi188.stdout:1637 read 0xda6a00 thru 0xdb4587 (0xdb88 bytes) 2024-09-14T08:40:45.831 INFO:teuthology.orchestra.run.smithi188.stdout:1638 read 0x1b6f600 thru 0x1b71f95 (0x2996 bytes) 2024-09-14T08:40:45.832 INFO:teuthology.orchestra.run.smithi188.stdout:1640 read 0x2357400 thru 0x23666f1 (0xf2f2 bytes) 2024-09-14T08:40:45.832 INFO:teuthology.orchestra.run.smithi188.stdout:1641 read 0x1718400 thru 0x1722568 (0xa169 bytes) 2024-09-14T08:40:45.843 INFO:teuthology.orchestra.run.smithi188.stdout:1644 trunc from 0x348f400 to 0x90f9800 2024-09-14T08:40:45.871 INFO:teuthology.orchestra.run.smithi188.stdout:1646 trunc from 0x90f9800 to 0x3a82c00 2024-09-14T08:40:45.890 INFO:teuthology.orchestra.run.smithi188.stdout:1647 punch from 0xada00 to 0xb8600, (0xac00 bytes) 2024-09-14T08:40:45.896 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:45.897+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:45.914 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:45.914 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:45.928 INFO:teuthology.orchestra.run.smithi188.stdout:1648 write 0x925d400 thru 0x926c9b5 (0xf5b6 bytes) 2024-09-14T08:40:45.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:45.931 INFO:teuthology.orchestra.run.smithi188.stdout:1649 read 0x6f42800 thru 0x6f50759 (0xdf5a bytes) 2024-09-14T08:40:45.943 INFO:teuthology.orchestra.run.smithi188.stdout:1650 trunc from 0x926ca00 to 0x2094c00 2024-09-14T08:40:45.980 INFO:teuthology.orchestra.run.smithi188.stdout:1652 trunc from 0x2094c00 to 0x3f22400 2024-09-14T08:40:45.996 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:45.998+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:45.997 INFO:teuthology.orchestra.run.smithi188.stdout:1653 read 0x1b1ce00 thru 0x1b232b0 (0x64b1 bytes) 2024-09-14T08:40:45.998 INFO:teuthology.orchestra.run.smithi188.stdout:1654 punch from 0x2d6f600 to 0x2d7a600, (0xb000 bytes) 2024-09-14T08:40:45.999 INFO:teuthology.orchestra.run.smithi188.stdout:1660 trunc from 0x3f22400 to 0x3dd9c00 2024-09-14T08:40:46.016 INFO:teuthology.orchestra.run.smithi188.stdout:1662 read 0x63c800 thru 0x642795 (0x5f96 bytes) 2024-09-14T08:40:46.018 INFO:teuthology.orchestra.run.smithi188.stdout:1664 read 0xd9e200 thru 0xd9f1cf (0xfd0 bytes) 2024-09-14T08:40:46.065 INFO:teuthology.orchestra.run.smithi188.stdout:1666 write 0xbd1c000 thru 0xbd1c191 (0x192 bytes) 2024-09-14T08:40:46.067 INFO:teuthology.orchestra.run.smithi188.stdout:1668 read 0x83d8000 thru 0x83e6bde (0xebdf bytes) 2024-09-14T08:40:46.067 INFO:teuthology.orchestra.run.smithi188.stdout:1670 punch from 0x318fa00 to 0x3193400, (0x3a00 bytes) 2024-09-14T08:40:46.068 INFO:teuthology.orchestra.run.smithi188.stdout:1672 write 0x10bca00 thru 0x10c6d52 (0xa353 bytes) 2024-09-14T08:40:46.071 INFO:teuthology.orchestra.run.smithi188.stdout:1673 write 0xb9ef200 thru 0xb9f6b15 (0x7916 bytes) 2024-09-14T08:40:46.072 INFO:teuthology.orchestra.run.smithi188.stdout:1674 read 0x7ac9600 thru 0x7acfa87 (0x6488 bytes) 2024-09-14T08:40:46.076 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:46.076 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:46.093 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:46.100 INFO:teuthology.orchestra.run.smithi188.stdout:1675 write 0xd0d4000 thru 0xd0d5274 (0x1275 bytes) 2024-09-14T08:40:46.102 INFO:teuthology.orchestra.run.smithi188.stdout:1676 write 0x9beea00 thru 0x9beeb80 (0x181 bytes) 2024-09-14T08:40:46.102 INFO:teuthology.orchestra.run.smithi188.stdout:1677 read 0x271600 thru 0x2797bf (0x81c0 bytes) 2024-09-14T08:40:46.104 INFO:teuthology.orchestra.run.smithi188.stdout:1678 read 0x7213000 thru 0x7218c3b (0x5c3c bytes) 2024-09-14T08:40:46.104 INFO:teuthology.orchestra.run.smithi188.stdout:1679 write 0xcd2ec00 thru 0xcd37095 (0x8496 bytes) 2024-09-14T08:40:46.105 INFO:teuthology.orchestra.run.smithi188.stdout:1680 flatten 2024-09-14T08:40:46.134 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:46.138+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:46.143 INFO:teuthology.orchestra.run.smithi188.stdout:1682 punch from 0x8685a00 to 0x8689400, (0x3a00 bytes) 2024-09-14T08:40:46.145 INFO:teuthology.orchestra.run.smithi188.stdout:1683 read 0x595600 thru 0x595740 (0x141 bytes) 2024-09-14T08:40:46.146 INFO:teuthology.orchestra.run.smithi188.stdout:1684 write 0x728f200 thru 0x72980eb (0x8eec bytes) 2024-09-14T08:40:46.146 INFO:teuthology.orchestra.run.smithi188.stdout:1687 write 0xb84ca00 thru 0xb84ed93 (0x2394 bytes) 2024-09-14T08:40:46.147 INFO:teuthology.orchestra.run.smithi188.stdout:1688 punch from 0x608a00 to 0x615a00, (0xd000 bytes) 2024-09-14T08:40:46.147 INFO:teuthology.orchestra.run.smithi188.stdout:1689 read 0xad2f800 thru 0xad36cd1 (0x74d2 bytes) 2024-09-14T08:40:46.151 INFO:teuthology.orchestra.run.smithi188.stdout:1690 read 0x8039400 thru 0x80430dd (0x9cde bytes) 2024-09-14T08:40:46.152 INFO:teuthology.orchestra.run.smithi188.stdout:1691 trunc from 0xd0d5400 to 0xd5e1200 2024-09-14T08:40:46.174 INFO:teuthology.orchestra.run.smithi188.stdout:1692 write 0x22a200 thru 0x2363e5 (0xc1e6 bytes) 2024-09-14T08:40:46.194 INFO:teuthology.orchestra.run.smithi188.stdout:1693 trunc from 0xd5e1200 to 0x339f400 2024-09-14T08:40:46.197 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:46.198+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:46.236 INFO:teuthology.orchestra.run.smithi188.stdout:1695 punch from 0x2ce200 to 0x2da400, (0xc200 bytes) 2024-09-14T08:40:46.238 INFO:teuthology.orchestra.run.smithi188.stdout:1698 read 0xac9400 thru 0xad0ef5 (0x7af6 bytes) 2024-09-14T08:40:46.242 INFO:teuthology.orchestra.run.smithi188.stdout:1700 read 0x323d800 thru 0x324639d (0x8b9e bytes) 2024-09-14T08:40:46.242 INFO:teuthology.orchestra.run.smithi188.stdout:1701 punch from 0x1e6f800 to 0x1e77c00, (0x8400 bytes) 2024-09-14T08:40:46.242 INFO:teuthology.orchestra.run.smithi188.stdout:1703 punch from 0x79a00 to 0x7c600, (0x2c00 bytes) 2024-09-14T08:40:46.243 INFO:teuthology.orchestra.run.smithi188.stdout:1705 trunc from 0x339f400 to 0x394e000 2024-09-14T08:40:46.261 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:46.261 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:46.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:46.311 INFO:teuthology.orchestra.run.smithi188.stdout:1707 write 0xd44a400 thru 0xd44c7ea (0x23eb bytes) 2024-09-14T08:40:46.314 INFO:teuthology.orchestra.run.smithi188.stdout:1710 write 0x88bc00 thru 0x88e05e (0x245f bytes) 2024-09-14T08:40:46.317 INFO:teuthology.orchestra.run.smithi188.stdout:1711 punch from 0x8c1b000 to 0x8c27c00, (0xcc00 bytes) 2024-09-14T08:40:46.318 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:46.322+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:46.328 INFO:teuthology.orchestra.run.smithi188.stdout:1713 trunc from 0xd44c800 to 0x8020600 2024-09-14T08:40:46.357 INFO:teuthology.orchestra.run.smithi188.stdout:1714 read 0xa21c00 thru 0xa2dc50 (0xc051 bytes) 2024-09-14T08:40:46.360 INFO:teuthology.orchestra.run.smithi188.stdout:1719 write 0x3b29c00 thru 0x3b38b20 (0xef21 bytes) 2024-09-14T08:40:46.361 INFO:teuthology.orchestra.run.smithi188.stdout:1720 write 0x58c8200 thru 0x58d7c97 (0xfa98 bytes) 2024-09-14T08:40:46.364 INFO:teuthology.orchestra.run.smithi188.stdout:1722 trunc from 0x8020600 to 0x93e1a00 2024-09-14T08:40:46.371 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:46.394 INFO:teuthology.orchestra.run.smithi188.stdout:1723 clone 16 order 21 su 1048576 sc 4 2024-09-14T08:40:46.399 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:46.397+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:46.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:40:46.455 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:46.455 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:46.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:46.497 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:46.499 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:46.500+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:46.515 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:46.515 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:46.548 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:46.548 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:46.581 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:46.581 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:46.601 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:46.600+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:46.603 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:46.603 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:46.622 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:46.622 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:46.622 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:46.622 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:46.624 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:46.624 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:46.627 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:46.627 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:46.637 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:46.702 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:46.700+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:46.795 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:46.795 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:46.795 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:46.795 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:46.796 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:46.802 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:46.802+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:46.810 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:46.903 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:46.906+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:46.984 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706772942999997, 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:40:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706744147000002, 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:40:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706715328000001, 2024-09-14T08:40:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:40:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:40:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:40:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:40:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:40:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706686998999999, 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706657798999998, 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:40:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:40:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:40:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:40:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706625791, 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:40:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:40:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:40:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706596515000001, 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:40:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:40:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:40:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:40:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:40:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706566848999998, 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:40:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706538305999999, 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.022 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:47.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.026 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706510000000002, 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:40:47.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:40:47.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706464732999997, 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:40:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:40:47.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706433111000003, 2024-09-14T08:40:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:47.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.039 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706375299000001, 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.040 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:40:47.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706307285999998, 2024-09-14T08:40:47.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:40:47.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.048 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706271913999998, 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:40:47.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.706237514999998, 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.053 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 36.679166961999996, 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:40:47.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:47.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4170567829999996, 2024-09-14T08:40:47.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:40:47.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:40:47.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4169096119999995, 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.069 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:40:47.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:40:47.073 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4167678119999998, 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:40:47.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:40:47.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:40:47.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:47.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:40:47.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:40:47.079 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.079 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.079 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.079 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:47.079 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:47.079 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:47.081 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:47.081 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:47.080+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:47.087 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-14T08:40:47.182 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:47.181+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:47.209 INFO:teuthology.orchestra.run.smithi188.stdout:1724 trunc from 0x93e1a00 to 0x13d0200 2024-09-14T08:40:47.212 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:47.212 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:47.212 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:47.212 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:47.226 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:47.259 INFO:teuthology.orchestra.run.smithi188.stdout:1725 read 0x2d4a00 thru 0x2da6c7 (0x5cc8 bytes) 2024-09-14T08:40:47.263 INFO:teuthology.orchestra.run.smithi188.stdout:1727 punch from 0x10eea00 to 0x10fd600, (0xec00 bytes) 2024-09-14T08:40:47.263 INFO:teuthology.orchestra.run.smithi188.stdout:1730 read 0x901c00 thru 0x90fd9a (0xe19b bytes) 2024-09-14T08:40:47.267 INFO:teuthology.orchestra.run.smithi188.stdout:1732 read 0x3cb000 thru 0x3cfc97 (0x4c98 bytes) 2024-09-14T08:40:47.268 INFO:teuthology.orchestra.run.smithi188.stdout:1733 read 0x25ce00 thru 0x26973a (0xc93b bytes) 2024-09-14T08:40:47.270 INFO:teuthology.orchestra.run.smithi188.stdout:1737 read 0x574200 thru 0x579411 (0x5212 bytes) 2024-09-14T08:40:47.272 INFO:teuthology.orchestra.run.smithi188.stdout:1741 read 0xfc7400 thru 0xfd66b1 (0xf2b2 bytes) 2024-09-14T08:40:47.282 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:47.285+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:47.311 INFO:teuthology.orchestra.run.smithi188.stdout:1746 trunc from 0x13d0200 to 0xafc4e00 2024-09-14T08:40:47.335 INFO:teuthology.orchestra.run.smithi188.stdout:1747 read 0x772e00 thru 0x775a6b (0x2c6c bytes) 2024-09-14T08:40:47.337 INFO:teuthology.orchestra.run.smithi188.stdout:1748 write 0x246c600 thru 0x2477b81 (0xb582 bytes) 2024-09-14T08:40:47.351 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:47.351 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:47.351 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:47.352 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:47.352 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:47.366 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:47.412 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:47.412+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:47.421 INFO:teuthology.orchestra.run.smithi188.stdout:1750 write 0xeac8e00 thru 0xeace349 (0x554a bytes) 2024-09-14T08:40:47.422 INFO:teuthology.orchestra.run.smithi188.stdout:1751 read 0xd3be400 thru 0xd3cc786 (0xe387 bytes) 2024-09-14T08:40:47.423 INFO:teuthology.orchestra.run.smithi188.stdout:1753 write 0x5421e00 thru 0x542a370 (0x8571 bytes) 2024-09-14T08:40:47.423 INFO:teuthology.orchestra.run.smithi188.stdout:1754 clone 17 order 20 su 4096 sc 15 2024-09-14T08:40:47.446 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:40:47.484 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:47.484+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:47.491 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:47.491 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.245364496000001, 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:40:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:40:47.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:40:47.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:40:47.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:40:47.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:40:47.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.245302483000003, 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:40:47.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:40:47.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:40:47.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:40:47.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.245236153, 2024-09-14T08:40:47.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.507 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:47.508 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.245180693000002, 2024-09-14T08:40:47.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:40:47.508 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.508 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.508 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:40:47.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.245121073, 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.513 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:40:47.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.245039533000003, 2024-09-14T08:40:47.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:47.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:40:47.521 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244983204999997, 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.522 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.526 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244911709999997, 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:47.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244838839000003, 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:40:47.531 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:40:47.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244796626999999, 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.536 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244766796999997, 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.541 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:40:47.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:40:47.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:47.545 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244738499999997, 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:47.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:40:47.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244697404999997, 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.550 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:40:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244668375000003, 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:40:47.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:40:47.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244639890999998, 2024-09-14T08:40:47.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:40:47.563 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244611751000001, 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.564 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:40:47.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:47.568 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244583055, 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:47.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:40:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244554297999997, 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:40:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244526251000003, 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:40:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:40:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:40:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.244496273999999, 2024-09-14T08:40:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:40:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:40:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:40:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:40:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:40:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:47.587 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:47.588 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone16 from 0xeace400 (overlap 0x13d0200) to 0x0 2024-09-14T08:40:47.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:47.589 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:47.588+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:47.689 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:47.688+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:47.761 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:47.762 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:47.762 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:47.762 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:47.777 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:47.790 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:47.793+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:47.891 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:47.888+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:47.948 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:47.949 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:47.963 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:48.008 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:48.008+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:48.091 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-14T08:40:48.093 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:48.093+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:48.136 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.251108891999998, 2024-09-14T08:40:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:40:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:40:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.239856856999999, 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:40:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.238996972000002, 2024-09-14T08:40:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:40:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.238690347000002, 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.238287012000001, 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:40:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:40:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.237883308999997, 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:40:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:40:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.237532563000002, 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:40:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:40:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.237146291000002, 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:40:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.236955758000001, 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.236449030000003, 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:40:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.236122958000003, 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:40:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.235813346, 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.235317803999997, 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:40:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.235002045999998, 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:40:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:40:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.234514609999998, 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:40:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:40:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:40:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.234164598, 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:40:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.233373479000001, 2024-09-14T08:40:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:40:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.232964420000002, 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:40:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.230331733, 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:40:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:40:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:40:48.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.403841092, 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:48.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:48.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:40:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:40:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.231 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:48.232 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:48.233 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:48.233+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:48.333 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:48.332+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:48.373 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:48.434 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:48.437+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:48.535 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:48.537+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:48.552 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:48.628 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:48.636 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:48.636+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:48.678 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.602632051999997, 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.602543955000002, 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.602476557999999, 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.602402861999998, 2024-09-14T08:40:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.602327389999999, 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.602270185999998, 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.602211302000001, 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.602146376, 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.602084925, 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.602025390999998, 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.601966081, 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.601894049000002, 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24681 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3076096~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.447559156000001, 2024-09-14T08:40:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096091748000000005, 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24681 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233725+0000", 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.017e-06 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233735+0000", 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8430000000000005e-06 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233746+0000", 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1409e-05 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233756+0000", 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5230000000000001e-06 2024-09-14T08:40:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329376+0000", 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095619941 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329544+0000", 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000168269 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329816+0000", 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027174600000000001 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24682 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.44748521, 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096544940999999995, 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24682 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233799+0000", 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.08e-06 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233803+0000", 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4429999999999999e-06 2024-09-14T08:40:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233816+0000", 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3816e-05 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233824+0000", 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5859999999999999e-06 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329882+0000", 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096058344000000004 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330073+0000", 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019082999999999999 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330343+0000", 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026984200000000001 2024-09-14T08:40:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.447446554999999, 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:40:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:40:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.447415777, 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.447350073999999, 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:40:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.447227903000002, 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:40:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:40:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.447193672000001, 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.447162247000001, 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:40:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:40:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:40:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:48.778 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:48.779 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:48.779 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:48.781+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:48.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:48.787 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:48.787 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:48.804 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:48.804 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:48.826 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:48.826 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:48.848 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:48.848 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:48.869 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:48.869 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:48.872 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:48.873 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:48.898 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:48.898 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:48.898 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:48.901+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:48.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:48.980 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:48.984+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:49.075 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:49.076 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:49.081 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:49.080+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:49.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:49.146 INFO:teuthology.orchestra.run.smithi188.stdout:1755 read 0x7a89200 thru 0x7a9475d (0xb55e bytes) 2024-09-14T08:40:49.148 INFO:teuthology.orchestra.run.smithi188.stdout:1756 read 0xa3be200 thru 0xa3cb942 (0xd743 bytes) 2024-09-14T08:40:49.149 INFO:teuthology.orchestra.run.smithi188.stdout:1757 read 0xb45200 thru 0xb519ad (0xc7ae bytes) 2024-09-14T08:40:49.156 INFO:teuthology.orchestra.run.smithi188.stdout:1758 write 0x881ea00 thru 0x882d22d (0xe82e bytes) 2024-09-14T08:40:49.157 INFO:teuthology.orchestra.run.smithi188.stdout:1759 punch from 0x49b8800 to 0x49c2200, (0x9a00 bytes) 2024-09-14T08:40:49.182 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:49.180+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:49.219 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:49.219 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:49.235 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:49.236 INFO:teuthology.orchestra.run.smithi188.stdout:1764 read 0x96b4e00 thru 0x96b543f (0x640 bytes) 2024-09-14T08:40:49.236 INFO:teuthology.orchestra.run.smithi188.stdout:1766 write 0x9f9600 thru 0xa01311 (0x7d12 bytes) 2024-09-14T08:40:49.283 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:49.280+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:49.313 INFO:teuthology.orchestra.run.smithi188.stdout:1774 trunc from 0xeace400 to 0x84cd200 2024-09-14T08:40:49.373 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:49.373 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:49.383 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:49.380+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:49.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:49.477 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:40:49.484 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:49.484+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:49.522 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:49.522 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:49.542 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:49.585 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:49.584+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:49.686 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:49.685+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:49.700 INFO:teuthology.orchestra.run.smithi188.stdout:1776 trunc from 0x84cd200 to 0x2d5a000 2024-09-14T08:40:49.708 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:49.708 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:49.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:49.770 INFO:teuthology.orchestra.run.smithi188.stdout:1777 punch from 0x2721400 to 0x272a600, (0x9200 bytes) 2024-09-14T08:40:49.787 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:49.789+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:1782 read 0x24e8800 thru 0x24f841f (0xfc20 bytes) 2024-09-14T08:40:49.856 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:49.857 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:49.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:49.887 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:49.889+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:1786 write 0xb3b1400 thru 0xb3b3990 (0x2591 bytes) 2024-09-14T08:40:49.973 INFO:teuthology.orchestra.run.smithi188.stdout:1791 punch from 0x5809a00 to 0x5812c00, (0x9200 bytes) 2024-09-14T08:40:49.974 INFO:teuthology.orchestra.run.smithi188.stdout:1792 read 0x828b800 thru 0x828e03f (0x2840 bytes) 2024-09-14T08:40:49.975 INFO:teuthology.orchestra.run.smithi188.stdout:1794 read 0x1154200 thru 0x1157a63 (0x3864 bytes) 2024-09-14T08:40:49.977 INFO:teuthology.orchestra.run.smithi188.stdout:1798 punch from 0x9ec5000 to 0x9ecd400, (0x8400 bytes) 2024-09-14T08:40:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:1800 read 0xab25400 thru 0xab34890 (0xf491 bytes) 2024-09-14T08:40:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:1803 read 0xaa16600 thru 0xaa22366 (0xbd67 bytes) 2024-09-14T08:40:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:1805 write 0xa4e6200 thru 0xa4f4747 (0xe548 bytes) 2024-09-14T08:40:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:1806 read 0x76c8000 thru 0x76cc3d6 (0x43d7 bytes) 2024-09-14T08:40:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:1807 punch from 0xaff400 to 0xaff800, (0x400 bytes) 2024-09-14T08:40:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:1811 punch from 0x580d200 to 0x5818a00, (0xb800 bytes) 2024-09-14T08:40:49.988 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:49.989+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:49.992 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:49.992 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:50.006 INFO:teuthology.orchestra.run.smithi188.stdout:1813 read 0x6125000 thru 0x6128eb9 (0x3eba bytes) 2024-09-14T08:40:50.006 INFO:teuthology.orchestra.run.smithi188.stdout:1814 read 0x479a200 thru 0x479fed6 (0x5cd7 bytes) 2024-09-14T08:40:50.013 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:1817 trunc from 0xb3b3a00 to 0x5615e00 2024-09-14T08:40:50.088 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:50.088+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:50.097 INFO:teuthology.orchestra.run.smithi188.stdout:1818 trunc from 0x5615e00 to 0x14c7000 2024-09-14T08:40:50.147 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:50.147 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:50.161 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:50.204 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:50.204+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:50.290 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:50.293+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:50.326 INFO:teuthology.orchestra.run.smithi188.stdout:1821 punch from 0xd43800 to 0xd47600, (0x3e00 bytes) 2024-09-14T08:40:50.328 INFO:teuthology.orchestra.run.smithi188.stdout:1822 read 0x105800 thru 0x10ca07 (0x7208 bytes) 2024-09-14T08:40:50.332 INFO:teuthology.orchestra.run.smithi188.stdout:1826 punch from 0x555e00 to 0x565600, (0xf800 bytes) 2024-09-14T08:40:50.344 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:50.344 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:50.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:50.391 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:50.393+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:50.468 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:40:50.472 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5] out_osds: [3] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:40:50.472 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:40:50.472 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-14T08:40:50.472 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T08:40:50.472 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T08:40:50.473 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-14T08:40:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:1827 write 0xc41d600 thru 0xc4237cb (0x61cc bytes) 2024-09-14T08:40:50.517 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:50.516+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:50.587 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:50.587 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:50.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:50.588 INFO:teuthology.orchestra.run.smithi188.stdout:1828 write 0xcabfe00 thru 0xcacf7aa (0xf9ab bytes) 2024-09-14T08:40:50.588 INFO:teuthology.orchestra.run.smithi188.stdout:1830 punch from 0x8d9ea00 to 0x8da3e00, (0x5400 bytes) 2024-09-14T08:40:50.588 INFO:teuthology.orchestra.run.smithi188.stdout:1831 trunc from 0xcacf800 to 0x9f35800 2024-09-14T08:40:50.588 INFO:teuthology.orchestra.run.smithi188.stdout:1835 read 0x4180c00 thru 0x4182c0e (0x200f bytes) 2024-09-14T08:40:50.588 INFO:teuthology.orchestra.run.smithi188.stdout:1836 punch from 0x9b8e00 to 0x9c8400, (0xf600 bytes) 2024-09-14T08:40:50.593 INFO:teuthology.orchestra.run.smithi188.stdout:1837 write 0xb20ec00 thru 0xb215208 (0x6609 bytes) 2024-09-14T08:40:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:1842 read 0x59c8200 thru 0x59d05d9 (0x83da bytes) 2024-09-14T08:40:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:1847 read 0x73ad000 thru 0x73bb938 (0xe939 bytes) 2024-09-14T08:40:50.602 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:50.602 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "" 2024-09-14T08:40:50.602 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:50.602 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:50.600+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:50.606 INFO:teuthology.orchestra.run.smithi188.stdout:1849 trunc from 0xb215400 to 0x6f42200 2024-09-14T08:40:50.673 INFO:teuthology.orchestra.run.smithi188.stdout:1850 trunc from 0x6f42200 to 0xd82400 2024-09-14T08:40:50.694 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:50.693+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:50.726 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:50.726 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:50.741 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:50.768 INFO:teuthology.orchestra.run.smithi188.stdout:1851 write 0xd119200 thru 0xd11f224 (0x6025 bytes) 2024-09-14T08:40:50.769 INFO:teuthology.orchestra.run.smithi188.stdout:1852 write 0x477aa00 thru 0x477cd5a (0x235b bytes) 2024-09-14T08:40:50.770 INFO:teuthology.orchestra.run.smithi188.stdout:1854 read 0x9c95a00 thru 0x9ca1ffa (0xc5fb bytes) 2024-09-14T08:40:50.770 INFO:teuthology.orchestra.run.smithi188.stdout:1855 write 0xa853c00 thru 0xa85b852 (0x7c53 bytes) 2024-09-14T08:40:50.770 INFO:teuthology.orchestra.run.smithi188.stdout:1856 read 0x9dd9400 thru 0x9ddedfd (0x59fe bytes) 2024-09-14T08:40:50.770 INFO:teuthology.orchestra.run.smithi188.stdout:1857 write 0x7739600 thru 0x773d6aa (0x40ab bytes) 2024-09-14T08:40:50.771 INFO:teuthology.orchestra.run.smithi188.stdout:1858 punch from 0xbbda800 to 0xbbe2800, (0x8000 bytes) 2024-09-14T08:40:50.772 INFO:teuthology.orchestra.run.smithi188.stdout:1859 punch from 0xb76f600 to 0xb770a00, (0x1400 bytes) 2024-09-14T08:40:50.772 INFO:teuthology.orchestra.run.smithi188.stdout:1860 clone 18 order 18 su 4096 sc 5 2024-09-14T08:40:50.796 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:50.797+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:50.867 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:50.867 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:50.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:50.881 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:50.928 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:50.928+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:50.996 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:50.997+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:51.000 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:51.000 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:51.007 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:51.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:51.025 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:51.041 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:51.042 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:51.063 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:51.082 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:51.102 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:51.104 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:51.104+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:51.105 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:51.105 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:51.183 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.106384384999998, 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.106296288000003, 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.106228891000001, 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.194 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:51.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:51.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:51.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:51.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.106155194999999, 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:51.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.200 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:51.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:51.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:51.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:51.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:51.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.106079723000001, 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.204 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:51.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:51.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:51.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:51.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:51.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.106022519, 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:51.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:51.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:51.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:51.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:51.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.105963635000002, 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.214 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:51.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:51.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:51.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:51.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:51.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:51.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:51.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:51.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:51.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:51.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.219 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.219 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.105898709000002, 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:51.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:51.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:51.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:51.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.224 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.105837258000001, 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:51.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:51.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:51.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.105777723999999, 2024-09-14T08:40:51.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:51.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.105718414000002, 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:51.234 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:51.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.105646382000003, 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:51.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:51.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24681 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3076096~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.951311488999998, 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096091748000000005, 2024-09-14T08:40:51.243 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24681 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233725+0000", 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.017e-06 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233735+0000", 2024-09-14T08:40:51.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8430000000000005e-06 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233746+0000", 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1409e-05 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233756+0000", 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5230000000000001e-06 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329376+0000", 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095619941 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329544+0000", 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000168269 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329816+0000", 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027174600000000001 2024-09-14T08:40:51.247 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24682 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.951237543000001, 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096544940999999995, 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24682 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233799+0000", 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.08e-06 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233803+0000", 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4429999999999999e-06 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233816+0000", 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3816e-05 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233824+0000", 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5859999999999999e-06 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329882+0000", 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096058344000000004 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330073+0000", 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019082999999999999 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330343+0000", 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026984200000000001 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.951198888, 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:51.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.951168110000001, 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.257 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.261 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.951102407, 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:40:51.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.950980235999999, 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.266 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:51.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:40:51.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.950946004999999, 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:40:51.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.950914579999999, 2024-09-14T08:40:51.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:51.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:51.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:40:51.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:40:51.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.280 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:51.280 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:51.280 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:51.281 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:51.280+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:51.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:51.383 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:51.384+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:51.410 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:51.410 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:51.410 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:51.410 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:51.424 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:51.483 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:51.485+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:51.550 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:51.550 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:51.550 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:51.550 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:51.551 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:51.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:51.607 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:51.609+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:51.640 INFO:teuthology.orchestra.run.smithi188.stdout:leaving image image_client.0-clone17 intact 2024-09-14T08:40:51.685 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:51.685+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:51.731 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:51.731 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:51.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:51.732 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:51.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.732 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31799 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3315712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.732 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:51.732 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.806278628999998, 2024-09-14T08:40:51.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071768473999999999, 2024-09-14T08:40:51.732 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.732 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31799 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:51.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925577+0000", 2024-09-14T08:40:51.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:40:51.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925579+0000", 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925587+0000", 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925593+0000", 2024-09-14T08:40:51.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997015+0000", 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071422484999999994 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997130+0000", 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115053 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997345+0000", 2024-09-14T08:40:51.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214379 2024-09-14T08:40:51.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.737 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.737 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31800 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3326976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.737 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:51.737 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.806254942999999, 2024-09-14T08:40:51.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072113090000000005, 2024-09-14T08:40:51.738 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.738 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.738 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.738 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31800 2024-09-14T08:40:51.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.738 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:51.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925603+0000", 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925610+0000", 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8029999999999997e-06 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925618+0000", 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6930000000000007e-06 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997400+0000", 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071781929999999994 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997507+0000", 2024-09-14T08:40:51.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107012 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997713+0000", 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020603 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:51.742 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.806229254000002, 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:51.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:51.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:51.748 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.806206697999997, 2024-09-14T08:40:51.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:40:51.748 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.748 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.748 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.748 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:40:51.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.749 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:51.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:40:51.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:40:51.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.806138683, 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.753 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:40:51.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:40:51.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:40:51.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:40:51.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:40:51.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.758 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.758 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.758 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.758 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:51.758 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.806088955, 2024-09-14T08:40:51.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:40:51.758 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:51.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:40:51.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:40:51.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:40:51.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:40:51.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:40:51.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.763 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.806037799999999, 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:40:51.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:40:51.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:40:51.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:40:51.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:40:51.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:51.768 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.805985796999998, 2024-09-14T08:40:51.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:40:51.769 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.769 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.769 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.769 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:40:51.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.805923227000001, 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.774 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.778 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.779 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:51.779 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.805856648999999, 2024-09-14T08:40:51.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:40:51.779 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.779 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.779 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.779 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.779 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.779 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.779 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:40:51.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.805778865000001, 2024-09-14T08:40:51.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:51.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:40:51.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.80572617, 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:40:51.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.792 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.805680516999999, 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.793 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:40:51.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.797 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.805634046000002, 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:40:51.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:40:51.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:40:51.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:40:51.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:40:51.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.805588057999998, 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:40:51.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:40:51.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:40:51.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.805559799999997, 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:40:51.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:40:51.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:40:51.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:40:51.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:40:51.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:40:51.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.812 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.805505021999998, 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:51.813 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:51.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:40:51.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:40:51.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:40:51.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:40:51.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.377734562999997, 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:40:51.818 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.819 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.819 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:51.819 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:51.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:51.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:40:51.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:40:51.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:40:51.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:40:51.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:40:51.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:40:51.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:40:51.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:40:51.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.385130495999999, 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:51.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:51.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:40:51.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:40:51.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:40:51.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:40:51.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:40:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:40:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:40:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:40:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.384292125000002, 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:51.831 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:40:51.832 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:51.832 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:40:51.832 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:40:51.832 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:40:51.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.832 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:51.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:51.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:51.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:51.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:40:51.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:40:51.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:40:51.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:40:51.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:51.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.837 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:51.837 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:51.837 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:51.838 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:51.839 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:51.837+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:51.938 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:51.937+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:52.009 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:52.009 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:52.009 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:52.009 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:52.024 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:52.039 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:52.036+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:52.141 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:52.140+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:52.203 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:52.203 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:52.203 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:52.203 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:52.204 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:52.218 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:52.241 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:52.240+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:52.242 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-14T08:40:52.305 INFO:teuthology.orchestra.run.smithi188.stdout:1863 write 0x52af600 thru 0x52b37c0 (0x41c1 bytes) 2024-09-14T08:40:52.307 INFO:teuthology.orchestra.run.smithi188.stdout:1865 read 0xab5ea00 thru 0xab6de42 (0xf443 bytes) 2024-09-14T08:40:52.310 INFO:teuthology.orchestra.run.smithi188.stdout:1866 write 0x9b96600 thru 0x9b9cd9a (0x679b bytes) 2024-09-14T08:40:52.311 INFO:teuthology.orchestra.run.smithi188.stdout:1867 read 0x1d7c400 thru 0x1d895c3 (0xd1c4 bytes) 2024-09-14T08:40:52.343 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:52.343 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:52.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:52.343 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:52.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.343 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.343 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:52.343 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065380077, 2024-09-14T08:40:52.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:40:52.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:40:52.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:40:52.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.348 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.348 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:52.348 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065351280999998, 2024-09-14T08:40:52.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:40:52.348 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:40:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:40:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:40:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:40:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:40:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065322461999997, 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:40:52.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065294133000002, 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.362 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065264933000002, 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:40:52.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065232924999997, 2024-09-14T08:40:52.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:52.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:40:52.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:40:52.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:52.372 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065203648999997, 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:52.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:40:52.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065173983000001, 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.377 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.378 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.378 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.378 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.378 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.378 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:40:52.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.378 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:40:52.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065145440000002, 2024-09-14T08:40:52.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:40:52.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:40:52.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:40:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065117133999998, 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.387 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:40:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.391 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065071867, 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.065040244999999, 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.396 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:40:52.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:40:52.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:40:52.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:40:52.400 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.400 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.400 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.064982432999997, 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:40:52.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:40:52.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.064914420000001, 2024-09-14T08:40:52.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:40:52.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:40:52.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:40:52.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:40:52.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:40:52.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:52.410 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.064879048000002, 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:40:52.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:40:52.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.064844649000001, 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.415 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:52.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:40:52.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:40:52.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:40:52.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.037774096, 2024-09-14T08:40:52.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:40:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:40:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7756639169999993, 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:40:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:40:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:40:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:40:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:40:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:40:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:40:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:40:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:40:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7755167459999992, 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:40:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:40:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:40:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:40:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:40:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.7753749459999995, 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:40:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:40:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:40:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:40:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:52.445 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:52.446 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:52.341+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:52.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:52.448 INFO:teuthology.orchestra.run.smithi188.stdout:1868 trunc from 0xd11f400 to 0x3a07800 2024-09-14T08:40:52.448 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:52.448+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:52.476 INFO:teuthology.orchestra.run.smithi188.stdout:1869 read 0xfaf000 thru 0xfbc995 (0xd996 bytes) 2024-09-14T08:40:52.478 INFO:teuthology.orchestra.run.smithi188.stdout:1870 read 0x1034e00 thru 0x103500b (0x20c bytes) 2024-09-14T08:40:52.478 INFO:teuthology.orchestra.run.smithi188.stdout:1873 punch from 0x1931a00 to 0x1940400, (0xea00 bytes) 2024-09-14T08:40:52.479 INFO:teuthology.orchestra.run.smithi188.stdout:1875 read 0x33b5600 thru 0x33c13f1 (0xbdf2 bytes) 2024-09-14T08:40:52.480 INFO:teuthology.orchestra.run.smithi188.stdout:1876 read 0x39b3400 thru 0x39c17a4 (0xe3a5 bytes) 2024-09-14T08:40:52.490 INFO:teuthology.orchestra.run.smithi188.stdout:1877 read 0x72c000 thru 0x7354d9 (0x94da bytes) 2024-09-14T08:40:52.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:40:52.495 INFO:teuthology.orchestra.run.smithi188.stdout:1878 read 0x2842600 thru 0x28462b1 (0x3cb2 bytes) 2024-09-14T08:40:52.495 INFO:teuthology.orchestra.run.smithi188.stdout:1879 read 0x67600 thru 0x7118e (0x9b8f bytes) 2024-09-14T08:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout:1885 write 0xc777400 thru 0xc7858a7 (0xe4a8 bytes) 2024-09-14T08:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout:1892 read 0x51dfa00 thru 0x51e4dba (0x53bb bytes) 2024-09-14T08:40:52.548 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:52.549+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout:1893 trunc from 0xc785a00 to 0x581bc00 2024-09-14T08:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout:1895 punch from 0x164ee00 to 0x1659c00, (0xae00 bytes) 2024-09-14T08:40:52.597 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:52.597 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:52.597 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:52.597 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:52.614 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:52.631 INFO:teuthology.orchestra.run.smithi188.stdout:1896 write 0xcc26400 thru 0xcc2be7d (0x5a7e bytes) 2024-09-14T08:40:52.633 INFO:teuthology.orchestra.run.smithi188.stdout:1897 write 0x3757c00 thru 0x37613c9 (0x97ca bytes) 2024-09-14T08:40:52.633 INFO:teuthology.orchestra.run.smithi188.stdout:1898 read 0xbb2c800 thru 0xbb2d2c2 (0xac3 bytes) 2024-09-14T08:40:52.633 INFO:teuthology.orchestra.run.smithi188.stdout:1899 write 0x973f000 thru 0x974dcca (0xeccb bytes) 2024-09-14T08:40:52.633 INFO:teuthology.orchestra.run.smithi188.stdout:1900 clone 19 order 21 su 1048576 sc 10 2024-09-14T08:40:52.650 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:52.649+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:52.740 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:52.740 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:52.740 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:52.740 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:52.740 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:52.751 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:52.753+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:52.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:52.852 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:52.856+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.632127162000003, 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.879 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:40:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:40:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:40:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:40:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:52.884 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.632065148999999, 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:40:52.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631998819000003, 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.889 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:40:52.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631943358999997, 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.894 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:40:52.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:40:52.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.898 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631883739000003, 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:40:52.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631802198999999, 2024-09-14T08:40:52.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:40:52.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:40:52.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631745871, 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:40:52.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631674375999999, 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.913 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:40:52.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:40:52.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631601504999999, 2024-09-14T08:40:52.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:52.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631559293000002, 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631529463, 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:40:52.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.931 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:52.932 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631501166, 2024-09-14T08:40:52.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:40:52.932 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.932 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.932 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.932 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:40:52.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.936 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631460070999999, 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:40:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:40:52.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631431040999999, 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.941 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:40:52.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.945 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631402557000001, 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:40:52.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631374417000004, 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:40:52.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.954 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631345721000002, 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:40:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:40:52.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631316964, 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.959 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.963 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631288916999999, 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:40:52.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.631258940000002, 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:52.968 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:52.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:40:52.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:52.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:52.972 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:52.974 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:52.974 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:52.973+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:53.075 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:53.076+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:53.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:53.143 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:53.143 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:53.157 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:53.175 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:53.177+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:53.244 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:53.262 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:53.262 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:53.276 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:53.280+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:53.278 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:53.279 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:53.299 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:53.299 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:53.319 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:53.320 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:53.321 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:53.321 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:53.335 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:53.340 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:53.340 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:53.343 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:53.344 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:53.387 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:53.389+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:53.477 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:53.477+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:53.488 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:40:53.502 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:53.502 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:53.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:53.578 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:53.577+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:53.643 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:53.643 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:53.658 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:53.690 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone18 from 0xcc2c000 (overlap 0x3a07800) to 0x22d1400 2024-09-14T08:40:53.708 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:53.708+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:53.779 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:53.781+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:53.799 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:53.799 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:53.814 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:53.900 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:53.904+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:53.975 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:53.975 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:53.980 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:53.984+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:53.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:54.081 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:54.084+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:54.122 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:54.122 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:54.136 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:54.183 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:54.185+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:54.264 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:54.264 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:54.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:54.323 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:54.325+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:54.383 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:54.384+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:54.399 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-14T08:40:54.447 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:54.447 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:54.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:54.484 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:54.488+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:54.585 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:54.588+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:54.591 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:54.591 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:54.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:54.686 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:54.688+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:54.747 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:54.747 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:54.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:54.811 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:54.813+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:54.887 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:54.888+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:54.918 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:54.919 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:54.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:54.988 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:54.988+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:55.088 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:55.089+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:55.100 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:55.100 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:55.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:55.189 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:55.189+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:55.289 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:55.292+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:55.303 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:55.304 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:55.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:55.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:55.412 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:55.416+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:55.488 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:55.490 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:55.489+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:55.506 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:55.506 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:55.512 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:55.512 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:55.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:40:55.522 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:55.534 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:55.535 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:55.558 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:55.558 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:55.577 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:55.577 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:55.599 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:55.599 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:55.602 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:55.603 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:55.608 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:55.612+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:55.620 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5] out_osds: [3] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:40:55.621 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:40:55.621 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-14T08:40:55.621 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T08:40:55.621 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T08:40:55.621 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-14T08:40:55.692 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:55.693+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:55.701 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:55.702 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:55.702 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:55.702 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:55.719 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:55.752 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:55.752 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T08:40:55.752 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:55.812 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:55.816+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:55.854 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:55.854 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:55.854 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:55.854 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:55.854 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:55.870 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:55.912 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:55.916+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:55.994 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:55.996+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:56.057 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.173599107999998, 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:40:56.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.062 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.063 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.063 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:56.063 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.162347072999999, 2024-09-14T08:40:56.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:40:56.063 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.063 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.063 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.063 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:40:56.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:40:56.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.161487188000002, 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:40:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:40:56.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:40:56.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:56.072 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.161180563000002, 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:40:56.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.160777228000001, 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.077 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:40:56.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:40:56.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.160373524999997, 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:40:56.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.086 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.160022779000002, 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:40:56.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:40:56.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.159636507000002, 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:40:56.091 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:40:56.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.159445974, 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:40:56.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.158939246000003, 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:40:56.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:40:56.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.158613174000003, 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:40:56.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:40:56.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.109 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.158303562, 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:40:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:40:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:40:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.157808019999997, 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:40:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.157492261999998, 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:40:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.157004825999998, 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:40:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.156654813999999, 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:40:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:40:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:40:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.155863695000001, 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:40:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.155454636000002, 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:40:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:40:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.152821949, 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:40:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:40:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:40:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:40:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.326331308, 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:40:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:40:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:40:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:40:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.154 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:56.155 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:56.156 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:56.157+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:56.256 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:56.260+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:56.322 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:56.322 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:56.322 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:40:56.322 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:56.336 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:56.380 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:56.384+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:56.457 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:56.457+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:56.486 INFO:teuthology.orchestra.run.smithi188.stdout:1902 read 0x21aa200 thru 0x21b6e84 (0xcc85 bytes) 2024-09-14T08:40:56.487 INFO:teuthology.orchestra.run.smithi188.stdout:1903 read 0x58cf000 thru 0x58d7d71 (0x8d72 bytes) 2024-09-14T08:40:56.502 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:40:56.503 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:56.504 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:40:56.504 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:40:56.504 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:40:56.504 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:56.519 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:56.550 INFO:teuthology.orchestra.run.smithi188.stdout:1904 trunc from 0xcc2c000 to 0x16f1400 2024-09-14T08:40:56.567 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:56.569+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:56.585 INFO:teuthology.orchestra.run.smithi188.stdout:1905 read 0x1547200 thru 0x155091f (0x9720 bytes) 2024-09-14T08:40:56.586 INFO:teuthology.orchestra.run.smithi188.stdout:1907 read 0x1164800 thru 0x1173f0f (0xf710 bytes) 2024-09-14T08:40:56.593 INFO:teuthology.orchestra.run.smithi188.stdout:1908 trunc from 0x16f1400 to 0x961400 2024-09-14T08:40:56.650 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:40:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:40:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:40:56.650 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573827414999997, 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.651 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:40:56.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:40:56.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573739318000001, 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:40:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:40:56.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573671920999999, 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:40:56.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:40:56.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573598224999998, 2024-09-14T08:40:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:40:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:40:56.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573522752999999, 2024-09-14T08:40:56.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:40:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:40:56.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.677 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573465548999998, 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.678 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:40:56.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.682 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573406665, 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.683 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:40:56.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573341739, 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.688 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:40:56.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:56.693 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573280287999999, 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:40:56.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573220753999998, 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:40:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573161444, 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:40:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.573089412000002, 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:40:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:40:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:40:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24681 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3076096~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.418754519, 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096091748000000005, 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24681 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233725+0000", 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.017e-06 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233735+0000", 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8430000000000005e-06 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233746+0000", 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1409e-05 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233756+0000", 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5230000000000001e-06 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329376+0000", 2024-09-14T08:40:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095619941 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329544+0000", 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000168269 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329816+0000", 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027174600000000001 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24682 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.418680573, 2024-09-14T08:40:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096544940999999995, 2024-09-14T08:40:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24682 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233799+0000", 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.08e-06 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233803+0000", 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4429999999999999e-06 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233816+0000", 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3816e-05 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233824+0000", 2024-09-14T08:40:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5859999999999999e-06 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329882+0000", 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096058344000000004 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330073+0000", 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019082999999999999 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330343+0000", 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026984200000000001 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.418641917999999, 2024-09-14T08:40:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:40:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.418611139999999, 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:40:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:40:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:40:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.418545436999999, 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:40:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.418423266000001, 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:40:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.418389035000001, 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:40:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.418357610000001, 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:40:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:40:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:40:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:40:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:40:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:40:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:40:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:40:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:40:56.757 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:40:56.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:1909 write 0xc4c6400 thru 0xc4d627c (0xfe7d bytes) 2024-09-14T08:40:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:1910 write 0x320d000 thru 0x320da28 (0xa29 bytes) 2024-09-14T08:40:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:1912 read 0x9285600 thru 0x928f97a (0xa37b bytes) 2024-09-14T08:40:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:1914 write 0x2221800 thru 0x2227f95 (0x6796 bytes) 2024-09-14T08:40:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:1917 punch from 0x9fb0200 to 0x9fb7200, (0x7000 bytes) 2024-09-14T08:40:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:1918 punch from 0x789000 to 0x78cc00, (0x3c00 bytes) 2024-09-14T08:40:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:1920 read 0x2439c00 thru 0x2444a3e (0xae3f bytes) 2024-09-14T08:40:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:1921 write 0x76b8e00 thru 0x76c60e9 (0xd2ea bytes) 2024-09-14T08:40:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:1923 read 0xae73c00 thru 0xae8016a (0xc56b bytes) 2024-09-14T08:40:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:1924 write 0x4910c00 thru 0x4912b8c (0x1f8d bytes) 2024-09-14T08:40:56.762 INFO:teuthology.orchestra.run.smithi188.stdout:1926 read 0x1634800 thru 0x163e75c (0x9f5d bytes) 2024-09-14T08:40:56.762 INFO:teuthology.orchestra.run.smithi188.stdout:1928 write 0xc785600 thru 0xc787f69 (0x296a bytes) 2024-09-14T08:40:56.762 INFO:teuthology.orchestra.run.smithi188.stdout:1929 write 0xd37200 thru 0xd3c5f6 (0x53f7 bytes) 2024-09-14T08:40:56.762 INFO:teuthology.orchestra.run.smithi188.stdout:1931 write 0x81e000 thru 0x81f594 (0x1595 bytes) 2024-09-14T08:40:56.762 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:56.757+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:56.779 INFO:teuthology.orchestra.run.smithi188.stdout:1934 trunc from 0xc788000 to 0x142a000 2024-09-14T08:40:56.823 INFO:teuthology.orchestra.run.smithi188.stdout:1935 read 0xa63600 thru 0xa6d110 (0x9b11 bytes) 2024-09-14T08:40:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:1938 read 0x63b200 thru 0x63c33e (0x113f bytes) 2024-09-14T08:40:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:1941 write 0x69f5200 thru 0x69fa733 (0x5534 bytes) 2024-09-14T08:40:56.859 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:56.860+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:56.860 INFO:teuthology.orchestra.run.smithi188.stdout:1942 clone 20 order 18 su 2048 sc 11 2024-09-14T08:40:56.904 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:56.904 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:56.905 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:56.905 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:56.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:56.967 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:56.969+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:57.039 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:57.040 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:57.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:57.099 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:57.101+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:57.161 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:57.161+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:57.225 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:57.225 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:40:57.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:40:57.225 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:40:57.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.225 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31799 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3315712~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.225 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:57.225 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.300135152999999, 2024-09-14T08:40:57.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071768473999999999, 2024-09-14T08:40:57.225 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31799 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925576+0000", 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925577+0000", 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925579+0000", 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2400000000000002e-06 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925587+0000", 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6420000000000007e-06 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925593+0000", 2024-09-14T08:40:57.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1789999999999996e-06 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997015+0000", 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071422484999999994 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997130+0000", 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115053 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997345+0000", 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214379 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31800 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3326976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.300111467000001, 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072113090000000005, 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.230 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31800 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925600+0000", 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925603+0000", 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1320000000000001e-06 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925610+0000", 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8029999999999997e-06 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925618+0000", 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6930000000000007e-06 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997400+0000", 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071781929999999994 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997507+0000", 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107012 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997713+0000", 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020603 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:57.234 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.300085778000003, 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:40:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:40:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:40:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:40:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:40:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.300063221999999, 2024-09-14T08:40:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:40:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299995207000002, 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:40:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:40:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299945479000002, 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:40:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299894324, 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:40:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:40:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299842321, 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:40:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299779751000003, 2024-09-14T08:40:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:40:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299713173000001, 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:40:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299635389000002, 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:40:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299582694000001, 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299537041000001, 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:40:57.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299490570000003, 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.287 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:40:57.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.291 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299444582, 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:40:57.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:40:57.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299416323999999, 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:40:57.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:40:57.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:57.301 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.299361546, 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:40:57.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.871591086999999, 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:40:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:40:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.87898702, 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:40:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.878148649, 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:40:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:40:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:40:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:40:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:40:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:40:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:40:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:40:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:40:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:40:57.321 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:57.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:57.323 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:57.323+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:57.423 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:57.423+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:57.493 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:57.493 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:57.493 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:40:57.493 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:57.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:40:57.524 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:57.523+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:57.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:40:57.624 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:57.627+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:57.636 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:40:57.636 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:40:57.636 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:40:57.636 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:40:57.636 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:40:57.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:40:57.705 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone19 from 0x69fa800 (overlap 0x961400) to 0x0 2024-09-14T08:40:57.725 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:57.727+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:57.731 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:40:57.749 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:40:57.749 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:40:57.766 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:40:57.766 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:40:57.787 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:40:57.787 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:40:57.808 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:40:57.809 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:40:57.822 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:57.822 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:57.827 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:57.827+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:57.831 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:40:57.831 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:40:57.834 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:40:57.835 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:40:57.837 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:40:57.928 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:57.929+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:57.966 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:57.966 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:57.979 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:40:58.029 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:58.031+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:58.099 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:58.100 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:58.113 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:40:58.130 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:58.129+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:58.230 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:58.231+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:58.275 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:58.275 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:58.289 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:40:58.333 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:58.335+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:58.432 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:58.431+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:58.458 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:58.458 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:58.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:40:58.525 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:40:58.560 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:58.563+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:58.634 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:58.633+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:58.639 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:58.639 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:58.640 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-14T08:40:58.653 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:40:58.735 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:58.737+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:58.836 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:58.835+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:58.841 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:58.842 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:58.856 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:40:58.948 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:58.951+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:58.988 INFO:teuthology.orchestra.run.smithi188.stdout:1944 punch from 0x5ce4e00 to 0x5cf2600, (0xd800 bytes) 2024-09-14T08:40:59.017 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:59.017 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:59.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:40:59.037 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:59.037+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:59.054 INFO:teuthology.orchestra.run.smithi188.stdout:1947 write 0x6ce1000 thru 0x6ce4cf1 (0x3cf2 bytes) 2024-09-14T08:40:59.057 INFO:teuthology.orchestra.run.smithi188.stdout:1949 trunc from 0x6ce4e00 to 0x6e64e00 2024-09-14T08:40:59.120 INFO:teuthology.orchestra.run.smithi188.stdout:1952 read 0x31e00 thru 0x388db (0x6adc bytes) 2024-09-14T08:40:59.138 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:59.139+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:59.195 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:59.195 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:59.210 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:40:59.239 INFO:teuthology.orchestra.run.smithi188.stdout:1955 write 0xe547000 thru 0xe547eff (0xf00 bytes) 2024-09-14T08:40:59.242 INFO:teuthology.orchestra.run.smithi188.stdout:1956 write 0xc49ac00 thru 0xc4a5deb (0xb1ec bytes) 2024-09-14T08:40:59.242 INFO:teuthology.orchestra.run.smithi188.stdout:1958 write 0x40d1400 thru 0x40de370 (0xcf71 bytes) 2024-09-14T08:40:59.252 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:59.255+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:59.303 INFO:teuthology.orchestra.run.smithi188.stdout:1959 trunc from 0xe548000 to 0x25fc600 2024-09-14T08:40:59.341 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:40:59.341+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:40:59.381 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:59.382 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:59.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:40:59.441 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:59.443+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:59.459 INFO:teuthology.orchestra.run.smithi188.stdout:1960 write 0x8d8b600 thru 0x8d9af12 (0xf913 bytes) 2024-09-14T08:40:59.461 INFO:teuthology.orchestra.run.smithi188.stdout:1961 read 0x7776800 thru 0x7785f24 (0xf725 bytes) 2024-09-14T08:40:59.462 INFO:teuthology.orchestra.run.smithi188.stdout:1962 read 0xcade00 thru 0xcb1aff (0x3d00 bytes) 2024-09-14T08:40:59.465 INFO:teuthology.orchestra.run.smithi188.stdout:1963 write 0x7df3e00 thru 0x7df742e (0x362f bytes) 2024-09-14T08:40:59.465 INFO:teuthology.orchestra.run.smithi188.stdout:1965 read 0x7887800 thru 0x788cc90 (0x5491 bytes) 2024-09-14T08:40:59.466 INFO:teuthology.orchestra.run.smithi188.stdout:1967 write 0xd82000 thru 0xd877f4 (0x57f5 bytes) 2024-09-14T08:40:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:1968 trunc from 0x8d9b000 to 0xa46a600 2024-09-14T08:40:59.531 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:40:59.542 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:40:59.543+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:40:59.559 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:59.559 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:59.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:40:59.641 INFO:teuthology.orchestra.run.smithi188.stdout:1972 punch from 0x2cd9600 to 0x2ce7a00, (0xe400 bytes) 2024-09-14T08:40:59.643 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:59.643+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:59.644 INFO:teuthology.orchestra.run.smithi188.stdout:1973 write 0x640e800 thru 0x6416daf (0x85b0 bytes) 2024-09-14T08:40:59.692 INFO:teuthology.orchestra.run.smithi188.stdout:1974 write 0xc3c3e00 thru 0xc3ca9ef (0x6bf0 bytes) 2024-09-14T08:40:59.694 INFO:teuthology.orchestra.run.smithi188.stdout:1975 punch from 0xb0b0800 to 0xb0bc000, (0xb800 bytes) 2024-09-14T08:40:59.695 INFO:teuthology.orchestra.run.smithi188.stdout:1978 punch from 0xbd8f600 to 0xbd9d200, (0xdc00 bytes) 2024-09-14T08:40:59.696 INFO:teuthology.orchestra.run.smithi188.stdout:1979 read 0xaa0bc00 thru 0xaa1938e (0xd78f bytes) 2024-09-14T08:40:59.701 INFO:teuthology.orchestra.run.smithi188.stdout:1981 trunc from 0xc3caa00 to 0xd9ef000 2024-09-14T08:40:59.744 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:40:59.747+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:40:59.744 INFO:teuthology.orchestra.run.smithi188.stdout:1984 write 0xd684c00 thru 0xd689ae2 (0x4ee3 bytes) 2024-09-14T08:40:59.745 INFO:teuthology.orchestra.run.smithi188.stdout:1986 write 0x3491e00 thru 0x34924a3 (0x6a4 bytes) 2024-09-14T08:40:59.745 INFO:teuthology.orchestra.run.smithi188.stdout:1987 write 0x4435a00 thru 0x4439d98 (0x4399 bytes) 2024-09-14T08:40:59.746 INFO:teuthology.orchestra.run.smithi188.stdout:1989 read 0x93d0a00 thru 0x93dbfbf (0xb5c0 bytes) 2024-09-14T08:40:59.746 INFO:teuthology.orchestra.run.smithi188.stdout:1990 read 0x7285400 thru 0x7292905 (0xd506 bytes) 2024-09-14T08:40:59.765 INFO:teuthology.orchestra.run.smithi188.stdout:1993 trunc from 0xd9ef000 to 0x67e5800 2024-09-14T08:40:59.781 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:59.781 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:59.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:40:59.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:40:59.845 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:40:59.845+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:40:59.858 INFO:teuthology.orchestra.run.smithi188.stdout:1995 read 0x6379800 thru 0x637c397 (0x2b98 bytes) 2024-09-14T08:40:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:1998 write 0x45cb200 thru 0x45d1165 (0x5f66 bytes) 2024-09-14T08:40:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:1999 read 0x3240800 thru 0x3249338 (0x8b39 bytes) 2024-09-14T08:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout:2001 write 0xd677c00 thru 0xd68465e (0xca5f bytes) 2024-09-14T08:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout:2002 punch from 0xbbee400 to 0xbbfb800, (0xd400 bytes) 2024-09-14T08:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout:2006 trunc from 0xd684800 to 0x781c400 2024-09-14T08:40:59.946 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:40:59.947+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:40:59.957 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:40:59.957 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:40:59.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:40:59.996 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:00.021 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:00.021 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:00.029 INFO:teuthology.orchestra.run.smithi188.stdout:2012 trunc from 0x781c400 to 0x90c0800 2024-09-14T08:41:00.040 INFO:teuthology.orchestra.run.smithi188.stdout:2013 read 0x6650c00 thru 0x665acfa (0xa0fb bytes) 2024-09-14T08:41:00.041 INFO:teuthology.orchestra.run.smithi188.stdout:2014 punch from 0x5252400 to 0x5261c00, (0xf800 bytes) 2024-09-14T08:41:00.042 INFO:teuthology.orchestra.run.smithi188.stdout:2015 read 0x41c0400 thru 0x41c4512 (0x4113 bytes) 2024-09-14T08:41:00.042 INFO:teuthology.orchestra.run.smithi188.stdout:2016 write 0x77a1600 thru 0x77aac5f (0x9660 bytes) 2024-09-14T08:41:00.042 INFO:teuthology.orchestra.run.smithi188.stdout:2017 write 0x548400 thru 0x5509bc (0x85bd bytes) 2024-09-14T08:41:00.047 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:00.047+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:00.047 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:00.048 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:00.083 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:00.084 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:00.120 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:00.120 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:00.147 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:00.149+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:00.149 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:00.150 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:00.153 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:00.154 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:00.182 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:00.182 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:00.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.182 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6703 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.182 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.140470+0000", 2024-09-14T08:41:00.182 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034515909999999997, 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034532733000000003, 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6703 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140470+0000", 2024-09-14T08:41:00.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140470+0000", 2024-09-14T08:41:00.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140471+0000", 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0999999999999998e-07 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140473+0000", 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.979e-06 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140484+0000", 2024-09-14T08:41:00.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140490+0000", 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3499999999999996e-06 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6787 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141229+0000", 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033756881000000002, 2024-09-14T08:41:00.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033819822999999999, 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6787 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141229+0000", 2024-09-14T08:41:00.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141229+0000", 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141229+0000", 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2799999999999996e-07 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141236+0000", 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8029999999999999e-06 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141242+0000", 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0299999999999999e-06 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141247+0000", 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.809e-06 2024-09-14T08:41:00.189 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6819 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141951+0000", 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033034516, 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033126488000000003, 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6819 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141951+0000", 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141951+0000", 2024-09-14T08:41:00.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141952+0000", 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9999999999999998e-07 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141954+0000", 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9130000000000001e-06 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141960+0000", 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8780000000000003e-06 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141964+0000", 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.916e-06 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.194 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6930 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.194 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154967+0000", 2024-09-14T08:41:00.194 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020019199000000001, 2024-09-14T08:41:00.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020136727, 2024-09-14T08:41:00.194 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.194 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.194 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.194 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6930 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154967+0000", 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154967+0000", 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154967+0000", 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.34e-07 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154969+0000", 2024-09-14T08:41:00.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0770000000000002e-06 2024-09-14T08:41:00.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154975+0000", 2024-09-14T08:41:00.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0430000000000004e-06 2024-09-14T08:41:00.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154980+0000", 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9130000000000002e-06 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6962 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155684+0000", 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019301793000000001, 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019445871, 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.198 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6962 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155684+0000", 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155684+0000", 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155685+0000", 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2e-07 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155687+0000", 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.125e-06 2024-09-14T08:41:00.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155693+0000", 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0009999999999998e-06 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155698+0000", 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8439999999999997e-06 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6704 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.140497+0000", 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034488698999999998, 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034659632000000003, 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6704 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140497+0000", 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140497+0000", 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140498+0000", 2024-09-14T08:41:00.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0500000000000004e-07 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140500+0000", 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4719999999999998e-06 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140514+0000", 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4076999999999999e-05 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140520+0000", 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6080000000000003e-06 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6788 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141254+0000", 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033731499999999998, 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033927206000000001, 2024-09-14T08:41:00.205 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.206 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.206 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.206 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6788 2024-09-14T08:41:00.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.207 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141254+0000", 2024-09-14T08:41:00.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141254+0000", 2024-09-14T08:41:00.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141255+0000", 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141257+0000", 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1919999999999999e-06 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141265+0000", 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0269999999999995e-06 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141270+0000", 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7169999999999999e-06 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6820 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141972+0000", 2024-09-14T08:41:00.210 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033013532999999998, 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033235720000000003, 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6820 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141972+0000", 2024-09-14T08:41:00.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141972+0000", 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141973+0000", 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2399999999999999e-07 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141975+0000", 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9589999999999998e-06 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141981+0000", 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9240000000000004e-06 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141986+0000", 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9740000000000001e-06 2024-09-14T08:41:00.213 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6931 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154986+0000", 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019999599999999999, 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020246433000000001, 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.215 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6931 2024-09-14T08:41:00.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.215 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154986+0000", 2024-09-14T08:41:00.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154986+0000", 2024-09-14T08:41:00.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154987+0000", 2024-09-14T08:41:00.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5999999999999999e-07 2024-09-14T08:41:00.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154988+0000", 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.796e-06 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154994+0000", 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.755e-06 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155002+0000", 2024-09-14T08:41:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5440000000000001e-06 2024-09-14T08:41:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6963 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155704+0000", 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019281539, 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019555121000000002, 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6963 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155704+0000", 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155704+0000", 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155705+0000", 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:41:00.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155707+0000", 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4439999999999998e-06 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155713+0000", 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.195e-06 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155718+0000", 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6705 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.140528+0000", 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034457936000000002, 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034756090000000003, 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.222 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.223 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.223 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.223 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.223 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.223 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6705 2024-09-14T08:41:00.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.223 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140528+0000", 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140528+0000", 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140528+0000", 2024-09-14T08:41:00.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2200000000000004e-07 2024-09-14T08:41:00.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140531+0000", 2024-09-14T08:41:00.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2139999999999999e-06 2024-09-14T08:41:00.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140537+0000", 2024-09-14T08:41:00.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0390000000000001e-06 2024-09-14T08:41:00.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140542+0000", 2024-09-14T08:41:00.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2000000000000002e-06 2024-09-14T08:41:00.226 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.226 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.226 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.227 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6789 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.227 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141276+0000", 2024-09-14T08:41:00.227 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033710068000000003, 2024-09-14T08:41:00.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034032817999999999, 2024-09-14T08:41:00.227 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.227 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.227 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6789 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141276+0000", 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141276+0000", 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141276+0000", 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9499999999999998e-07 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141278+0000", 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.841e-06 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141284+0000", 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.587e-06 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141288+0000", 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6821 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.142009+0000", 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.032976449999999997, 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033324484000000001, 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6821 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142009+0000", 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142009+0000", 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142010+0000", 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9100000000000004e-07 2024-09-14T08:41:00.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142012+0000", 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.351e-06 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142019+0000", 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0419999999999997e-06 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142025+0000", 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689999999999999e-06 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6932 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155016+0000", 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.01996995, 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020342658999999999, 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.234 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6932 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155016+0000", 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155016+0000", 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155016+0000", 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155019+0000", 2024-09-14T08:41:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.181e-06 2024-09-14T08:41:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155025+0000", 2024-09-14T08:41:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7950000000000002e-06 2024-09-14T08:41:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155030+0000", 2024-09-14T08:41:00.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9119999999999997e-06 2024-09-14T08:41:00.238 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.238 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.238 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.238 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6964 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155726+0000", 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019260269, 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019658585999999999, 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6964 2024-09-14T08:41:00.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.240 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155726+0000", 2024-09-14T08:41:00.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155726+0000", 2024-09-14T08:41:00.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155726+0000", 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0999999999999999e-07 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155728+0000", 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2819999999999999e-06 2024-09-14T08:41:00.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155734+0000", 2024-09-14T08:41:00.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:41:00.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155738+0000", 2024-09-14T08:41:00.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3229999999999999e-06 2024-09-14T08:41:00.242 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6706 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.140549+0000", 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034437008999999998, 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034859528000000001, 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.243 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6706 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140549+0000", 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140549+0000", 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140549+0000", 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7800000000000001e-07 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140551+0000", 2024-09-14T08:41:00.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0930000000000001e-06 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140558+0000", 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2349999999999996e-06 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140562+0000", 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7500000000000003e-06 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.246 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6790 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141295+0000", 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033690686999999997, 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034137381000000001, 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6790 2024-09-14T08:41:00.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141295+0000", 2024-09-14T08:41:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141295+0000", 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141296+0000", 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0699999999999998e-07 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141298+0000", 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.153e-06 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141305+0000", 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.866e-06 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141309+0000", 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8799999999999999e-06 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6822 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.142032+0000", 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.032953591999999997, 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033433932999999999, 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6822 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142032+0000", 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142032+0000", 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142033+0000", 2024-09-14T08:41:00.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8800000000000002e-07 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142040+0000", 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0180000000000004e-06 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142046+0000", 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000003e-06 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142051+0000", 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2549999999999997e-06 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6933 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155039+0000", 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019946620000000002, 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020475216000000001, 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.254 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6933 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155039+0000", 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155039+0000", 2024-09-14T08:41:00.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155040+0000", 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0100000000000005e-07 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155042+0000", 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.871e-06 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155055+0000", 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3475000000000001e-05 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155060+0000", 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9860000000000002e-06 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6965 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.156908+0000", 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018077612999999999, 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018657171, 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6965 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156908+0000", 2024-09-14T08:41:00.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156908+0000", 2024-09-14T08:41:00.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156909+0000", 2024-09-14T08:41:00.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1999999999999998e-07 2024-09-14T08:41:00.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156920+0000", 2024-09-14T08:41:00.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:41:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156933+0000", 2024-09-14T08:41:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2672e-05 2024-09-14T08:41:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156941+0000", 2024-09-14T08:41:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6707 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.140569+0000", 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034416725000000002, 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035047785999999997, 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6707 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140569+0000", 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140569+0000", 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140570+0000", 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2199999999999999e-07 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140572+0000", 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2790000000000001e-06 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140578+0000", 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.156e-06 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140583+0000", 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5680000000000001e-06 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6791 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141316+0000", 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033670019000000002, 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034351855000000001, 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6791 2024-09-14T08:41:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141316+0000", 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141316+0000", 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141316+0000", 2024-09-14T08:41:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5400000000000001e-07 2024-09-14T08:41:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141318+0000", 2024-09-14T08:41:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.823e-06 2024-09-14T08:41:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141324+0000", 2024-09-14T08:41:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:41:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141328+0000", 2024-09-14T08:41:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5299999999999998e-06 2024-09-14T08:41:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6823 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.142058+0000", 2024-09-14T08:41:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.032927708, 2024-09-14T08:41:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033659755, 2024-09-14T08:41:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6823 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142058+0000", 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142058+0000", 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142059+0000", 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3799999999999998e-07 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142061+0000", 2024-09-14T08:41:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1019999999999999e-06 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142067+0000", 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1820000000000003e-06 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142071+0000", 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6319999999999999e-06 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6890 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.147015+0000", 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027970980999999999, 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.028755928, 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6890 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147015+0000", 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147015+0000", 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147015+0000", 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4700000000000001e-07 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147018+0000", 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1440000000000001e-06 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147023+0000", 2024-09-14T08:41:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8830000000000003e-06 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147028+0000", 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6670000000000004e-06 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6934 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155067+0000", 2024-09-14T08:41:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.01991894, 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020730102, 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6934 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155067+0000", 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155067+0000", 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155067+0000", 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1199999999999998e-07 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155069+0000", 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0320000000000002e-06 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155076+0000", 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1539999999999996e-06 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155081+0000", 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.301e-06 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6966 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.156970+0000", 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.018015452000000001, 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018851281000000001, 2024-09-14T08:41:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6966 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156970+0000", 2024-09-14T08:41:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156970+0000", 2024-09-14T08:41:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156971+0000", 2024-09-14T08:41:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:41:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156974+0000", 2024-09-14T08:41:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9890000000000001e-06 2024-09-14T08:41:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156983+0000", 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1419999999999999e-06 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156989+0000", 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9859999999999999e-06 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6708 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.140589+0000", 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.034396402, 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035256991000000001, 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6708 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140589+0000", 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140589+0000", 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140590+0000", 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4099999999999999e-07 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140592+0000", 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9309999999999998e-06 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140597+0000", 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6740000000000002e-06 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140604+0000", 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.229e-06 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6792 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141335+0000", 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033650643000000001, 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034535732999999999, 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6792 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141335+0000", 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141335+0000", 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141336+0000", 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141338+0000", 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0810000000000001e-06 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141344+0000", 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9939999999999997e-06 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141348+0000", 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7129999999999996e-06 2024-09-14T08:41:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6824 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.142078+0000", 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.032907600000000002, 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.033818953999999998, 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6824 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142078+0000", 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142078+0000", 2024-09-14T08:41:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142079+0000", 2024-09-14T08:41:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142081+0000", 2024-09-14T08:41:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9769999999999999e-06 2024-09-14T08:41:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142087+0000", 2024-09-14T08:41:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9259999999999997e-06 2024-09-14T08:41:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142091+0000", 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8389999999999997e-06 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6892 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.147035+0000", 2024-09-14T08:41:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027951064000000001, 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.028886887, 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6892 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147035+0000", 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147035+0000", 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147035+0000", 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1200000000000002e-07 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147038+0000", 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0810000000000001e-06 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147044+0000", 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.241e-06 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147049+0000", 2024-09-14T08:41:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8709999999999996e-06 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6935 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155087+0000", 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019898639999999999, 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020859035000000001, 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6935 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155087+0000", 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155087+0000", 2024-09-14T08:41:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155088+0000", 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9900000000000001e-07 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155089+0000", 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9089999999999998e-06 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155095+0000", 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155099+0000", 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2649999999999998e-06 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6967 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.156998+0000", 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017987412000000001, 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018976481, 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6967 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156998+0000", 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156998+0000", 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.156999+0000", 2024-09-14T08:41:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1299999999999999e-07 2024-09-14T08:41:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157002+0000", 2024-09-14T08:41:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3870000000000002e-06 2024-09-14T08:41:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157008+0000", 2024-09-14T08:41:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.764e-06 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157014+0000", 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3310000000000003e-06 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6710 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.140610+0000", 2024-09-14T08:41:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.03437544, 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035410275999999997, 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6710 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140610+0000", 2024-09-14T08:41:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140610+0000", 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140611+0000", 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1699999999999999e-07 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140613+0000", 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9700000000000002e-06 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140619+0000", 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4189999999999999e-06 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.140624+0000", 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7090000000000001e-06 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6793 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141354+0000", 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033631332, 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034716476000000003, 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6793 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141354+0000", 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141354+0000", 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141355+0000", 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4199999999999995e-07 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141357+0000", 2024-09-14T08:41:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8169999999999999e-06 2024-09-14T08:41:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141362+0000", 2024-09-14T08:41:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5339999999999999e-06 2024-09-14T08:41:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141367+0000", 2024-09-14T08:41:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5310000000000003e-06 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6825 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.142098+0000", 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.032888076000000002, 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034066085000000003, 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6825 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142098+0000", 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142098+0000", 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142098+0000", 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6199999999999997e-07 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142100+0000", 2024-09-14T08:41:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142107+0000", 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0219999999999999e-06 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142112+0000", 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9520000000000002e-06 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6904 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.147055+0000", 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027930644000000001, 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029160062, 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6904 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147055+0000", 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147055+0000", 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147056+0000", 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1800000000000001e-07 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147058+0000", 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9879999999999999e-06 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147063+0000", 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8259999999999998e-06 2024-09-14T08:41:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147068+0000", 2024-09-14T08:41:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3460000000000004e-06 2024-09-14T08:41:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6936 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155104+0000", 2024-09-14T08:41:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019881401999999999, 2024-09-14T08:41:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021144894000000001, 2024-09-14T08:41:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6936 2024-09-14T08:41:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155104+0000", 2024-09-14T08:41:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155104+0000", 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155105+0000", 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7599999999999998e-07 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155107+0000", 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.894e-06 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155114+0000", 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8279999999999997e-06 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155118+0000", 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:41:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6968 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.157021+0000", 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017964989000000001, 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019253585, 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6968 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157021+0000", 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157021+0000", 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157021+0000", 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4199999999999996e-07 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157024+0000", 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.311e-06 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157030+0000", 2024-09-14T08:41:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.212e-06 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157035+0000", 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0289999999999996e-06 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6794 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141373+0000", 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033612664, 2024-09-14T08:41:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034926393999999999, 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6794 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141373+0000", 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141373+0000", 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141374+0000", 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8500000000000002e-07 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141376+0000", 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0059999999999999e-06 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141382+0000", 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2940000000000002e-06 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141387+0000", 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9180000000000002e-06 2024-09-14T08:41:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6826 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.142128+0000", 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.032858052999999998, 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034198316999999999, 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6826 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142128+0000", 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142128+0000", 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142128+0000", 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142130+0000", 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1770000000000001e-06 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142137+0000", 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7179999999999999e-06 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142142+0000", 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7119999999999999e-06 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6905 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.147075+0000", 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027910873999999999, 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029275967999999999, 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6905 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147075+0000", 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147075+0000", 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147075+0000", 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.46e-07 2024-09-14T08:41:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147082+0000", 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8959999999999997e-06 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147088+0000", 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.117e-06 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147093+0000", 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9030000000000003e-06 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6937 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155149+0000", 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019836647999999998, 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021228240999999998, 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6937 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155149+0000", 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155149+0000", 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155150+0000", 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3000000000000001e-07 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155152+0000", 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.182e-06 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155158+0000", 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3659999999999997e-06 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155163+0000", 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7249999999999997e-06 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6969 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.157043+0000", 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017943092000000001, 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019359204000000001, 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6969 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157043+0000", 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157043+0000", 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157043+0000", 2024-09-14T08:41:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4999999999999998e-07 2024-09-14T08:41:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157046+0000", 2024-09-14T08:41:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4030000000000001e-06 2024-09-14T08:41:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157052+0000", 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6100000000000002e-06 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157058+0000", 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1680000000000001e-06 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6795 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141393+0000", 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033592384000000003, 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035036276999999998, 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6795 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141393+0000", 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141393+0000", 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141394+0000", 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5899999999999996e-07 2024-09-14T08:41:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141396+0000", 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0480000000000001e-06 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141402+0000", 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7649999999999999e-06 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141406+0000", 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5530000000000003e-06 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6827 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.142149+0000", 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.032836387000000002, 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034304939999999999, 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6827 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142149+0000", 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142149+0000", 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142150+0000", 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4600000000000005e-07 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142152+0000", 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.385e-06 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142159+0000", 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3319999999999997e-06 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142164+0000", 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0270000000000003e-06 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6906 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.147100+0000", 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027886013000000001, 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029400285000000002, 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6906 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147100+0000", 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147100+0000", 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147100+0000", 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1100000000000001e-07 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147102+0000", 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.902e-06 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147109+0000", 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9120000000000001e-06 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147114+0000", 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6938 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155170+0000", 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019816107999999999, 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021380321000000001, 2024-09-14T08:41:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6938 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155170+0000", 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155170+0000", 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155170+0000", 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0999999999999999e-07 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155172+0000", 2024-09-14T08:41:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.855e-06 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155178+0000", 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7490000000000004e-06 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155182+0000", 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5589999999999999e-06 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6970 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.157066+0000", 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017920116999999999, 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019538605000000001, 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6970 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157066+0000", 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157066+0000", 2024-09-14T08:41:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157066+0000", 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.96e-07 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157068+0000", 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2029999999999999e-06 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157074+0000", 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8340000000000004e-06 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157079+0000", 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6796 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141412+0000", 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033573629000000001, 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035242621000000002, 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6796 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141412+0000", 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141412+0000", 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141413+0000", 2024-09-14T08:41:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8599999999999999e-07 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141414+0000", 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.874e-06 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141420+0000", 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6489999999999996e-06 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141426+0000", 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3119999999999999e-06 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6828 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.142171+0000", 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.032814960999999997, 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034536878999999999, 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6828 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142171+0000", 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142171+0000", 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142171+0000", 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6699999999999999e-07 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142173+0000", 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8959999999999999e-06 2024-09-14T08:41:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142179+0000", 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9240000000000004e-06 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142184+0000", 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0209999999999999e-06 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6907 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.147121+0000", 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027864585000000001, 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029614437, 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6907 2024-09-14T08:41:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147121+0000", 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147121+0000", 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147122+0000", 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147124+0000", 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0490000000000002e-06 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147130+0000", 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9179999999999999e-06 2024-09-14T08:41:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147135+0000", 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.356e-06 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6939 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155189+0000", 2024-09-14T08:41:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019796672000000001, 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021573434999999998, 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6939 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155189+0000", 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155189+0000", 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155190+0000", 2024-09-14T08:41:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1800000000000001e-07 2024-09-14T08:41:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155192+0000", 2024-09-14T08:41:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2000000000000001e-06 2024-09-14T08:41:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155198+0000", 2024-09-14T08:41:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155203+0000", 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0860000000000001e-06 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6972 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.157086+0000", 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017899829999999999, 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019701356999999999, 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6972 2024-09-14T08:41:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157086+0000", 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157086+0000", 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157086+0000", 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3099999999999998e-07 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157089+0000", 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3309999999999998e-06 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157095+0000", 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0870000000000003e-06 2024-09-14T08:41:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157100+0000", 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9749999999999998e-06 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6797 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141433+0000", 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033552477999999997, 2024-09-14T08:41:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035380170000000002, 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6797 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141433+0000", 2024-09-14T08:41:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141433+0000", 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141434+0000", 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141436+0000", 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1040000000000001e-06 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141442+0000", 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8730000000000004e-06 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141447+0000", 2024-09-14T08:41:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.724e-06 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6829 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.142191+0000", 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.032795207, 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.03464805, 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6829 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142191+0000", 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142191+0000", 2024-09-14T08:41:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142191+0000", 2024-09-14T08:41:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3200000000000005e-07 2024-09-14T08:41:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142193+0000", 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2259999999999999e-06 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142199+0000", 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9909999999999999e-06 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142204+0000", 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0250000000000002e-06 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6908 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.147141+0000", 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.027844447000000001, 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.029722642000000001, 2024-09-14T08:41:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6908 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147141+0000", 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.147141+0000", 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154371+0000", 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0072293110000000004 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154378+0000", 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7370000000000006e-06 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154395+0000", 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6843000000000001e-05 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154412+0000", 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6852999999999999e-05 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6940 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155209+0000", 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019776872000000001, 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021682690000000001, 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6940 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155209+0000", 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155209+0000", 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155209+0000", 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155211+0000", 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.871e-06 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155217+0000", 2024-09-14T08:41:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0669999999999997e-06 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155222+0000", 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7570000000000004e-06 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6973 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.157106+0000", 2024-09-14T08:41:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.01787973, 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019810153, 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6973 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157106+0000", 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157106+0000", 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157107+0000", 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1899999999999998e-07 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157109+0000", 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2309999999999999e-06 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157115+0000", 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157120+0000", 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1340000000000003e-06 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6798 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141477+0000", 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033509246999999999, 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035465864, 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6798 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141477+0000", 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141477+0000", 2024-09-14T08:41:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141477+0000", 2024-09-14T08:41:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.99e-07 2024-09-14T08:41:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141480+0000", 2024-09-14T08:41:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5019999999999999e-06 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141487+0000", 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8340000000000001e-06 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141491+0000", 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.95e-06 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6830 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.142211+0000", 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.032774886000000003, 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.034772562, 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6830 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142211+0000", 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.142211+0000", 2024-09-14T08:41:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146396+0000", 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.004185126 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146402+0000", 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6579999999999999e-06 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146414+0000", 2024-09-14T08:41:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1952e-05 2024-09-14T08:41:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146422+0000", 2024-09-14T08:41:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8900000000000007e-06 2024-09-14T08:41:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6909 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154431+0000", 2024-09-14T08:41:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020555316000000001, 2024-09-14T08:41:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022612482, 2024-09-14T08:41:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6909 2024-09-14T08:41:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154431+0000", 2024-09-14T08:41:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154431+0000", 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154431+0000", 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3900000000000004e-07 2024-09-14T08:41:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154434+0000", 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154444+0000", 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0253e-05 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154450+0000", 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9220000000000002e-06 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6941 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155228+0000", 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019757690000000001, 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021865992000000001, 2024-09-14T08:41:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6941 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155228+0000", 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155228+0000", 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155229+0000", 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1300000000000001e-07 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155235+0000", 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6100000000000002e-06 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155242+0000", 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7689999999999999e-06 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155247+0000", 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9869999999999999e-06 2024-09-14T08:41:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6974 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.157127+0000", 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.017859105, 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020020612, 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6974 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157127+0000", 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157127+0000", 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157127+0000", 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2800000000000002e-07 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157129+0000", 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.035e-06 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157144+0000", 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4851999999999999e-05 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.157168+0000", 2024-09-14T08:41:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3671000000000001e-05 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6799 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141503+0000", 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033482694, 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035694223999999997, 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6799 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141503+0000", 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141503+0000", 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141504+0000", 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.82e-07 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141506+0000", 2024-09-14T08:41:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2809999999999998e-06 2024-09-14T08:41:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141512+0000", 2024-09-14T08:41:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3509999999999998e-06 2024-09-14T08:41:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141517+0000", 2024-09-14T08:41:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9540000000000003e-06 2024-09-14T08:41:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6831 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146438+0000", 2024-09-14T08:41:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028547448, 2024-09-14T08:41:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030812262, 2024-09-14T08:41:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6831 2024-09-14T08:41:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146438+0000", 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146438+0000", 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146439+0000", 2024-09-14T08:41:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2099999999999996e-07 2024-09-14T08:41:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146442+0000", 2024-09-14T08:41:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0649999999999999e-06 2024-09-14T08:41:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146455+0000", 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3061000000000001e-05 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146461+0000", 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1369999999999999e-06 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6910 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154468+0000", 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020518231000000001, 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022834074999999999, 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6910 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154468+0000", 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154468+0000", 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154468+0000", 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2699999999999999e-07 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154471+0000", 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4569999999999999e-06 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154478+0000", 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0090000000000001e-06 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154483+0000", 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0180000000000001e-06 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6942 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155254+0000", 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019732054999999998, 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022102041999999999, 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6942 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155254+0000", 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155254+0000", 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155254+0000", 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6100000000000001e-07 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155256+0000", 2024-09-14T08:41:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0049999999999999e-06 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155262+0000", 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9440000000000002e-06 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155267+0000", 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8040000000000001e-06 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6800 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141525+0000", 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033461291999999997, 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.035883669, 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6800 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141525+0000", 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141525+0000", 2024-09-14T08:41:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141525+0000", 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2199999999999999e-07 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141527+0000", 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9740000000000001e-06 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141533+0000", 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3080000000000004e-06 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141538+0000", 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7350000000000004e-06 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6832 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146472+0000", 2024-09-14T08:41:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028513790000000001, 2024-09-14T08:41:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.03106122, 2024-09-14T08:41:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6832 2024-09-14T08:41:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146472+0000", 2024-09-14T08:41:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146472+0000", 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146473+0000", 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0299999999999999e-07 2024-09-14T08:41:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146475+0000", 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6070000000000002e-06 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146482+0000", 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5030000000000002e-06 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146487+0000", 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6911 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154490+0000", 2024-09-14T08:41:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020496204000000001, 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023097620999999999, 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6911 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154490+0000", 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154490+0000", 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154490+0000", 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1600000000000002e-07 2024-09-14T08:41:00.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154492+0000", 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1260000000000001e-06 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154498+0000", 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1809999999999998e-06 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154508+0000", 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4569999999999994e-06 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6943 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155273+0000", 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019712699, 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022364558, 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.455 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6943 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155273+0000", 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155273+0000", 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155274+0000", 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1699999999999999e-07 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155276+0000", 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9589999999999998e-06 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155282+0000", 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0329999999999997e-06 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155286+0000", 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9339999999999997e-06 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6801 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141545+0000", 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033441048000000001, 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036146272, 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6801 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141545+0000", 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141545+0000", 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141545+0000", 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141547+0000", 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1770000000000001e-06 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141553+0000", 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9920000000000004e-06 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141558+0000", 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8690000000000003e-06 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6833 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146495+0000", 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028490864000000001, 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031222757, 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.462 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6833 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146495+0000", 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146495+0000", 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146495+0000", 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.34e-07 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146498+0000", 2024-09-14T08:41:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3029999999999998e-06 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146504+0000", 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3040000000000001e-06 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146509+0000", 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.465 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6912 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154515+0000", 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020470530000000001, 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023230201999999998, 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6912 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154515+0000", 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154515+0000", 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154516+0000", 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4499999999999997e-07 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154518+0000", 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.306e-06 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154524+0000", 2024-09-14T08:41:00.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0510000000000002e-06 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154529+0000", 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-06 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6944 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155292+0000", 2024-09-14T08:41:00.469 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019693525, 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022478129999999999, 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6944 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155292+0000", 2024-09-14T08:41:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155292+0000", 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155293+0000", 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9200000000000002e-07 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155295+0000", 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9750000000000001e-06 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155300+0000", 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3680000000000001e-06 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155304+0000", 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4100000000000001e-06 2024-09-14T08:41:00.472 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6802 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141565+0000", 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033420800000000001, 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036231562000000002, 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6802 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141565+0000", 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141565+0000", 2024-09-14T08:41:00.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141565+0000", 2024-09-14T08:41:00.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4099999999999999e-07 2024-09-14T08:41:00.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141568+0000", 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1019999999999999e-06 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141576+0000", 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5029999999999997e-06 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141581+0000", 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.147e-06 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6834 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146516+0000", 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028469607000000001, 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031306274000000002, 2024-09-14T08:41:00.477 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6834 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146516+0000", 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146516+0000", 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146517+0000", 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1300000000000001e-07 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146524+0000", 2024-09-14T08:41:00.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7360000000000001e-06 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146531+0000", 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.596e-06 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146536+0000", 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1499999999999998e-06 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.480 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6913 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154535+0000", 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020450792999999998, 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023313855000000001, 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6913 2024-09-14T08:41:00.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154535+0000", 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154535+0000", 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154535+0000", 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2199999999999999e-07 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154538+0000", 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4049999999999998e-06 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154544+0000", 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7769999999999999e-06 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154550+0000", 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5180000000000001e-06 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6945 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155311+0000", 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019674799999999999, 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022562316999999998, 2024-09-14T08:41:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6945 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155311+0000", 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155311+0000", 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155311+0000", 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3700000000000001e-07 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155314+0000", 2024-09-14T08:41:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1150000000000001e-06 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155320+0000", 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.976e-06 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155324+0000", 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8040000000000001e-06 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6803 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141588+0000", 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033398005000000001, 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036311504000000001, 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6803 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141588+0000", 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141588+0000", 2024-09-14T08:41:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141588+0000", 2024-09-14T08:41:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0800000000000004e-07 2024-09-14T08:41:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141590+0000", 2024-09-14T08:41:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0209999999999998e-06 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141596+0000", 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.801e-06 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141601+0000", 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9130000000000002e-06 2024-09-14T08:41:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6835 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146544+0000", 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028441846, 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031384056, 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6835 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146544+0000", 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146544+0000", 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146544+0000", 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146547+0000", 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.492e-06 2024-09-14T08:41:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146553+0000", 2024-09-14T08:41:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4649999999999999e-06 2024-09-14T08:41:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146558+0000", 2024-09-14T08:41:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.843e-06 2024-09-14T08:41:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6914 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154558+0000", 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020427923000000001, 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023417352999999998, 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6914 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154558+0000", 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154558+0000", 2024-09-14T08:41:00.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154558+0000", 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3799999999999998e-07 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154560+0000", 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9379999999999999e-06 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154566+0000", 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4489999999999998e-06 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154570+0000", 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3449999999999999e-06 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.499 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6946 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155334+0000", 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019652320000000001, 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022693683999999999, 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6946 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155334+0000", 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155334+0000", 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155334+0000", 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8100000000000002e-07 2024-09-14T08:41:00.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155336+0000", 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2199999999999999e-06 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155345+0000", 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5569999999999996e-06 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155350+0000", 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0350000000000001e-06 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6804 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141608+0000", 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033377719, 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036474624999999997, 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.503 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6804 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141608+0000", 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141608+0000", 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141609+0000", 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0699999999999998e-07 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141611+0000", 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0949999999999998e-06 2024-09-14T08:41:00.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141617+0000", 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5560000000000004e-06 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141622+0000", 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7380000000000002e-06 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6836 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146565+0000", 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028420864000000001, 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031568406, 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6836 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.507 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146565+0000", 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146565+0000", 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146565+0000", 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.08e-07 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146567+0000", 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8589999999999999e-06 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146573+0000", 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146578+0000", 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9799999999999998e-06 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6915 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154577+0000", 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020409006, 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023601607, 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.510 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6915 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154577+0000", 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154577+0000", 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154577+0000", 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3300000000000003e-07 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154579+0000", 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2060000000000001e-06 2024-09-14T08:41:00.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154586+0000", 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1619999999999996e-06 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154593+0000", 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4109999999999999e-06 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6947 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155370+0000", 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019616267, 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022834837, 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6947 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.514 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155370+0000", 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155370+0000", 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155370+0000", 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4400000000000001e-07 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155372+0000", 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1509999999999998e-06 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155379+0000", 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7880000000000001e-06 2024-09-14T08:41:00.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155384+0000", 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000003e-06 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6805 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141628+0000", 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033357431999999999, 2024-09-14T08:41:00.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036600944000000003, 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6805 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141628+0000", 2024-09-14T08:41:00.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141628+0000", 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141629+0000", 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1699999999999999e-07 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141631+0000", 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1849999999999998e-06 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141646+0000", 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5211999999999999e-05 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141651+0000", 2024-09-14T08:41:00.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.203e-06 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6837 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146585+0000", 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028400482000000001, 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031670337, 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.521 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6837 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146585+0000", 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146585+0000", 2024-09-14T08:41:00.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146586+0000", 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2e-07 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146588+0000", 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3360000000000002e-06 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146594+0000", 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2489999999999998e-06 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146600+0000", 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2530000000000004e-06 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6916 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.524 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154600+0000", 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020385667999999999, 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023680443999999998, 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6916 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154600+0000", 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154600+0000", 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154601+0000", 2024-09-14T08:41:00.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2199999999999999e-07 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154603+0000", 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1280000000000002e-06 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154609+0000", 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154615+0000", 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2620000000000004e-06 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6948 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155391+0000", 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019594871999999999, 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.022916268, 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.528 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6948 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155391+0000", 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155391+0000", 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155392+0000", 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0399999999999996e-07 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155394+0000", 2024-09-14T08:41:00.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.058e-06 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155400+0000", 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2809999999999997e-06 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155405+0000", 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.78e-06 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.531 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6806 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141659+0000", 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033326532999999998, 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036685772999999998, 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.532 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6806 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141659+0000", 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141659+0000", 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141660+0000", 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7899999999999998e-07 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141662+0000", 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4849999999999999e-06 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141672+0000", 2024-09-14T08:41:00.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0729999999999994e-06 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141677+0000", 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1290000000000004e-06 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6838 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146606+0000", 2024-09-14T08:41:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028379672000000002, 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031767015000000003, 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6838 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146606+0000", 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146606+0000", 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146607+0000", 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0200000000000003e-07 2024-09-14T08:41:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146609+0000", 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9870000000000002e-06 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146615+0000", 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839999999999998e-06 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146621+0000", 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6279999999999999e-06 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6917 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154621+0000", 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020364507, 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023776466, 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6917 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154621+0000", 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154621+0000", 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154622+0000", 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2800000000000002e-07 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154630+0000", 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6319999999999997e-06 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154644+0000", 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3298e-05 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154649+0000", 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1950000000000002e-06 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.542 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6949 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155411+0000", 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019574568000000001, 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023028824999999999, 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6949 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155411+0000", 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155411+0000", 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155412+0000", 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2300000000000002e-07 2024-09-14T08:41:00.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155414+0000", 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.916e-06 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155420+0000", 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0669999999999997e-06 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155424+0000", 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6770000000000003e-06 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6807 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141683+0000", 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033302391000000001, 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036807157, 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.546 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6807 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141683+0000", 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141683+0000", 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141684+0000", 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141686+0000", 2024-09-14T08:41:00.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:41:00.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141692+0000", 2024-09-14T08:41:00.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1009999999999997e-06 2024-09-14T08:41:00.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141697+0000", 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3279999999999996e-06 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6839 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146654+0000", 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028331709, 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031890295999999999, 2024-09-14T08:41:00.550 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6839 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146654+0000", 2024-09-14T08:41:00.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146654+0000", 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146655+0000", 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2399999999999998e-07 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146657+0000", 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6400000000000001e-06 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146664+0000", 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9290000000000001e-06 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146670+0000", 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0750000000000003e-06 2024-09-14T08:41:00.553 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6918 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154665+0000", 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020320451, 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023929145999999998, 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6918 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154665+0000", 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154665+0000", 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154666+0000", 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4999999999999998e-07 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154668+0000", 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2189999999999998e-06 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154675+0000", 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9210000000000003e-06 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154680+0000", 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1869999999999996e-06 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6950 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155431+0000", 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019555273000000001, 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023217852000000001, 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6950 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.558 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155431+0000", 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155431+0000", 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155431+0000", 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3500000000000002e-07 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155433+0000", 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8419999999999999e-06 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155439+0000", 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9359999999999996e-06 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155444+0000", 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0590000000000002e-06 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6808 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141704+0000", 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033281782000000003, 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.036977677, 2024-09-14T08:41:00.561 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6808 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141704+0000", 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141704+0000", 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141705+0000", 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5799999999999999e-07 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141707+0000", 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2239999999999998e-06 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141713+0000", 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.015e-06 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141718+0000", 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9080000000000003e-06 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6840 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146679+0000", 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028307169, 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032030337999999998, 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6840 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146679+0000", 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146679+0000", 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146679+0000", 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9400000000000005e-07 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146681+0000", 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2359999999999999e-06 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146688+0000", 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.331e-06 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146693+0000", 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0409999999999997e-06 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6919 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154688+0000", 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020298317999999999, 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024046194, 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6919 2024-09-14T08:41:00.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154688+0000", 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154688+0000", 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154688+0000", 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5799999999999999e-07 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154690+0000", 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1050000000000002e-06 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154696+0000", 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154701+0000", 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7779999999999998e-06 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6951 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155450+0000", 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019535586000000001, 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023309460000000001, 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.572 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6951 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155450+0000", 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155450+0000", 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155451+0000", 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2100000000000002e-07 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155453+0000", 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9439999999999999e-06 2024-09-14T08:41:00.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155459+0000", 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0190000000000003e-06 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155463+0000", 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6809999999999997e-06 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6809 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141724+0000", 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033261682000000001, 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037060168999999997, 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6809 2024-09-14T08:41:00.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141724+0000", 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141724+0000", 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141725+0000", 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3300000000000003e-07 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141727+0000", 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9970000000000001e-06 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141733+0000", 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9569999999999999e-06 2024-09-14T08:41:00.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141737+0000", 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8149999999999996e-06 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6841 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146700+0000", 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028285536, 2024-09-14T08:41:00.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032110102000000001, 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6841 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146700+0000", 2024-09-14T08:41:00.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146700+0000", 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146701+0000", 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000002e-07 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146703+0000", 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2879999999999999e-06 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146709+0000", 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2380000000000002e-06 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146716+0000", 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5440000000000004e-06 2024-09-14T08:41:00.582 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6920 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154707+0000", 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020278744000000001, 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024127637, 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.583 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6920 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154707+0000", 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154707+0000", 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154707+0000", 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154709+0000", 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0040000000000002e-06 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154715+0000", 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.66e-06 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154720+0000", 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6530000000000002e-06 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6952 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155470+0000", 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019516114000000001, 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023389547, 2024-09-14T08:41:00.586 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.587 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.587 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.587 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6952 2024-09-14T08:41:00.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.587 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155470+0000", 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155470+0000", 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155470+0000", 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2800000000000002e-07 2024-09-14T08:41:00.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155472+0000", 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9120000000000001e-06 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155479+0000", 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.81e-06 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155484+0000", 2024-09-14T08:41:00.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6810 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141744+0000", 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033241651999999997, 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037141367000000002, 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.590 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6810 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141744+0000", 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141744+0000", 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141745+0000", 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0999999999999999e-07 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141751+0000", 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.781e-06 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141758+0000", 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-14T08:41:00.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141763+0000", 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7439999999999998e-06 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6842 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146722+0000", 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028263383, 2024-09-14T08:41:00.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032201791, 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6842 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146722+0000", 2024-09-14T08:41:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146722+0000", 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146723+0000", 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146725+0000", 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1959999999999998e-06 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146731+0000", 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9959999999999999e-06 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146736+0000", 2024-09-14T08:41:00.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.617e-06 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6921 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154726+0000", 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020260174999999998, 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024251865000000001, 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.597 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6921 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154726+0000", 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154726+0000", 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154726+0000", 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.77e-07 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154728+0000", 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8300000000000001e-06 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154734+0000", 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8409999999999996e-06 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154739+0000", 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.66e-06 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6953 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155491+0000", 2024-09-14T08:41:00.600 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019495232000000001, 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023537766000000002, 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6953 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155491+0000", 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155491+0000", 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155491+0000", 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.63e-07 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155497+0000", 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.409e-06 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155504+0000", 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7619999999999998e-06 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155509+0000", 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1370000000000001e-06 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6811 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141770+0000", 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033215980999999999, 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.03731425, 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6811 2024-09-14T08:41:00.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141770+0000", 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141770+0000", 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141770+0000", 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6699999999999999e-07 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141772+0000", 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.086e-06 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141778+0000", 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9120000000000003e-06 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141783+0000", 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7960000000000003e-06 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6843 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.146742+0000", 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.028243362000000001, 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032391604999999997, 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.607 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6843 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146742+0000", 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146742+0000", 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146743+0000", 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146745+0000", 2024-09-14T08:41:00.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.035e-06 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146751+0000", 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0209999999999996e-06 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.146756+0000", 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9049999999999996e-06 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6922 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154747+0000", 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020239126999999999, 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024420051000000002, 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6922 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.611 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154747+0000", 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154747+0000", 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154747+0000", 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2199999999999999e-07 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154749+0000", 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9889999999999999e-06 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154755+0000", 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2659999999999998e-06 2024-09-14T08:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154760+0000", 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0390000000000004e-06 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6954 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155517+0000", 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019469172, 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023675481000000002, 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6954 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155517+0000", 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155517+0000", 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155517+0000", 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3500000000000002e-07 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155519+0000", 2024-09-14T08:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0619999999999999e-06 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155526+0000", 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.421e-06 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155531+0000", 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9899999999999997e-06 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.617 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.618 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6812 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.619 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141804+0000", 2024-09-14T08:41:00.619 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033181429999999998, 2024-09-14T08:41:00.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037414254000000001, 2024-09-14T08:41:00.619 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6812 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141804+0000", 2024-09-14T08:41:00.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141804+0000", 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141805+0000", 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3799999999999997e-07 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141807+0000", 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2819999999999999e-06 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141814+0000", 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141819+0000", 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2079999999999999e-06 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.622 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6923 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154767+0000", 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020218627999999999, 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024476547000000001, 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6923 2024-09-14T08:41:00.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154767+0000", 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154767+0000", 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154768+0000", 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9299999999999999e-07 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154770+0000", 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9989999999999998e-06 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154776+0000", 2024-09-14T08:41:00.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4629999999999998e-06 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154781+0000", 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7550000000000002e-06 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6955 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155537+0000", 2024-09-14T08:41:00.626 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019449086000000001, 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023733052000000001, 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6955 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155537+0000", 2024-09-14T08:41:00.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155537+0000", 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155537+0000", 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155539+0000", 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9369999999999998e-06 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155547+0000", 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.554e-06 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155551+0000", 2024-09-14T08:41:00.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5349999999999998e-06 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6813 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141827+0000", 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033159090000000002, 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037467845, 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6813 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141827+0000", 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141827+0000", 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141827+0000", 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5199999999999997e-07 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141829+0000", 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1859999999999999e-06 2024-09-14T08:41:00.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141836+0000", 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3450000000000002e-06 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141841+0000", 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0699999999999997e-06 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.633 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6924 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154788+0000", 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020198018000000002, 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024532686000000001, 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6924 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154788+0000", 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154788+0000", 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154788+0000", 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.15e-07 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154790+0000", 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0940000000000002e-06 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154797+0000", 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5060000000000001e-06 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154802+0000", 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9180000000000002e-06 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6956 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.637 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155567+0000", 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019418701, 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023777978000000002, 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6956 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155567+0000", 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155567+0000", 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155568+0000", 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7599999999999997e-07 2024-09-14T08:41:00.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155570+0000", 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2989999999999999e-06 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155576+0000", 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155581+0000", 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6770000000000003e-06 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6782 3.5 3:a056cab1:::rbd_data.10f1af94c1de.0000000000000004:16 [read 194560~2048 out=2048b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141114+0000", 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033871631999999999, 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038257997000000002, 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.641 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6782 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141114+0000", 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141114+0000", 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141115+0000", 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3200000000000005e-07 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141117+0000", 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0810000000000001e-06 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141123+0000", 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7939999999999999e-06 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141127+0000", 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5870000000000003e-06 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.179168+0000", 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038040818999999997 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.179265+0000", 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6593000000000002e-05 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.179372+0000", 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010759099999999999 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.645 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6814 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141848+0000", 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033138052000000001, 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037609108000000002, 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6814 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141848+0000", 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141848+0000", 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141848+0000", 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141850+0000", 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1830000000000001e-06 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141856+0000", 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0700000000000003e-06 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141862+0000", 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1420000000000001e-06 2024-09-14T08:41:00.648 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.649 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.649 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.649 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6925 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.649 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154808+0000", 2024-09-14T08:41:00.649 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020177401000000001, 2024-09-14T08:41:00.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024702465999999999, 2024-09-14T08:41:00.649 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6925 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154808+0000", 2024-09-14T08:41:00.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154808+0000", 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154809+0000", 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6600000000000002e-07 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154811+0000", 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.057e-06 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154817+0000", 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4409999999999998e-06 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154822+0000", 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0629999999999996e-06 2024-09-14T08:41:00.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6957 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155588+0000", 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019398246000000001, 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023972856000000001, 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6957 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155588+0000", 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155588+0000", 2024-09-14T08:41:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155588+0000", 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7899999999999998e-07 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155590+0000", 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.917e-06 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155596+0000", 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3690000000000003e-06 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155601+0000", 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4100000000000001e-06 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6815 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141868+0000", 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033117504999999998, 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037746692999999998, 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6815 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141868+0000", 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141868+0000", 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141869+0000", 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3700000000000001e-07 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141871+0000", 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9240000000000001e-06 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141877+0000", 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9309999999999996e-06 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141882+0000", 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9110000000000001e-06 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6926 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154830+0000", 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020156051000000001, 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024835731999999999, 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.660 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6926 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154830+0000", 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154830+0000", 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154830+0000", 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6800000000000001e-07 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154833+0000", 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.261e-06 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154844+0000", 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1503e-05 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154849+0000", 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3449999999999996e-06 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.663 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6958 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155607+0000", 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019379231, 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024110903999999999, 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.664 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6958 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155607+0000", 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155607+0000", 2024-09-14T08:41:00.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155607+0000", 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9799999999999999e-07 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155609+0000", 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7010000000000001e-06 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155615+0000", 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8560000000000003e-06 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155619+0000", 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5009999999999998e-06 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.667 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6784 3.5 3:a056cab1:::rbd_data.10f1af94c1de.0000000000000004:16 [read 239616~2048 out=2048b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141154+0000", 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033831399999999998, 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038620248000000003, 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6784 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141154+0000", 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141154+0000", 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141155+0000", 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7e-07 2024-09-14T08:41:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141157+0000", 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8989999999999999e-06 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141163+0000", 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.818e-06 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141167+0000", 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6439999999999999e-06 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.179616+0000", 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038448813999999998 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.179702+0000", 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5822000000000006e-05 2024-09-14T08:41:00.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6816 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141889+0000", 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033097173000000001, 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.037939420000000001, 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6816 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141889+0000", 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141889+0000", 2024-09-14T08:41:00.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141889+0000", 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2e-07 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141891+0000", 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9520000000000001e-06 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141898+0000", 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.255e-06 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141903+0000", 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9049999999999996e-06 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.675 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6927 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154873+0000", 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020113184999999999, 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024981564000000001, 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6927 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.676 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154873+0000", 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154873+0000", 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154873+0000", 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154876+0000", 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3369999999999998e-06 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154884+0000", 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0579999999999998e-06 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154891+0000", 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6599999999999995e-06 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6959 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155625+0000", 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019360945000000001, 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024255480999999999, 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.679 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6959 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155625+0000", 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155625+0000", 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155625+0000", 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8500000000000002e-07 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155627+0000", 2024-09-14T08:41:00.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5829999999999999e-06 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155632+0000", 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2650000000000004e-06 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155636+0000", 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3239999999999996e-06 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.682 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6785 3.5 3:a056cab1:::rbd_data.10f1af94c1de.0000000000000004:16 [read 262144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141174+0000", 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033811515, 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038740537999999998, 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.683 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6785 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141174+0000", 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141174+0000", 2024-09-14T08:41:00.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141175+0000", 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4400000000000001e-07 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141177+0000", 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.04e-06 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141183+0000", 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9970000000000004e-06 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141187+0000", 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4410000000000003e-06 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.179831+0000", 2024-09-14T08:41:00.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038643798 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6817 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141909+0000", 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033076370000000001, 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038042715999999997, 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.687 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6817 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141909+0000", 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141909+0000", 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141910+0000", 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6199999999999998e-07 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141912+0000", 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.885e-06 2024-09-14T08:41:00.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141918+0000", 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000003e-06 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141923+0000", 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.797e-06 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6928 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154906+0000", 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020079764999999999, 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025071183, 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6928 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.691 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154906+0000", 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154906+0000", 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154907+0000", 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4300000000000003e-07 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154909+0000", 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1560000000000002e-06 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154915+0000", 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3249999999999996e-06 2024-09-14T08:41:00.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154925+0000", 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0195e-05 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6960 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155644+0000", 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019342226000000001, 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024358609, 2024-09-14T08:41:00.694 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6960 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155644+0000", 2024-09-14T08:41:00.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155644+0000", 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155644+0000", 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1899999999999998e-07 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155646+0000", 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.99e-06 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155652+0000", 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9279999999999998e-06 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155656+0000", 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5120000000000002e-06 2024-09-14T08:41:00.697 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6786 3.5 3:a056cab1:::rbd_data.10f1af94c1de.0000000000000004:16 [read 284672~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141206+0000", 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033779455999999999, 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038985346999999997, 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6786 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141206+0000", 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141206+0000", 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141207+0000", 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7599999999999997e-07 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141210+0000", 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8140000000000001e-06 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141217+0000", 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8329999999999996e-06 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141222+0000", 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0690000000000001e-06 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.180092+0000", 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038870246999999997 2024-09-14T08:41:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.180184+0000", 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2163000000000005e-05 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6818 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.141929+0000", 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.033056336999999998, 2024-09-14T08:41:00.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.038328182000000002, 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6818 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141929+0000", 2024-09-14T08:41:00.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141929+0000", 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141930+0000", 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4999999999999998e-07 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141932+0000", 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4899999999999999e-06 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141940+0000", 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2339999999999997e-06 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.141945+0000", 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9350000000000002e-06 2024-09-14T08:41:00.705 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6929 3.5 3.8d536a05 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.154937+0000", 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.020048466000000001, 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025369504000000001, 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6929 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154937+0000", 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154937+0000", 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154938+0000", 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154946+0000", 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4009999999999997e-06 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154953+0000", 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2949999999999999e-06 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.154959+0000", 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:6961 3.d 3.72c0e12d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:00.155664+0000", 2024-09-14T08:41:00.709 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.019321811000000001, 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024669374000000001, 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6961 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:00.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155664+0000", 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155664+0000", 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155664+0000", 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7100000000000002e-07 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155667+0000", 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4109999999999999e-06 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155673+0000", 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7339999999999996e-06 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:00.155677+0000", 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3390000000000003e-06 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.712 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:00.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:00.713 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:00.713 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 140 2024-09-14T08:41:00.713 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:00.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:00.716 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:00.713+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:00.717 INFO:teuthology.orchestra.run.smithi188.stdout:2019 write 0xc65a600 thru 0xc66a5d6 (0xffd7 bytes) 2024-09-14T08:41:00.717 INFO:teuthology.orchestra.run.smithi188.stdout:2020 write 0xe866a00 thru 0xe86da81 (0x7082 bytes) 2024-09-14T08:41:00.717 INFO:teuthology.orchestra.run.smithi188.stdout:2021 write 0x81e5400 thru 0x81e7e0c (0x2a0d bytes) 2024-09-14T08:41:00.717 INFO:teuthology.orchestra.run.smithi188.stdout:2027 punch from 0xb9f0600 to 0xb9fb400, (0xae00 bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2028 write 0x6943400 thru 0x6946e76 (0x3a77 bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2030 trunc from 0xe86dc00 to 0xa8ae000 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2032 read 0x63c9600 thru 0x63ca0bd (0xabe bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2034 read 0x5437400 thru 0x543cdaf (0x59b0 bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2035 read 0x72bea00 thru 0x72cd3a9 (0xe9aa bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2036 punch from 0x84c6000 to 0x84c8800, (0x2800 bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2037 punch from 0x6a9ea00 to 0x6aa8600, (0x9c00 bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2038 read 0x149000 thru 0x14d5d5 (0x45d6 bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2039 punch from 0x33dfc00 to 0x33e3e00, (0x4200 bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2040 read 0x3bd8200 thru 0x3bd83f7 (0x1f8 bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2041 read 0x816c000 thru 0x81703d6 (0x43d7 bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2042 trunc from 0xa8ae000 to 0x4e57c00 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2043 punch from 0x1d92400 to 0x1da0000, (0xdc00 bytes) 2024-09-14T08:41:00.718 INFO:teuthology.orchestra.run.smithi188.stdout:2044 read 0x4097a00 thru 0x4098531 (0xb32 bytes) 2024-09-14T08:41:00.719 INFO:teuthology.orchestra.run.smithi188.stdout:2045 trunc from 0x4e57c00 to 0xb50c600 2024-09-14T08:41:00.719 INFO:teuthology.orchestra.run.smithi188.stdout:2048 write 0xcee7200 thru 0xcee7e10 (0xc11 bytes) 2024-09-14T08:41:00.719 INFO:teuthology.orchestra.run.smithi188.stdout:2052 trunc from 0xcee8000 to 0x75c6000 2024-09-14T08:41:00.719 INFO:teuthology.orchestra.run.smithi188.stdout:skipping zero length punch hole 2024-09-14T08:41:00.719 INFO:teuthology.orchestra.run.smithi188.stdout:2055 punch from 0x25b2000 to 0x25bee00, (0xce00 bytes) 2024-09-14T08:41:00.719 INFO:teuthology.orchestra.run.smithi188.stdout:2056 read 0xa56400 thru 0xa58f61 (0x2b62 bytes) 2024-09-14T08:41:00.719 INFO:teuthology.orchestra.run.smithi188.stdout:2057 punch from 0x6d06400 to 0x6d12a00, (0xc600 bytes) 2024-09-14T08:41:00.720 INFO:teuthology.orchestra.run.smithi188.stdout:2058 read 0x72df400 thru 0x72e737e (0x7f7f bytes) 2024-09-14T08:41:00.720 INFO:teuthology.orchestra.run.smithi188.stdout:2060 punch from 0x5e18000 to 0x5e20800, (0x8800 bytes) 2024-09-14T08:41:00.721 INFO:teuthology.orchestra.run.smithi188.stdout:2062 read 0x71eb800 thru 0x71ec5b9 (0xdba bytes) 2024-09-14T08:41:00.721 INFO:teuthology.orchestra.run.smithi188.stdout:2068 read 0x54e9c00 thru 0x54f5ee2 (0xc2e3 bytes) 2024-09-14T08:41:00.725 INFO:teuthology.orchestra.run.smithi188.stdout:2071 trunc from 0x75c6000 to 0x86dd800 2024-09-14T08:41:00.768 INFO:teuthology.orchestra.run.smithi188.stdout:2072 read 0x20c5600 thru 0x20cbd2e (0x672f bytes) 2024-09-14T08:41:00.769 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5] out_osds: [3] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:41:00.769 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:41:00.769 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-14T08:41:00.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T08:41:00.803 INFO:teuthology.orchestra.run.smithi188.stdout:2077 write 0xeb54800 thru 0xeb5a667 (0x5e68 bytes) 2024-09-14T08:41:00.803 INFO:teuthology.orchestra.run.smithi188.stdout:2079 write 0x2db2000 thru 0x2db9dd5 (0x7dd6 bytes) 2024-09-14T08:41:00.804 INFO:teuthology.orchestra.run.smithi188.stdout:2080 punch from 0x7cb5600 to 0x7cb9400, (0x3e00 bytes) 2024-09-14T08:41:00.805 INFO:teuthology.orchestra.run.smithi188.stdout:2083 read 0x9153e00 thru 0x915ace7 (0x6ee8 bytes) 2024-09-14T08:41:00.805 INFO:teuthology.orchestra.run.smithi188.stdout:2084 punch from 0xd29fa00 to 0xd2a1e00, (0x2400 bytes) 2024-09-14T08:41:00.806 INFO:teuthology.orchestra.run.smithi188.stdout:2085 punch from 0x647b400 to 0x6483800, (0x8400 bytes) 2024-09-14T08:41:00.806 INFO:teuthology.orchestra.run.smithi188.stdout:2086 write 0x6b97600 thru 0x6ba28df (0xb2e0 bytes) 2024-09-14T08:41:00.810 INFO:teuthology.orchestra.run.smithi188.stdout:2090 trunc from 0xeb5a800 to 0xdf41200 2024-09-14T08:41:00.847 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:00.849+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:00.893 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:00.894 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:00.894 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:00.894 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:00.894 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:00.909 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:00.916 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:00.915+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:00.961 INFO:teuthology.orchestra.run.smithi188.stdout:2092 trunc from 0xdf41200 to 0x508a00 2024-09-14T08:41:01.017 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:01.017+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:01.088 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:01.088 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.812114880999999, 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.089 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:41:01.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.812086084999997, 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.094 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:41:01.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.812057265999997, 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:01.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.812028937000001, 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.103 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:01.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.107 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811999737000001, 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.111 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811967729000003, 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:41:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811938453000003, 2024-09-14T08:41:01.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:01.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:41:01.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811908787, 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.121 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:01.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:41:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811880244000001, 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.126 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:01.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811851937999997, 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:41:01.130 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:41:01.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811806670999999, 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.135 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.139 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811775048999998, 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:41:01.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:41:01.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811717237000003, 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.144 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:41:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811649224, 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.149 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:41:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.153 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811613852000001, 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:41:01.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.811579453, 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.158 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:01.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:41:01.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:01.162 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.784508899999999, 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:01.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:01.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.522398720999998, 2024-09-14T08:41:01.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:01.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.174 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.52225155, 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:01.175 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:01.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.522109749999998, 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:01.181 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:01.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:01.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:01.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.189 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.189 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:01.191 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:41:01.192 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 91, 2024-09-14T08:41:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "57b092b7-5550-41a0-8f78-531de0e7c469", 2024-09-14T08:41:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-09-14T08:38:48.610112+0000", 2024-09-14T08:41:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-09-14T08:40:59.522582+0000", 2024-09-14T08:41:01.192 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-09-14T08:39:51.541202+0000", 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-09-14T08:40:39.381309+0000", 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5804032, 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "nodeep-scrub", 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:01.193 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 5, 2024-09-14T08:41:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T08:41:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T08:41:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T08:41:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-09-14T08:41:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 3, 2024-09-14T08:41:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 6, 2024-09-14T08:41:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-09-14T08:41:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "luminous", 2024-09-14T08:41:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-09-14T08:41:01.194 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:00.306403+0000", 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:41:01.195 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:41:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:41:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:41:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:41:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:41:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:41:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:41:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:41:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-09-14T08:41:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-09-14T08:41:01.196 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.197 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "15", 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:41:01.198 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:41:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:41:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:41:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:41:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:41:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:41:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:41:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:41:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:41:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:41:01.199 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:41:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:41:01.201 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 5.880000114440918, 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 5.880000114440918, 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.17000000178813934, 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1, 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1, 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:41:01.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:06.370159+0000", 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:41:01.203 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-09-14T08:41:01.204 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:41:01.205 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 2, 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 19, 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:41:01.206 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:41:01.207 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:41:01.208 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:41:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:41:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:41:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:41:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:41:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:41:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:41:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:41:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.9900000095367432, 2024-09-14T08:41:01.209 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.9900000095367432, 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.67000001668930054, 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-09-14T08:41:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "pool_client.0", 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:16.437713+0000", 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:41:01.211 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:41:01.212 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "90", 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 22, 2024-09-14T08:41:01.213 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 90, 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:41:01.214 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:41:01.215 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:41:01.216 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:41:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:41:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:41:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 1.8700000047683716, 2024-09-14T08:41:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 1.8700000047683716, 2024-09-14T08:41:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.67000001668930054, 2024-09-14T08:41:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.25, 2024-09-14T08:41:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.25, 2024-09-14T08:41:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:41:01.217 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d", 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 0, 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:41:01.218 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 41, 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6800", 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:41:01.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6801", 2024-09-14T08:41:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:41:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:01.220 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6802", 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6803", 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.221 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6806", 2024-09-14T08:41:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:41:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.222 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6807", 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6804", 2024-09-14T08:41:01.223 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:41:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6805", 2024-09-14T08:41:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2282442554 2024-09-14T08:41:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6801/2282442554", 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6803/2282442554", 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6807/2282442554", 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6805/2282442554", 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "exists" 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "09ba1390-a0d1-48a3-9342-5f5aa64e2217", 2024-09-14T08:41:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 80, 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6808", 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6809", 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.227 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6810", 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.228 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6811", 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6814", 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6815", 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6812", 2024-09-14T08:41:01.230 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6813", 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6809/2739597491", 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6811/2739597491", 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6815/2739597491", 2024-09-14T08:41:01.231 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6813/2739597491", 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "a7cd8610-d8e1-44e7-a423-4419cad90d8e", 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:41:01.232 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 80, 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.233 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6816", 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817", 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818", 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819", 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6822", 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6823", 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:01.236 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6820", 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.237 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6821", 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6817/1157205327", 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6819/1157205327", 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6823/1157205327", 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6821/1157205327", 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:01.238 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "1339fb05-5d1c-4c0a-8388-314119543bb6", 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 0, 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0, 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:41:01.239 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 79, 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6808", 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.240 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6809", 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6810", 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:01.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6811", 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.242 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6814", 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6815", 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:01.243 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6812", 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6813", 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.244 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6809/1656791341", 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6811/1656791341", 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6815/1656791341", 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6813/1656791341", 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.245 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "0cebba54-9019-47bd-870f-306664e390e1", 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 78, 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:41:01.246 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6816", 2024-09-14T08:41:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.247 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6817", 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6818", 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6819", 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.249 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6822", 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6823", 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:01.250 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6820", 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6821", 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6817/1186206237", 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6819/1186206237", 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6823/1186206237", 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6821/1186206237", 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.252 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "e571e73b-0e9d-417d-b01c-59b651016763", 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0.1356353759765625, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 78, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:01.253 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6800", 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6801", 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:01.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6802", 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.255 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6803", 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6806", 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:01.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6807", 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:01.257 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6804", 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6805", 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6801/796623465", 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6803/796623465", 2024-09-14T08:41:01.258 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6807/796623465", 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6805/796623465", 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:41:01.259 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.174731+0000", 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 41 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:01.260 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.475467+0000", 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.606174+0000", 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 65536, 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.835957+0000", 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:41:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.753547+0000", 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.284212+0000", 2024-09-14T08:41:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:41:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [ 2024-09-14T08:41:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:41:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:41:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: 0 2024-09-14T08:41:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.a", 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: 5 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [ 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:41:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 4, 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 0 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 5, 2024-09-14T08:41:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 2 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [ 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "1.0", 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:41:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "2.0", 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "2.5", 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: 4, 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.9", 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: 2 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.f", 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: 5, 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: 5 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.11", 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: 4, 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.12", 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: 1, 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.15", 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: 4, 2024-09-14T08:41:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.1f", 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: 3 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-09-14T08:41:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:01.277 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:01.277 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:01.189+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:01.280 INFO:tasks.thrashosds.thrasher:j is {'epoch': 91, 'fsid': '57b092b7-5550-41a0-8f78-531de0e7c469', 'created': '2024-09-14T08:38:48.610112+0000', 'modified': '2024-09-14T08:40:59.522582+0000', 'last_up_change': '2024-09-14T08:39:51.541202+0000', 'last_in_change': '2024-09-14T08:40:39.381309+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T08:39:00.306403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 5.880000114440918, 'score_stable': 5.880000114440918, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T08:39:06.370159+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T08:39:16.437713+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 22, 'snap_epoch': 90, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}], 'osds': [{'osd': 0, 'uuid': '2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 21, 'down_at': 41, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 2282442554}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 2282442554}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 2282442554}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 2282442554}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 2282442554}]}, 'public_addr': '172.21.15.89:6801/2282442554', 'cluster_addr': '172.21.15.89:6803/2282442554', 'heartbeat_back_addr': '172.21.15.89:6807/2282442554', 'heartbeat_front_addr': '172.21.15.89:6805/2282442554', 'state': ['exists']}, {'osd': 1, 'uuid': '09ba1390-a0d1-48a3-9342-5f5aa64e2217', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 80, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6808', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6809', 'nonce': 2739597491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6810', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6811', 'nonce': 2739597491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6814', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6815', 'nonce': 2739597491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6812', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6813', 'nonce': 2739597491}]}, 'public_addr': '172.21.15.89:6809/2739597491', 'cluster_addr': '172.21.15.89:6811/2739597491', 'heartbeat_back_addr': '172.21.15.89:6815/2739597491', 'heartbeat_front_addr': '172.21.15.89:6813/2739597491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a7cd8610-d8e1-44e7-a423-4419cad90d8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 80, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6816', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6817', 'nonce': 1157205327}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6818', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 1157205327}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6822', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6823', 'nonce': 1157205327}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6820', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6821', 'nonce': 1157205327}]}, 'public_addr': '172.21.15.89:6817/1157205327', 'cluster_addr': '172.21.15.89:6819/1157205327', 'heartbeat_back_addr': '172.21.15.89:6823/1157205327', 'heartbeat_front_addr': '172.21.15.89:6821/1157205327', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1339fb05-5d1c-4c0a-8388-314119543bb6', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 79, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6808', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6809', 'nonce': 1656791341}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6810', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6811', 'nonce': 1656791341}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6814', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6815', 'nonce': 1656791341}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6812', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6813', 'nonce': 1656791341}]}, 'public_addr': '172.21.15.112:6809/1656791341', 'cluster_addr': '172.21.15.112:6811/1656791341', 'heartbeat_back_addr': '172.21.15.112:6815/1656791341', 'heartbeat_front_addr': '172.21.15.112:6813/1656791341', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0cebba54-9019-47bd-870f-306664e390e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 78, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6816', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6817', 'nonce': 1186206237}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6818', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6819', 'nonce': 1186206237}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6822', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6823', 'nonce': 1186206237}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6820', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6821', 'nonce': 1186206237}]}, 'public_addr': '172.21.15.112:6817/1186206237', 'cluster_addr': '172.21.15.112:6819/1186206237', 'heartbeat_back_addr': '172.21.15.112:6823/1186206237', 'heartbeat_front_addr': '172.21.15.112:6821/1186206237', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e571e73b-0e9d-417d-b01c-59b651016763', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1356353759765625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 78, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 796623465}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 796623465}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 796623465}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 796623465}]}, 'public_addr': '172.21.15.112:6801/796623465', 'cluster_addr': '172.21.15.112:6803/796623465', 'heartbeat_back_addr': '172.21.15.112:6807/796623465', 'heartbeat_front_addr': '172.21.15.112:6805/796623465', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.174731+0000', 'dead_epoch': 41}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.475467+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.606174+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.835957+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.753547+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.284212+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.9', 'osds': [1, 0]}, {'pgid': '3.a', 'osds': [2, 5]}], 'pg_upmap_items': [{'pgid': '3.9', 'mappings': [{'from': 4, 'to': 0}]}, {'pgid': '3.10', 'mappings': [{'from': 5, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '1.0', 'osds': [1, 3]}, {'pgid': '2.0', 'osds': [1, 3]}, {'pgid': '2.5', 'osds': [4, 3]}, {'pgid': '3.9', 'osds': [1, 2]}, {'pgid': '3.f', 'osds': [5, 3]}, {'pgid': '3.10', 'osds': [2, 5]}, {'pgid': '3.11', 'osds': [4, 3]}, {'pgid': '3.12', 'osds': [1, 3]}, {'pgid': '3.15', 'osds': [4, 3]}, {'pgid': '3.1f', 'osds': [2, 3]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T08:41:01.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:41:01.280 INFO:teuthology.orchestra.run.smithi188.stdout:2094 write 0x6e22e00 thru 0x6e2735d (0x455e bytes) 2024-09-14T08:41:01.280 INFO:teuthology.orchestra.run.smithi188.stdout:2095 write 0x2e00a00 thru 0x2e0dc4e (0xd24f bytes) 2024-09-14T08:41:01.280 INFO:teuthology.orchestra.run.smithi188.stdout:2096 read 0x5f6a00 thru 0x5fca13 (0x6014 bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2097 punch from 0x84dc00 to 0x85b600, (0xda00 bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2099 write 0x26d7c00 thru 0x26e5152 (0xd553 bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2105 read 0x5609c00 thru 0x560b1eb (0x15ec bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2106 write 0x6c90e00 thru 0x6c9897a (0x7b7b bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2112 read 0x6df1200 thru 0x6df2b1e (0x191f bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2114 trunc from 0x6e27400 to 0x755e600 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2117 read 0x4661000 thru 0x466b3d3 (0xa3d4 bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2126 read 0x8b7e00 thru 0x8baab7 (0x2cb8 bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2127 write 0x9d84600 thru 0x9d94398 (0xfd99 bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2129 write 0xcd1f200 thru 0xcd2079f (0x15a0 bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2130 read 0xd16200 thru 0xd1b43f (0x5240 bytes) 2024-09-14T08:41:01.281 INFO:teuthology.orchestra.run.smithi188.stdout:2131 write 0x6050000 thru 0x60546f0 (0x46f1 bytes) 2024-09-14T08:41:01.282 INFO:teuthology.orchestra.run.smithi188.stdout:2134 trunc from 0xcd20800 to 0x321aa00 2024-09-14T08:41:01.323 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:01.325+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:01.324 INFO:teuthology.orchestra.run.smithi188.stdout:2135 read 0x1c6400 thru 0x1d29ba (0xc5bb bytes) 2024-09-14T08:41:01.375 INFO:teuthology.orchestra.run.smithi188.stdout:2136 write 0xb4be400 thru 0xb4c6cdb (0x88dc bytes) 2024-09-14T08:41:01.386 INFO:teuthology.orchestra.run.smithi188.stdout:2137 trunc from 0xb4c6e00 to 0x7ac3800 2024-09-14T08:41:01.391 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:01.393+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:01.414 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:01.414 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:01.414 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:01.414 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:01.432 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:01.476 INFO:teuthology.orchestra.run.smithi188.stdout:2139 write 0xdbcc200 thru 0xdbd0042 (0x3e43 bytes) 2024-09-14T08:41:01.476 INFO:teuthology.orchestra.run.smithi188.stdout:2140 read 0x9092600 thru 0x909eeea (0xc8eb bytes) 2024-09-14T08:41:01.492 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:01.495+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:01.502 INFO:teuthology.orchestra.run.smithi188.stdout:2144 trunc from 0xdbd0200 to 0xe95400 2024-09-14T08:41:01.549 INFO:teuthology.orchestra.run.smithi188.stdout:2146 read 0x2b6a00 thru 0x2b9358 (0x2959 bytes) 2024-09-14T08:41:01.552 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:01.552 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:01.553 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:01.553 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:01.553 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:01.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:41:01.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:01.583 INFO:teuthology.orchestra.run.smithi188.stdout:2147 write 0x39dcc00 thru 0x39e3b27 (0x6f28 bytes) 2024-09-14T08:41:01.588 INFO:teuthology.orchestra.run.smithi188.stdout:2148 trunc from 0x39e3c00 to 0x5788800 2024-09-14T08:41:01.608 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:01.611+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:01.620 INFO:teuthology.orchestra.run.smithi188.stdout:2149 read 0x4bb3000 thru 0x4bba50a (0x750b bytes) 2024-09-14T08:41:01.621 INFO:teuthology.orchestra.run.smithi188.stdout:2152 read 0x2eb4e00 thru 0x2ebfb1b (0xad1c bytes) 2024-09-14T08:41:01.642 INFO:teuthology.orchestra.run.smithi188.stdout:2154 write 0x82e8800 thru 0x82efee2 (0x76e3 bytes) 2024-09-14T08:41:01.664 INFO:teuthology.orchestra.run.smithi188.stdout:2155 trunc from 0x82f0000 to 0x1427200 2024-09-14T08:41:01.685 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:41:01.685 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:41:01.695 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:01.693+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:01.709 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-14T08:41:00.297483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599816127,"num_objects":920,"num_object_clones":181,"num_object_copies":1840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":221,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":477,"num_read":338590,"num_read_kb":567807,"num_write":5941,"num_write_kb":144263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":283,"num_bytes_recovered":12942101,"num_keys_recovered":68,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5769,"ondisk_log_size":5769,"up":63,"acting":73,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":253892,"kb_used_data":81328,"kb_used_omap":7,"kb_used_meta":172472,"kb_avail":471605308,"statfs":{"total":483183820800,"available":482923835392,"internally_reserved":0,"allocated":83279872,"data_stored":93445473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7975,"internal_metadata":176611545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4643816,"num_objects":151,"num_object_clones":21,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":27,"num_objects_misplaced":42,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":106,"num_read":9645,"num_read_kb":42487,"num_write":335,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001855"},"pg_stats":[{"pgid":"3.1f","version":"88'54","reported_seq":93,"reported_epoch":88,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:53.754285+0000","last_change":"2024-09-14T08:40:41.463433+0000","last_active":"2024-09-14T08:40:53.754285+0000","last_peered":"2024-09-14T08:40:53.754285+0000","last_clean":"2024-09-14T08:40:53.754285+0000","last_became_active":"2024-09-14T08:40:41.414953+0000","last_became_peered":"2024-09-14T08:40:41.414953+0000","last_unstale":"2024-09-14T08:40:53.754285+0000","last_undegraded":"2024-09-14T08:40:53.754285+0000","last_fullsized":"2024-09-14T08:40:53.754285+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:59.684970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001451897,"stat_sum":{"num_bytes":267354,"num_objects":20,"num_object_clones":3,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":20,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":15,"num_read":58,"num_read_kb":106,"num_write":43,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[{"shards":"2,3","objects":20}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"88'88","reported_seq":26443,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:55.936890+0000","last_change":"2024-09-14T08:40:40.488885+0000","last_active":"2024-09-14T08:40:55.936890+0000","last_peered":"2024-09-14T08:40:55.936890+0000","last_clean":"2024-09-14T08:40:55.936890+0000","last_became_active":"2024-09-14T08:40:40.416949+0000","last_became_peered":"2024-09-14T08:40:40.416949+0000","last_unstale":"2024-09-14T08:40:55.936890+0000","last_undegraded":"2024-09-14T08:40:55.936890+0000","last_fullsized":"2024-09-14T08:40:55.936890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:34.133076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013459450000000001,"stat_sum":{"num_bytes":16509968,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":20,"num_read":26173,"num_read_kb":23596,"num_write":71,"num_write_kb":1067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"88'215","reported_seq":4148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:55.935945+0000","last_change":"2024-09-14T08:40:16.727831+0000","last_active":"2024-09-14T08:40:55.935945+0000","last_peered":"2024-09-14T08:40:55.935945+0000","last_clean":"2024-09-14T08:40:55.935945+0000","last_became_active":"2024-09-14T08:40:16.726695+0000","last_became_peered":"2024-09-14T08:40:16.726695+0000","last_unstale":"2024-09-14T08:40:55.935945+0000","last_undegraded":"2024-09-14T08:40:55.935945+0000","last_fullsized":"2024-09-14T08:40:55.935945+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:24.706379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003027493,"stat_sum":{"num_bytes":11750430,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":21,"num_read":5237,"num_read_kb":24612,"num_write":170,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"88'359","reported_seq":4755,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:56.227828+0000","last_change":"2024-09-14T08:40:16.728168+0000","last_active":"2024-09-14T08:40:56.227828+0000","last_peered":"2024-09-14T08:40:56.227828+0000","last_clean":"2024-09-14T08:40:56.227828+0000","last_became_active":"2024-09-14T08:40:16.726971+0000","last_became_peered":"2024-09-14T08:40:16.726971+0000","last_unstale":"2024-09-14T08:40:56.227828+0000","last_undegraded":"2024-09-14T08:40:56.227828+0000","last_fullsized":"2024-09-14T08:40:56.227828+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:27.281833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001345691,"stat_sum":{"num_bytes":25274414,"num_objects":31,"num_object_clones":4,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":15,"num_read":5111,"num_read_kb":24428,"num_write":444,"num_write_kb":3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"88'371","reported_seq":2084,"reported_epoch":88,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:54.138735+0000","last_change":"2024-09-14T08:39:52.563176+0000","last_active":"2024-09-14T08:40:54.138735+0000","last_peered":"2024-09-14T08:40:54.138735+0000","last_clean":"2024-09-14T08:39:47.936799+0000","last_became_active":"2024-09-14T08:39:52.563176+0000","last_became_peered":"2024-09-14T08:39:52.563176+0000","last_unstale":"2024-09-14T08:40:54.138735+0000","last_undegraded":"2024-09-14T08:39:52.558992+0000","last_fullsized":"2024-09-14T08:39:52.558706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:27.805516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910279999999999,"stat_sum":{"num_bytes":8774231,"num_objects":22,"num_object_clones":4,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":22,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":11,"num_read":3431,"num_read_kb":14805,"num_write":516,"num_write_kb":1518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":22}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"88'139","reported_seq":2256,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:56.152416+0000","last_change":"2024-09-14T08:39:20.388365+0000","last_active":"2024-09-14T08:40:56.152416+0000","last_peered":"2024-09-14T08:40:56.152416+0000","last_clean":"2024-09-14T08:40:56.152416+0000","last_became_active":"2024-09-14T08:39:18.383879+0000","last_became_peered":"2024-09-14T08:39:18.383879+0000","last_unstale":"2024-09-14T08:40:56.152416+0000","last_undegraded":"2024-09-14T08:40:56.152416+0000","last_fullsized":"2024-09-14T08:40:56.152416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:08.710822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211712,"stat_sum":{"num_bytes":8803910,"num_objects":23,"num_object_clones":5,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":10,"num_read":2344,"num_read_kb":4719,"num_write":185,"num_write_kb":1857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"88'206","reported_seq":1539,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:55.169224+0000","last_change":"2024-09-14T08:39:20.386019+0000","last_active":"2024-09-14T08:40:55.169224+0000","last_peered":"2024-09-14T08:40:55.169224+0000","last_clean":"2024-09-14T08:40:55.169224+0000","last_became_active":"2024-09-14T08:39:18.384097+0000","last_became_peered":"2024-09-14T08:39:18.384097+0000","last_unstale":"2024-09-14T08:40:55.169224+0000","last_undegraded":"2024-09-14T08:40:55.169224+0000","last_fullsized":"2024-09-14T08:40:55.169224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:04.039971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014331750000000001,"stat_sum":{"num_bytes":6957766,"num_objects":27,"num_object_clones":3,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":14,"num_read":1809,"num_read_kb":7306,"num_write":276,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"88'111","reported_seq":1644,"reported_epoch":88,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:56.206708+0000","last_change":"2024-09-14T08:39:52.548543+0000","last_active":"2024-09-14T08:40:56.206708+0000","last_peered":"2024-09-14T08:40:56.206708+0000","last_clean":"2024-09-14T08:39:50.545311+0000","last_became_active":"2024-09-14T08:39:52.548543+0000","last_became_peered":"2024-09-14T08:39:52.548543+0000","last_unstale":"2024-09-14T08:40:56.206708+0000","last_undegraded":"2024-09-14T08:39:52.547916+0000","last_fullsized":"2024-09-14T08:39:52.547825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:53.091319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922599999999997,"stat_sum":{"num_bytes":20451476,"num_objects":31,"num_object_clones":7,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":31,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":19,"num_read":1419,"num_read_kb":15364,"num_write":89,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":31}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"88'116","reported_seq":4541,"reported_epoch":88,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:53.711174+0000","last_change":"2024-09-14T08:39:52.560566+0000","last_active":"2024-09-14T08:40:53.711174+0000","last_peered":"2024-09-14T08:40:53.711174+0000","last_clean":"2024-09-14T08:39:44.516221+0000","last_became_active":"2024-09-14T08:39:52.560566+0000","last_became_peered":"2024-09-14T08:39:52.560566+0000","last_unstale":"2024-09-14T08:40:53.711174+0000","last_undegraded":"2024-09-14T08:39:52.556527+0000","last_fullsized":"2024-09-14T08:39:52.556283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:29.312929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862059999999999,"stat_sum":{"num_bytes":24331024,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":29,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":13,"num_read":4594,"num_read_kb":31011,"num_write":98,"num_write_kb":2634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":29}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"88'117","reported_seq":478,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:54.750088+0000","last_change":"2024-09-14T08:40:40.555724+0000","last_active":"2024-09-14T08:40:54.750088+0000","last_peered":"2024-09-14T08:40:54.750088+0000","last_clean":"2024-09-14T08:40:54.750088+0000","last_became_active":"2024-09-14T08:40:40.416704+0000","last_became_peered":"2024-09-14T08:40:40.416704+0000","last_unstale":"2024-09-14T08:40:54.750088+0000","last_undegraded":"2024-09-14T08:40:54.750088+0000","last_fullsized":"2024-09-14T08:40:54.750088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:22.914008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029337040000000001,"stat_sum":{"num_bytes":8817391,"num_objects":27,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":15,"num_read":24677,"num_read_kb":19388,"num_write":113,"num_write_kb":2778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"88'121","reported_seq":694,"reported_epoch":88,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:56.225372+0000","last_change":"2024-09-14T08:40:41.523240+0000","last_active":"2024-09-14T08:40:56.225372+0000","last_peered":"2024-09-14T08:40:56.225372+0000","last_clean":"2024-09-14T08:40:56.225372+0000","last_became_active":"2024-09-14T08:40:41.430173+0000","last_became_peered":"2024-09-14T08:40:41.430173+0000","last_unstale":"2024-09-14T08:40:56.225372+0000","last_undegraded":"2024-09-14T08:40:56.225372+0000","last_fullsized":"2024-09-14T08:40:56.225372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:09:46.706753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018449409999999999,"stat_sum":{"num_bytes":39916129,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":31,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":18,"num_read":1433,"num_read_kb":10425,"num_write":114,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1470049,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[{"shards":"3,4","objects":31}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"88'104","reported_seq":28848,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:54.752793+0000","last_change":"2024-09-14T08:40:40.495288+0000","last_active":"2024-09-14T08:40:54.752793+0000","last_peered":"2024-09-14T08:40:54.752793+0000","last_clean":"2024-09-14T08:40:54.752793+0000","last_became_active":"2024-09-14T08:40:40.411694+0000","last_became_peered":"2024-09-14T08:40:40.411694+0000","last_unstale":"2024-09-14T08:40:54.752793+0000","last_undegraded":"2024-09-14T08:40:54.752793+0000","last_fullsized":"2024-09-14T08:40:54.752793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:31.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014343330000000001,"stat_sum":{"num_bytes":30962932,"num_objects":24,"num_object_clones":3,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":11,"num_read":28711,"num_read_kb":26182,"num_write":119,"num_write_kb":1133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":222964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:53.500353+0000","last_change":"2024-09-14T08:40:40.408528+0000","last_active":"2024-09-14T08:40:53.500353+0000","last_peered":"2024-09-14T08:40:53.500353+0000","last_clean":"2024-09-14T08:40:53.500353+0000","last_became_active":"2024-09-14T08:40:40.408122+0000","last_became_peered":"2024-09-14T08:40:40.408122+0000","last_unstale":"2024-09-14T08:40:53.500353+0000","last_undegraded":"2024-09-14T08:40:53.500353+0000","last_fullsized":"2024-09-14T08:40:53.500353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:43.290991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'235","reported_seq":46942,"reported_epoch":88,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:55.934959+0000","last_change":"2024-09-14T08:39:52.551765+0000","last_active":"2024-09-14T08:40:55.934959+0000","last_peered":"2024-09-14T08:40:55.934959+0000","last_clean":"2024-09-14T08:39:47.208280+0000","last_became_active":"2024-09-14T08:39:52.551765+0000","last_became_peered":"2024-09-14T08:39:52.551765+0000","last_unstale":"2024-09-14T08:40:55.934959+0000","last_undegraded":"2024-09-14T08:39:52.550793+0000","last_fullsized":"2024-09-14T08:39:52.550716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:48:11.396796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484614,"stat_sum":{"num_bytes":26923599,"num_objects":32,"num_object_clones":7,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":32,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":17,"num_read":47650,"num_read_kb":35133,"num_write":235,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":32}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:53.496686+0000","last_change":"2024-09-14T08:40:40.418897+0000","last_active":"2024-09-14T08:40:53.496686+0000","last_peered":"2024-09-14T08:40:53.496686+0000","last_clean":"2024-09-14T08:40:53.496686+0000","last_became_active":"2024-09-14T08:40:40.418160+0000","last_became_peered":"2024-09-14T08:40:40.418160+0000","last_unstale":"2024-09-14T08:40:53.496686+0000","last_undegraded":"2024-09-14T08:40:53.496686+0000","last_fullsized":"2024-09-14T08:40:53.496686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:39.281258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"88'174","reported_seq":43487,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:56.046379+0000","last_change":"2024-09-14T08:39:20.419181+0000","last_active":"2024-09-14T08:40:56.046379+0000","last_peered":"2024-09-14T08:40:56.046379+0000","last_clean":"2024-09-14T08:40:56.046379+0000","last_became_active":"2024-09-14T08:39:18.382867+0000","last_became_peered":"2024-09-14T08:39:18.382867+0000","last_unstale":"2024-09-14T08:40:56.046379+0000","last_undegraded":"2024-09-14T08:40:56.046379+0000","last_fullsized":"2024-09-14T08:40:56.046379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:31.594743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015322599999999999,"stat_sum":{"num_bytes":25763909,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":17,"num_read":43306,"num_read_kb":37076,"num_write":174,"num_write_kb":30788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:53.500563+0000","last_change":"2024-09-14T08:40:41.431348+0000","last_active":"2024-09-14T08:40:53.500563+0000","last_peered":"2024-09-14T08:40:53.500563+0000","last_clean":"2024-09-14T08:40:53.500563+0000","last_became_active":"2024-09-14T08:40:41.430205+0000","last_became_peered":"2024-09-14T08:40:41.430205+0000","last_unstale":"2024-09-14T08:40:53.500563+0000","last_undegraded":"2024-09-14T08:40:53.500563+0000","last_fullsized":"2024-09-14T08:40:53.500563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:29.588789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"88'264","reported_seq":2490,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:54.750260+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:40:54.750260+0000","last_peered":"2024-09-14T08:40:54.750260+0000","last_clean":"2024-09-14T08:40:54.750260+0000","last_became_active":"2024-09-14T08:39:18.387737+0000","last_became_peered":"2024-09-14T08:39:18.387737+0000","last_unstale":"2024-09-14T08:40:54.750260+0000","last_undegraded":"2024-09-14T08:40:54.750260+0000","last_fullsized":"2024-09-14T08:40:54.750260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:58.040954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010096059999999999,"stat_sum":{"num_bytes":33600549,"num_objects":27,"num_object_clones":4,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":17,"num_read":3155,"num_read_kb":7153,"num_write":311,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":88,"state":"active+undersized","last_fresh":"2024-09-14T08:40:53.496693+0000","last_change":"2024-09-14T08:39:52.551815+0000","last_active":"2024-09-14T08:40:53.496693+0000","last_peered":"2024-09-14T08:40:53.496693+0000","last_clean":"2024-09-14T08:39:50.569724+0000","last_became_active":"2024-09-14T08:39:52.551815+0000","last_became_peered":"2024-09-14T08:39:52.551815+0000","last_unstale":"2024-09-14T08:40:53.496693+0000","last_undegraded":"2024-09-14T08:40:53.496693+0000","last_fullsized":"2024-09-14T08:39:52.550804+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:21.879310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"88'390","reported_seq":1693,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:54.191876+0000","last_change":"2024-09-14T08:40:16.717901+0000","last_active":"2024-09-14T08:40:54.191876+0000","last_peered":"2024-09-14T08:40:54.191876+0000","last_clean":"2024-09-14T08:40:54.191876+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:40:54.191876+0000","last_undegraded":"2024-09-14T08:40:54.191876+0000","last_fullsized":"2024-09-14T08:40:54.191876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:31.685601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032365710000000002,"stat_sum":{"num_bytes":13901544,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":18,"num_read":2908,"num_read_kb":16325,"num_write":619,"num_write_kb":2930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"88'98","reported_seq":16249,"reported_epoch":88,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:56.216624+0000","last_change":"2024-09-14T08:39:52.566848+0000","last_active":"2024-09-14T08:40:56.216624+0000","last_peered":"2024-09-14T08:40:56.216624+0000","last_clean":"2024-09-14T08:39:50.573428+0000","last_became_active":"2024-09-14T08:39:52.566848+0000","last_became_peered":"2024-09-14T08:39:52.566848+0000","last_unstale":"2024-09-14T08:40:56.216624+0000","last_undegraded":"2024-09-14T08:39:52.559844+0000","last_fullsized":"2024-09-14T08:39:52.559536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:11.490801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599846,"stat_sum":{"num_bytes":7130112,"num_objects":31,"num_object_clones":5,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":31,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":18,"num_read":16016,"num_read_kb":10658,"num_write":80,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":31}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:53.496750+0000","last_change":"2024-09-14T08:40:16.717703+0000","last_active":"2024-09-14T08:40:53.496750+0000","last_peered":"2024-09-14T08:40:53.496750+0000","last_clean":"2024-09-14T08:40:53.496750+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:40:53.496750+0000","last_undegraded":"2024-09-14T08:40:53.496750+0000","last_fullsized":"2024-09-14T08:40:53.496750+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:18.988966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"88'66","reported_seq":25356,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:55.493084+0000","last_change":"2024-09-14T08:39:20.385113+0000","last_active":"2024-09-14T08:40:55.493084+0000","last_peered":"2024-09-14T08:40:55.493084+0000","last_clean":"2024-09-14T08:40:55.493084+0000","last_became_active":"2024-09-14T08:39:18.387585+0000","last_became_peered":"2024-09-14T08:39:18.387585+0000","last_unstale":"2024-09-14T08:40:55.493084+0000","last_undegraded":"2024-09-14T08:40:55.493084+0000","last_fullsized":"2024-09-14T08:40:55.493084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:49.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058750299999999996,"stat_sum":{"num_bytes":11912285,"num_objects":25,"num_object_clones":5,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":11,"num_read":25161,"num_read_kb":20078,"num_write":55,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":158,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:53.593096+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:40:53.593096+0000","last_peered":"2024-09-14T08:40:53.593096+0000","last_clean":"2024-09-14T08:40:53.593096+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:40:53.593096+0000","last_undegraded":"2024-09-14T08:40:53.593096+0000","last_fullsized":"2024-09-14T08:40:53.593096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"88'102","reported_seq":2047,"reported_epoch":88,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:56.047190+0000","last_change":"2024-09-14T08:39:52.560317+0000","last_active":"2024-09-14T08:40:56.047190+0000","last_peered":"2024-09-14T08:40:56.047190+0000","last_clean":"2024-09-14T08:39:44.515729+0000","last_became_active":"2024-09-14T08:39:52.560317+0000","last_became_peered":"2024-09-14T08:39:52.560317+0000","last_unstale":"2024-09-14T08:40:56.047190+0000","last_undegraded":"2024-09-14T08:39:52.558935+0000","last_fullsized":"2024-09-14T08:39:52.558691+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:28:01.457866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047135900000000002,"stat_sum":{"num_bytes":34527269,"num_objects":16,"num_object_clones":4,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":16,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":8,"num_read":1829,"num_read_kb":7159,"num_write":91,"num_write_kb":1258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":16}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:53.496117+0000","last_change":"2024-09-14T08:40:41.411848+0000","last_active":"2024-09-14T08:40:53.496117+0000","last_peered":"2024-09-14T08:40:53.496117+0000","last_clean":"2024-09-14T08:40:53.496117+0000","last_became_active":"2024-09-14T08:40:41.411057+0000","last_became_peered":"2024-09-14T08:40:41.411057+0000","last_unstale":"2024-09-14T08:40:53.496117+0000","last_undegraded":"2024-09-14T08:40:53.496117+0000","last_fullsized":"2024-09-14T08:40:53.496117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:36:11.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"88'158","reported_seq":2730,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:56.046572+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:40:56.046572+0000","last_peered":"2024-09-14T08:40:56.046572+0000","last_clean":"2024-09-14T08:40:56.046572+0000","last_became_active":"2024-09-14T08:39:18.387242+0000","last_became_peered":"2024-09-14T08:39:18.387242+0000","last_unstale":"2024-09-14T08:40:56.046572+0000","last_undegraded":"2024-09-14T08:40:56.046572+0000","last_fullsized":"2024-09-14T08:40:56.046572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:06.022443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332069,"stat_sum":{"num_bytes":30607013,"num_objects":26,"num_object_clones":5,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":11,"num_read":2855,"num_read_kb":22833,"num_write":214,"num_write_kb":3165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":76,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:53.593746+0000","last_change":"2024-09-14T08:40:16.718478+0000","last_active":"2024-09-14T08:40:53.593746+0000","last_peered":"2024-09-14T08:40:53.593746+0000","last_clean":"2024-09-14T08:40:53.593746+0000","last_became_active":"2024-09-14T08:40:16.717575+0000","last_became_peered":"2024-09-14T08:40:16.717575+0000","last_unstale":"2024-09-14T08:40:53.593746+0000","last_undegraded":"2024-09-14T08:40:53.593746+0000","last_fullsized":"2024-09-14T08:40:53.593746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:50.808473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:53.495764+0000","last_change":"2024-09-14T08:40:41.421649+0000","last_active":"2024-09-14T08:40:53.495764+0000","last_peered":"2024-09-14T08:40:53.495764+0000","last_clean":"2024-09-14T08:40:53.495764+0000","last_became_active":"2024-09-14T08:40:41.411564+0000","last_became_peered":"2024-09-14T08:40:41.411564+0000","last_unstale":"2024-09-14T08:40:53.495764+0000","last_undegraded":"2024-09-14T08:40:53.495764+0000","last_fullsized":"2024-09-14T08:40:53.495764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:03.165008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"88'217","reported_seq":30824,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:55.936542+0000","last_change":"2024-09-14T08:39:20.418935+0000","last_active":"2024-09-14T08:40:55.936542+0000","last_peered":"2024-09-14T08:40:55.936542+0000","last_clean":"2024-09-14T08:40:55.936542+0000","last_became_active":"2024-09-14T08:39:18.382844+0000","last_became_peered":"2024-09-14T08:39:18.382844+0000","last_unstale":"2024-09-14T08:40:55.936542+0000","last_undegraded":"2024-09-14T08:40:55.936542+0000","last_fullsized":"2024-09-14T08:40:55.936542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:38.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013334390000000001,"stat_sum":{"num_bytes":7285875,"num_objects":25,"num_object_clones":2,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":13,"num_read":29672,"num_read_kb":22205,"num_write":136,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"88'341","reported_seq":4021,"reported_epoch":88,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:56.232951+0000","last_change":"2024-09-14T08:40:13.684553+0000","last_active":"2024-09-14T08:40:56.232951+0000","last_peered":"2024-09-14T08:40:56.232951+0000","last_clean":"2024-09-14T08:40:56.232951+0000","last_became_active":"2024-09-14T08:40:13.683804+0000","last_became_peered":"2024-09-14T08:40:13.683804+0000","last_unstale":"2024-09-14T08:40:56.232951+0000","last_undegraded":"2024-09-14T08:40:56.232951+0000","last_fullsized":"2024-09-14T08:40:56.232951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:21.210073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011980249999999999,"stat_sum":{"num_bytes":19018326,"num_objects":36,"num_object_clones":7,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":36,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":18,"num_read":5564,"num_read_kb":9531,"num_write":308,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":97792,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":36}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"88'189","reported_seq":5502,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:54.357448+0000","last_change":"2024-09-14T08:40:36.360897+0000","last_active":"2024-09-14T08:40:54.357448+0000","last_peered":"2024-09-14T08:40:54.357448+0000","last_clean":"2024-09-14T08:40:54.357448+0000","last_became_active":"2024-09-14T08:40:36.358876+0000","last_became_peered":"2024-09-14T08:40:36.358876+0000","last_unstale":"2024-09-14T08:40:54.357448+0000","last_undegraded":"2024-09-14T08:40:54.357448+0000","last_fullsized":"2024-09-14T08:40:54.357448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:05:38.105687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002911753,"stat_sum":{"num_bytes":37371408,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":10,"num_read":6256,"num_read_kb":56946,"num_write":156,"num_write_kb":36344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":5746688,"num_keys_recovered":33,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'95","reported_seq":2648,"reported_epoch":88,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:55.169902+0000","last_change":"2024-09-14T08:39:52.551432+0000","last_active":"2024-09-14T08:40:55.169902+0000","last_peered":"2024-09-14T08:40:55.169902+0000","last_clean":"2024-09-14T08:39:50.569609+0000","last_became_active":"2024-09-14T08:39:52.551432+0000","last_became_peered":"2024-09-14T08:39:52.551432+0000","last_unstale":"2024-09-14T08:40:55.169902+0000","last_undegraded":"2024-09-14T08:39:52.550774+0000","last_fullsized":"2024-09-14T08:39:52.550674+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:51.754726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013500459999999999,"stat_sum":{"num_bytes":11671584,"num_objects":23,"num_object_clones":5,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":11,"num_read":2435,"num_read_kb":12449,"num_write":88,"num_write_kb":1966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":23}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'187","reported_seq":26822,"reported_epoch":88,"state":"active+undersized+degraded","last_fresh":"2024-09-14T08:40:53.710989+0000","last_change":"2024-09-14T08:39:52.561097+0000","last_active":"2024-09-14T08:40:53.710989+0000","last_peered":"2024-09-14T08:40:53.710989+0000","last_clean":"2024-09-14T08:39:50.651509+0000","last_became_active":"2024-09-14T08:39:52.561097+0000","last_became_peered":"2024-09-14T08:39:52.561097+0000","last_unstale":"2024-09-14T08:40:53.710989+0000","last_undegraded":"2024-09-14T08:39:52.557286+0000","last_fullsized":"2024-09-14T08:39:52.556541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:01.239228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652499,"stat_sum":{"num_bytes":24139815,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":34,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":17,"num_read":27790,"num_read_kb":33897,"num_write":165,"num_write_kb":3363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":34}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"88'328","reported_seq":3727,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:56.225438+0000","last_change":"2024-09-14T08:40:43.437156+0000","last_active":"2024-09-14T08:40:56.225438+0000","last_peered":"2024-09-14T08:40:56.225438+0000","last_clean":"2024-09-14T08:40:56.225438+0000","last_became_active":"2024-09-14T08:40:43.436214+0000","last_became_peered":"2024-09-14T08:40:43.436214+0000","last_unstale":"2024-09-14T08:40:56.225438+0000","last_undegraded":"2024-09-14T08:40:56.225438+0000","last_fullsized":"2024-09-14T08:40:56.225438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:13.418974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024901429999999998,"stat_sum":{"num_bytes":11452928,"num_objects":26,"num_object_clones":7,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":11,"num_read":5541,"num_read_kb":9725,"num_write":202,"num_write_kb":3300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":1135104,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"88'62","reported_seq":1226,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:56.047264+0000","last_change":"2024-09-14T08:40:16.728183+0000","last_active":"2024-09-14T08:40:56.047264+0000","last_peered":"2024-09-14T08:40:56.047264+0000","last_clean":"2024-09-14T08:40:56.047264+0000","last_became_active":"2024-09-14T08:40:16.727022+0000","last_became_peered":"2024-09-14T08:40:16.727022+0000","last_unstale":"2024-09-14T08:40:56.047264+0000","last_undegraded":"2024-09-14T08:40:56.047264+0000","last_fullsized":"2024-09-14T08:40:56.047264+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:59.806525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002389113,"stat_sum":{"num_bytes":8422912,"num_objects":22,"num_object_clones":2,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":12,"num_read":1051,"num_read_kb":7192,"num_write":53,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"88'139","reported_seq":2573,"reported_epoch":88,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:53.878145+0000","last_change":"2024-09-14T08:40:41.420643+0000","last_active":"2024-09-14T08:40:53.878145+0000","last_peered":"2024-09-14T08:40:53.878145+0000","last_clean":"2024-09-14T08:40:53.878145+0000","last_became_active":"2024-09-14T08:40:41.419323+0000","last_became_peered":"2024-09-14T08:40:41.419323+0000","last_unstale":"2024-09-14T08:40:53.878145+0000","last_undegraded":"2024-09-14T08:40:53.878145+0000","last_fullsized":"2024-09-14T08:40:53.878145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:25.777399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023917970000000002,"stat_sum":{"num_bytes":39831568,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":42,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":22,"num_read":2358,"num_read_kb":21908,"num_write":115,"num_write_kb":4759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[{"shards":"3,5","objects":42}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"88'136","reported_seq":1596,"reported_epoch":88,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:56.152097+0000","last_change":"2024-09-14T08:39:56.643519+0000","last_active":"2024-09-14T08:40:56.152097+0000","last_peered":"2024-09-14T08:40:56.152097+0000","last_clean":"2024-09-14T08:40:56.152097+0000","last_became_active":"2024-09-14T08:39:56.593633+0000","last_became_peered":"2024-09-14T08:39:56.593633+0000","last_unstale":"2024-09-14T08:40:56.152097+0000","last_undegraded":"2024-09-14T08:40:56.152097+0000","last_fullsized":"2024-09-14T08:40:56.152097+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:37.774629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024547029999999999,"stat_sum":{"num_bytes":30879870,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":29,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":12,"num_read":3043,"num_read_kb":18218,"num_write":127,"num_write_kb":1058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":177790,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[{"shards":"2,5","objects":29}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"88'154","reported_seq":2075,"reported_epoch":88,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:56.152454+0000","last_change":"2024-09-14T08:40:41.418824+0000","last_active":"2024-09-14T08:40:56.152454+0000","last_peered":"2024-09-14T08:40:56.152454+0000","last_clean":"2024-09-14T08:40:56.152454+0000","last_became_active":"2024-09-14T08:40:41.415895+0000","last_became_peered":"2024-09-14T08:40:41.415895+0000","last_unstale":"2024-09-14T08:40:56.152454+0000","last_undegraded":"2024-09-14T08:40:56.152454+0000","last_fullsized":"2024-09-14T08:40:56.152454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:31.365723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001362044,"stat_sum":{"num_bytes":3953231,"num_objects":32,"num_object_clones":7,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":32,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":20,"num_read":2596,"num_read_kb":6364,"num_write":115,"num_write_kb":1346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[{"shards":"3,4","objects":32}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"88'223","reported_seq":2484,"reported_epoch":88,"state":"active+clean+remapped","last_fresh":"2024-09-14T08:40:56.222880+0000","last_change":"2024-09-14T08:40:43.431976+0000","last_active":"2024-09-14T08:40:56.222880+0000","last_peered":"2024-09-14T08:40:56.222880+0000","last_clean":"2024-09-14T08:40:56.222880+0000","last_became_active":"2024-09-14T08:40:43.431333+0000","last_became_peered":"2024-09-14T08:40:43.431333+0000","last_unstale":"2024-09-14T08:40:56.222880+0000","last_undegraded":"2024-09-14T08:40:56.222880+0000","last_fullsized":"2024-09-14T08:40:56.222880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:46.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013117140000000001,"stat_sum":{"num_bytes":6784626,"num_objects":31,"num_object_clones":8,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":31,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":15,"num_read":2796,"num_read_kb":6459,"num_write":214,"num_write_kb":3363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2141810,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":31}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"88'135","reported_seq":1213,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-14T08:40:56.197676+0000","last_change":"2024-09-14T08:40:41.553903+0000","last_active":"2024-09-14T08:40:56.197676+0000","last_peered":"2024-09-14T08:40:56.197676+0000","last_clean":"2024-09-14T08:40:56.197676+0000","last_became_active":"2024-09-14T08:40:41.420572+0000","last_became_peered":"2024-09-14T08:40:41.420572+0000","last_unstale":"2024-09-14T08:40:56.197676+0000","last_undegraded":"2024-09-14T08:40:56.197676+0000","last_fullsized":"2024-09-14T08:40:56.197676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:23.928022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018326740000000001,"stat_sum":{"num_bytes":11230292,"num_objects":31,"num_object_clones":4,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":17,"num_read":1545,"num_read_kb":4501,"num_write":142,"num_write_kb":2253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":515126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":599225740,"num_objects":916,"num_object_clones":181,"num_object_copies":1832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":221,"num_objects_unfound":0,"num_objects_dirty":916,"num_whiteouts":477,"num_read":338524,"num_read_kb":567752,"num_write":5838,"num_write_kb":142633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":11761365,"num_keys_recovered":68,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89411584,"data_stored":103810824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5694,"ondisk_log_size":5694,"up":49,"acting":56,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":13,"acting":15,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":1,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49604,"kb_used_data":14260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322236,"statfs":{"total":96636764160,"available":96585969664,"internally_reserved":0,"allocated":14602240,"data_stored":13752831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574875,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54520,"kb_used_data":19176,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94317320,"statfs":{"total":96636764160,"available":96580935680,"internally_reserved":0,"allocated":19636224,"data_stored":22345439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53036,"kb_used_data":17692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318804,"statfs":{"total":96636764160,"available":96582455296,"internally_reserved":0,"allocated":18116608,"data_stored":18989531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607579,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61640,"kb_used_data":26296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94310200,"statfs":{"total":96636764160,"available":96573644800,"internally_reserved":0,"allocated":26927104,"data_stored":34736255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607567,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35092,"kb_used_data":3904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336748,"statfs":{"total":96636764160,"available":96600829952,"internally_reserved":0,"allocated":3997696,"data_stored":3621417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3571712,"data_stored":3460262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16490496,"data_stored":17977633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18608128,"data_stored":21923928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11272192,"data_stored":12802956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13574144,"data_stored":13331320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25894912,"data_stored":34314725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:41:01.712 INFO:tasks.thrashosds.thrasher:Setting 3.0 to [5, 0, 3, 1] 2024-09-14T08:41:01.712 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.0', '5', '0', '3', '1'] 2024-09-14T08:41:01.712 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.0 5 0 3 1 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491986689000001, 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.738 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:41:01.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:41:01.742 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491924675999996, 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:41:01.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.747 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491858346000001, 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.748 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:41:01.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.752 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491802886000002, 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:41:01.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:41:01.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:41:01.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.758 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.758 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.758 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:01.758 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491743266, 2024-09-14T08:41:01.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:41:01.758 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:41:01.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.762 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491661725999997, 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.763 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:41:01.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:41:01.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:01.767 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491605397999997, 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491533902999997, 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:41:01.772 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:41:01.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.776 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491461031999997, 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.777 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:41:01.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:41:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:01.781 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.49141882, 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:01.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.785 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491388989999997, 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:41:01.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:41:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491360692999997, 2024-09-14T08:41:01.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:41:01.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491319597999997, 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:41:01.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:41:01.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:01.799 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491290567999997, 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.803 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491262083999999, 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.804 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:41:01.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.808 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491233944000001, 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:41:01.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491205248, 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:41:01.814 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.818 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491176490999997, 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.819 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.823 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491148443999997, 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:01.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:01.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:41:01.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.491118467, 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:01.828 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:01.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:01.832 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:01.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:01.835 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:01.835+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout:2156 write 0x970f600 thru 0x9717fbc (0x89bd bytes) 2024-09-14T08:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout:2157 read 0x18c3c00 thru 0x18cea48 (0xae49 bytes) 2024-09-14T08:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout:2159 write 0xcda2200 thru 0xcda2db0 (0xbb1 bytes) 2024-09-14T08:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout:2162 read 0xc09c800 thru 0xc0a6520 (0x9d21 bytes) 2024-09-14T08:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout:2163 write 0x5cef200 thru 0x5cefd25 (0xb26 bytes) 2024-09-14T08:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout:2164 punch from 0x1207200 to 0x1211800, (0xa600 bytes) 2024-09-14T08:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout:2165 write 0x867f800 thru 0x86891d0 (0x99d1 bytes) 2024-09-14T08:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout:2168 write 0xd1c2c00 thru 0xd1ca8fb (0x7cfc bytes) 2024-09-14T08:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout:2169 read 0x7c36c00 thru 0x7c37f23 (0x1324 bytes) 2024-09-14T08:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout:2171 trunc from 0xd1caa00 to 0xba8ac00 2024-09-14T08:41:01.900 INFO:teuthology.orchestra.run.smithi188.stdout:2172 write 0x1015000 thru 0x101e4ca (0x94cb bytes) 2024-09-14T08:41:01.902 INFO:teuthology.orchestra.run.smithi188.stdout:2173 read 0xa9b8a00 thru 0xa9c548b (0xca8c bytes) 2024-09-14T08:41:01.907 INFO:teuthology.orchestra.run.smithi188.stdout:2174 trunc from 0xba8ac00 to 0xa1e6c00 2024-09-14T08:41:01.934 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:01.933+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:01.960 INFO:teuthology.orchestra.run.smithi188.stdout:2176 read 0x3d77c00 thru 0x3d7e8b1 (0x6cb2 bytes) 2024-09-14T08:41:01.986 INFO:teuthology.orchestra.run.smithi188.stdout:2180 write 0xe633000 thru 0xe6370d7 (0x40d8 bytes) 2024-09-14T08:41:01.988 INFO:teuthology.orchestra.run.smithi188.stdout:2181 read 0x8868e00 thru 0x8875bd4 (0xcdd5 bytes) 2024-09-14T08:41:01.988 INFO:teuthology.orchestra.run.smithi188.stdout:2182 read 0x5274200 thru 0x52817dd (0xd5de bytes) 2024-09-14T08:41:01.989 INFO:teuthology.orchestra.run.smithi188.stdout:2183 write 0x75a8e00 thru 0x75b36ae (0xa8af bytes) 2024-09-14T08:41:01.989 INFO:teuthology.orchestra.run.smithi188.stdout:2184 read 0xbd84800 thru 0xbd887d4 (0x3fd5 bytes) 2024-09-14T08:41:01.989 INFO:teuthology.orchestra.run.smithi188.stdout:2185 punch from 0x8b31c00 to 0x8b3d000, (0xb400 bytes) 2024-09-14T08:41:01.991 INFO:teuthology.orchestra.run.smithi188.stdout:2186 read 0x51f3800 thru 0x52017b1 (0xdfb2 bytes) 2024-09-14T08:41:01.991 INFO:teuthology.orchestra.run.smithi188.stdout:2188 write 0xac44a00 thru 0xac54796 (0xfd97 bytes) 2024-09-14T08:41:01.992 INFO:teuthology.orchestra.run.smithi188.stdout:2190 read 0x410a800 thru 0x411490d (0xa10e bytes) 2024-09-14T08:41:01.992 INFO:teuthology.orchestra.run.smithi188.stdout:2193 write 0xb493400 thru 0xb49cc4c (0x984d bytes) 2024-09-14T08:41:01.992 INFO:teuthology.orchestra.run.smithi188.stdout:2194 read 0xa67400 thru 0xa707c7 (0x93c8 bytes) 2024-09-14T08:41:01.993 INFO:teuthology.orchestra.run.smithi188.stdout:2195 punch from 0x5f57a00 to 0x5f59c00, (0x2200 bytes) 2024-09-14T08:41:01.994 INFO:teuthology.orchestra.run.smithi188.stdout:2202 read 0x302a600 thru 0x3033118 (0x8b19 bytes) 2024-09-14T08:41:01.994 INFO:teuthology.orchestra.run.smithi188.stdout:2203 read 0x2f3c00 thru 0x2f62f8 (0x26f9 bytes) 2024-09-14T08:41:01.996 INFO:teuthology.orchestra.run.smithi188.stdout:2206 punch from 0x3ecaa00 to 0x3ed0800, (0x5e00 bytes) 2024-09-14T08:41:02.011 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:02.011 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:02.011 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:02.011 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:02.020 INFO:teuthology.orchestra.run.smithi188.stdout:2207 trunc from 0xe637200 to 0x1bbfe00 2024-09-14T08:41:02.028 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:02.073 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:02.075+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:02.135 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:02.135+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:02.149 INFO:teuthology.orchestra.run.smithi188.stdout:2208 read 0xd3b400 thru 0xd4301b (0x7c1c bytes) 2024-09-14T08:41:02.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:02.162 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:02.162 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:02.162 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:02.162 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:02.162 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:02.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:02.186 INFO:teuthology.orchestra.run.smithi188.stdout:2209 trunc from 0x1bbfe00 to 0xee11200 2024-09-14T08:41:02.202 INFO:teuthology.orchestra.run.smithi188.stdout:2210 read 0x703c00 thru 0x711d85 (0xe186 bytes) 2024-09-14T08:41:02.205 INFO:teuthology.orchestra.run.smithi188.stdout:2211 read 0xc356000 thru 0xc3593a3 (0x33a4 bytes) 2024-09-14T08:41:02.205 INFO:teuthology.orchestra.run.smithi188.stdout:2212 write 0xeb19600 thru 0xeb1ae44 (0x1845 bytes) 2024-09-14T08:41:02.205 INFO:teuthology.orchestra.run.smithi188.stdout:2215 write 0x2bbaa00 thru 0x2bbcc0c (0x220d bytes) 2024-09-14T08:41:02.206 INFO:teuthology.orchestra.run.smithi188.stdout:2217 read 0x2c1fc00 thru 0x2c29bb2 (0x9fb3 bytes) 2024-09-14T08:41:02.206 INFO:teuthology.orchestra.run.smithi188.stdout:2219 write 0x17f6200 thru 0x17f6e88 (0xc89 bytes) 2024-09-14T08:41:02.206 INFO:teuthology.orchestra.run.smithi188.stdout:2220 read 0x3235600 thru 0x323bc49 (0x664a bytes) 2024-09-14T08:41:02.217 INFO:teuthology.orchestra.run.smithi188.stdout:2221 trunc from 0xee11200 to 0xaa43600 2024-09-14T08:41:02.236 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:02.237+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:02.276 INFO:teuthology.orchestra.run.smithi188.stdout:2222 write 0x8614e00 thru 0x8616012 (0x1213 bytes) 2024-09-14T08:41:02.278 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:02.279 INFO:teuthology.orchestra.run.smithi188.stdout:2225 punch from 0x1e6b400 to 0x1e70c00, (0x5800 bytes) 2024-09-14T08:41:02.280 INFO:teuthology.orchestra.run.smithi188.stdout:2227 punch from 0xbbea00 to 0xbca000, (0xb600 bytes) 2024-09-14T08:41:02.281 INFO:teuthology.orchestra.run.smithi188.stdout:2228 trunc from 0xaa43600 to 0xa9b1600 2024-09-14T08:41:02.299 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:02.300 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:02.321 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:02.321 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:02.337 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:02.337+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:02.341 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:02.341 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:02.352 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:02.352 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:02.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:02.352 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:02.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.352 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.352 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:41:02.352 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.467788982000002, 2024-09-14T08:41:02.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:41:02.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.456536947000004, 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:41:02.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:41:02.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.455677061999999, 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.362 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:02.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:41:02.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.455370436999999, 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:41:02.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:41:02.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:41:02.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:02.371 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.454967101999998, 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:41:02.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.454563399000001, 2024-09-14T08:41:02.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:02.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:41:02.380 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.454212652999999, 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.381 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.453826380999999, 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:41:02.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:41:02.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.453635847999998, 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:41:02.390 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:41:02.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.45312912, 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.395 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:02.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.399 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.452803048, 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:41:02.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:41:02.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.452493435999997, 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.404 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:41:02.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:41:02.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.451997894000002, 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:41:02.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:41:02.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:41:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.413 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.451682136000002, 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:41:02.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.451194700000002, 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.418 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:41:02.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:41:02.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.450844687999997, 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.423 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:41:02.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.427 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.450053568999998, 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:41:02.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.449644509999999, 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:41:02.432 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:41:02.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:41:02.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.447011822999997, 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.437 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:41:02.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.620521181999997, 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.442 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:02.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:41:02.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:41:02.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:02.448 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:02.449 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:02.451 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:02.452 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:02.453 INFO:teuthology.orchestra.run.smithi188.stdout:2234 write 0xcf19c00 thru 0xcf2067e (0x6a7f bytes) 2024-09-14T08:41:02.453 INFO:teuthology.orchestra.run.smithi188.stdout:2239 read 0x5e30400 thru 0x5e3303b (0x2c3c bytes) 2024-09-14T08:41:02.453 INFO:teuthology.orchestra.run.smithi188.stdout:2240 write 0x8ed3200 thru 0x8ee13db (0xe1dc bytes) 2024-09-14T08:41:02.453 INFO:teuthology.orchestra.run.smithi188.stdout:2241 punch from 0x3cfb400 to 0x3d00000, (0x4c00 bytes) 2024-09-14T08:41:02.453 INFO:teuthology.orchestra.run.smithi188.stdout:2244 trunc from 0xcf20800 to 0x9588800 2024-09-14T08:41:02.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:02.454 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:02.451+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:02.454 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:02.454 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:02.455 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:02.543 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:41:02.543 INFO:teuthology.orchestra.run.smithi089.stderr:set 3.0 pg_upmap_items mapping to [5->0,3->1] 2024-09-14T08:41:02.550 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:02.551+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:02.626 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:02.626 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:02.640 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:02.651 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:02.653+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:02.691 INFO:teuthology.orchestra.run.smithi188.stdout:2245 punch from 0x6d49000 to 0x6d57a00, (0xea00 bytes) 2024-09-14T08:41:02.692 INFO:teuthology.orchestra.run.smithi188.stdout:2246 write 0x1760e00 thru 0x176d3f1 (0xc5f2 bytes) 2024-09-14T08:41:02.701 INFO:teuthology.orchestra.run.smithi188.stdout:2247 trunc from 0x9588800 to 0x7620a00 2024-09-14T08:41:02.752 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:02.753+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:02.801 INFO:teuthology.orchestra.run.smithi188.stdout:2248 write 0x751a000 thru 0x751a53b (0x53c bytes) 2024-09-14T08:41:02.811 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:02.812 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:02.815 INFO:teuthology.orchestra.run.smithi188.stdout:2249 trunc from 0x7620a00 to 0x3091c00 2024-09-14T08:41:02.825 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:02.853 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:02.853+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:02.949 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:02.950 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:02.954 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:02.955+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:02.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:02.997 INFO:teuthology.orchestra.run.smithi188.stdout:2254 trunc from 0x3091c00 to 0xdaa2a00 2024-09-14T08:41:03.026 INFO:teuthology.orchestra.run.smithi188.stdout:2255 trunc from 0xdaa2a00 to 0xd66f800 2024-09-14T08:41:03.044 INFO:teuthology.orchestra.run.smithi188.stdout:2259 write 0x85a7200 thru 0x85afce5 (0x8ae6 bytes) 2024-09-14T08:41:03.045 INFO:teuthology.orchestra.run.smithi188.stdout:2260 read 0xbcdc400 thru 0xbcde712 (0x2313 bytes) 2024-09-14T08:41:03.045 INFO:teuthology.orchestra.run.smithi188.stdout:2261 read 0x3298400 thru 0x329ad04 (0x2905 bytes) 2024-09-14T08:41:03.046 INFO:teuthology.orchestra.run.smithi188.stdout:2263 read 0xfe1c00 thru 0xfe4c8e (0x308f bytes) 2024-09-14T08:41:03.047 INFO:teuthology.orchestra.run.smithi188.stdout:2264 write 0x6a44000 thru 0x6a52567 (0xe568 bytes) 2024-09-14T08:41:03.047 INFO:teuthology.orchestra.run.smithi188.stdout:2265 write 0xbe47c00 thru 0xbe505b8 (0x89b9 bytes) 2024-09-14T08:41:03.053 INFO:teuthology.orchestra.run.smithi188.stdout:2267 trunc from 0xd66f800 to 0xab02800 2024-09-14T08:41:03.054 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:03.053+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:03.124 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:03.124 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:03.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:03.149 INFO:teuthology.orchestra.run.smithi188.stdout:2268 write 0xc2afc00 thru 0xc2b62f0 (0x66f1 bytes) 2024-09-14T08:41:03.151 INFO:teuthology.orchestra.run.smithi188.stdout:2269 read 0x5a6fc00 thru 0x5a7ce34 (0xd235 bytes) 2024-09-14T08:41:03.152 INFO:teuthology.orchestra.run.smithi188.stdout:2270 read 0x9a0ba00 thru 0x9a1223a (0x683b bytes) 2024-09-14T08:41:03.152 INFO:teuthology.orchestra.run.smithi188.stdout:2274 write 0xac40800 thru 0xac4fff1 (0xf7f2 bytes) 2024-09-14T08:41:03.152 INFO:teuthology.orchestra.run.smithi188.stdout:2275 punch from 0x146e600 to 0x1472800, (0x4200 bytes) 2024-09-14T08:41:03.154 INFO:teuthology.orchestra.run.smithi188.stdout:2276 read 0x85eae00 thru 0x85f693d (0xbb3e bytes) 2024-09-14T08:41:03.156 INFO:teuthology.orchestra.run.smithi188.stdout:2277 read 0xa52cc00 thru 0xa5330b1 (0x64b2 bytes) 2024-09-14T08:41:03.156 INFO:teuthology.orchestra.run.smithi188.stdout:2278 read 0x150d600 thru 0x1512810 (0x5211 bytes) 2024-09-14T08:41:03.157 INFO:teuthology.orchestra.run.smithi188.stdout:2282 read 0x5ecc000 thru 0x5ed71ec (0xb1ed bytes) 2024-09-14T08:41:03.157 INFO:teuthology.orchestra.run.smithi188.stdout:2285 write 0x729e000 thru 0x72aa6cd (0xc6ce bytes) 2024-09-14T08:41:03.157 INFO:teuthology.orchestra.run.smithi188.stdout:2287 punch from 0x145c200 to 0x1469e00, (0xdc00 bytes) 2024-09-14T08:41:03.158 INFO:teuthology.orchestra.run.smithi188.stdout:2288 write 0x3fd7200 thru 0x3fe1be3 (0xa9e4 bytes) 2024-09-14T08:41:03.158 INFO:teuthology.orchestra.run.smithi188.stdout:2292 write 0x91d8200 thru 0x91e60d2 (0xded3 bytes) 2024-09-14T08:41:03.158 INFO:teuthology.orchestra.run.smithi188.stdout:2294 read 0x4ae2200 thru 0x4aee43e (0xc23f bytes) 2024-09-14T08:41:03.167 INFO:teuthology.orchestra.run.smithi188.stdout:2295 trunc from 0xc2b6400 to 0x74dd600 2024-09-14T08:41:03.183 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:03.185+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:03.256 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:03.255+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:03.296 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:03.296 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:03.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:03.357 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:03.359+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:03.458 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:03.459+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:03.458 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:03.458 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:03.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:03.528 INFO:teuthology.orchestra.run.smithi188.stdout:2298 write 0x851d200 thru 0x8529ae9 (0xc8ea bytes) 2024-09-14T08:41:03.529 INFO:teuthology.orchestra.run.smithi188.stdout:2299 read 0x8378600 thru 0x837bc4e (0x364f bytes) 2024-09-14T08:41:03.530 INFO:teuthology.orchestra.run.smithi188.stdout:2300 punch from 0x50c6000 to 0x50d3000, (0xd000 bytes) 2024-09-14T08:41:03.558 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:03.557+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:03.580 INFO:teuthology.orchestra.run.smithi188.stdout:2301 write 0x97c9c00 thru 0x97d0e70 (0x7271 bytes) 2024-09-14T08:41:03.616 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:03.616 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:03.630 INFO:teuthology.orchestra.run.smithi188.stdout:2302 write 0xdd4ee00 thru 0xdd5c8c1 (0xdac2 bytes) 2024-09-14T08:41:03.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:03.633 INFO:teuthology.orchestra.run.smithi188.stdout:2308 read 0x5f9a800 thru 0x5f9ec99 (0x449a bytes) 2024-09-14T08:41:03.633 INFO:teuthology.orchestra.run.smithi188.stdout:2309 write 0xc54c000 thru 0xc559dc5 (0xddc6 bytes) 2024-09-14T08:41:03.633 INFO:teuthology.orchestra.run.smithi188.stdout:2312 punch from 0xd4b8000 to 0xd4c1e00, (0x9e00 bytes) 2024-09-14T08:41:03.634 INFO:teuthology.orchestra.run.smithi188.stdout:2314 read 0x37bba00 thru 0x37c9fbe (0xe5bf bytes) 2024-09-14T08:41:03.634 INFO:teuthology.orchestra.run.smithi188.stdout:2316 read 0x2c9ae00 thru 0x2ca397c (0x8b7d bytes) 2024-09-14T08:41:03.634 INFO:teuthology.orchestra.run.smithi188.stdout:2317 punch from 0x9b14600 to 0x9b23600, (0xf000 bytes) 2024-09-14T08:41:03.635 INFO:teuthology.orchestra.run.smithi188.stdout:2319 write 0xcdba200 thru 0xcdc6e1b (0xcc1c bytes) 2024-09-14T08:41:03.635 INFO:teuthology.orchestra.run.smithi188.stdout:2320 read 0x343000 thru 0x34a035 (0x7036 bytes) 2024-09-14T08:41:03.659 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:03.659+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:03.693 INFO:teuthology.orchestra.run.smithi188.stdout:2321 trunc from 0xdd5ca00 to 0x68c5800 2024-09-14T08:41:03.759 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:03.761+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:03.821 INFO:teuthology.orchestra.run.smithi188.stdout:2323 write 0xbb5000 thru 0xbbb80a (0x680b bytes) 2024-09-14T08:41:03.826 INFO:teuthology.orchestra.run.smithi188.stdout:2324 trunc from 0x68c5800 to 0x5a72400 2024-09-14T08:41:03.826 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:03.826 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:03.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:03.869 INFO:teuthology.orchestra.run.smithi188.stdout:2325 read 0x420d200 thru 0x421a304 (0xd105 bytes) 2024-09-14T08:41:03.871 INFO:teuthology.orchestra.run.smithi188.stdout:2332 read 0x31e1800 thru 0x31e7096 (0x5897 bytes) 2024-09-14T08:41:03.872 INFO:teuthology.orchestra.run.smithi188.stdout:2334 punch from 0x47f7200 to 0x4805e00, (0xec00 bytes) 2024-09-14T08:41:03.872 INFO:teuthology.orchestra.run.smithi188.stdout:2338 punch from 0x41e3400 to 0x41eea00, (0xb600 bytes) 2024-09-14T08:41:03.887 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:03.889+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:03.911 INFO:teuthology.orchestra.run.smithi188.stdout:2339 write 0x6b8e600 thru 0x6b92e68 (0x4869 bytes) 2024-09-14T08:41:03.913 INFO:teuthology.orchestra.run.smithi188.stdout:2340 punch from 0x4de6600 to 0x4df2800, (0xc200 bytes) 2024-09-14T08:41:03.914 INFO:teuthology.orchestra.run.smithi188.stdout:2342 write 0x5741000 thru 0x574d029 (0xc02a bytes) 2024-09-14T08:41:03.915 INFO:teuthology.orchestra.run.smithi188.stdout:2347 read 0x33cfc00 thru 0x33d1c05 (0x2006 bytes) 2024-09-14T08:41:03.919 INFO:teuthology.orchestra.run.smithi188.stdout:2348 trunc from 0x6b93000 to 0x8451600 2024-09-14T08:41:03.961 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:03.963+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:03.976 INFO:teuthology.orchestra.run.smithi188.stdout:2349 write 0x56e6c00 thru 0x56ea5ef (0x39f0 bytes) 2024-09-14T08:41:04.003 INFO:teuthology.orchestra.run.smithi188.stdout:2350 write 0x9524a00 thru 0x9525f69 (0x156a bytes) 2024-09-14T08:41:04.005 INFO:teuthology.orchestra.run.smithi188.stdout:2352 read 0x7f8e00 thru 0x800b45 (0x7d46 bytes) 2024-09-14T08:41:04.006 INFO:teuthology.orchestra.run.smithi188.stdout:2354 read 0x3f2b000 thru 0x3f30cdc (0x5cdd bytes) 2024-09-14T08:41:04.006 INFO:teuthology.orchestra.run.smithi188.stdout:2355 read 0x5fa4e00 thru 0x5fa553b (0x73c bytes) 2024-09-14T08:41:04.006 INFO:teuthology.orchestra.run.smithi188.stdout:2356 read 0x90e5c00 thru 0x90f2f97 (0xd398 bytes) 2024-09-14T08:41:04.007 INFO:teuthology.orchestra.run.smithi188.stdout:2360 write 0x4254800 thru 0x426193e (0xd13f bytes) 2024-09-14T08:41:04.041 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:04.041 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:04.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:04.061 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:04.061+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:04.061 INFO:teuthology.orchestra.run.smithi188.stdout:2361 write 0x96f0800 thru 0x96fa36d (0x9b6e bytes) 2024-09-14T08:41:04.073 INFO:teuthology.orchestra.run.smithi188.stdout:2362 trunc from 0x96fa400 to 0x5c92000 2024-09-14T08:41:04.138 INFO:teuthology.orchestra.run.smithi188.stdout:2365 read 0x37f0600 thru 0x37f68c2 (0x62c3 bytes) 2024-09-14T08:41:04.161 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:04.160+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:04.168 INFO:teuthology.orchestra.run.smithi188.stdout:2367 write 0xbc8fc00 thru 0xbc9dc26 (0xe027 bytes) 2024-09-14T08:41:04.170 INFO:teuthology.orchestra.run.smithi188.stdout:2368 read 0xa646200 thru 0xa64aefa (0x4cfb bytes) 2024-09-14T08:41:04.171 INFO:teuthology.orchestra.run.smithi188.stdout:2369 write 0x863b400 thru 0x86482a0 (0xcea1 bytes) 2024-09-14T08:41:04.186 INFO:teuthology.orchestra.run.smithi188.stdout:2374 trunc from 0xbc9de00 to 0x4ba4c00 2024-09-14T08:41:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:04.195 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:04.211 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:04.263 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:04.260+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:04.312 INFO:teuthology.orchestra.run.smithi188.stdout:2375 write 0xc926e00 thru 0xc931a2f (0xac30 bytes) 2024-09-14T08:41:04.314 INFO:teuthology.orchestra.run.smithi188.stdout:2376 write 0x432da00 thru 0x4334ba1 (0x71a2 bytes) 2024-09-14T08:41:04.316 INFO:teuthology.orchestra.run.smithi188.stdout:2377 read 0x68a1800 thru 0x68a2477 (0xc78 bytes) 2024-09-14T08:41:04.316 INFO:teuthology.orchestra.run.smithi188.stdout:2383 read 0x4d1aa00 thru 0x4d23863 (0x8e64 bytes) 2024-09-14T08:41:04.317 INFO:teuthology.orchestra.run.smithi188.stdout:2384 read 0x2206200 thru 0x220e3ff (0x8200 bytes) 2024-09-14T08:41:04.317 INFO:teuthology.orchestra.run.smithi188.stdout:2385 write 0x377a800 thru 0x3789a16 (0xf217 bytes) 2024-09-14T08:41:04.317 INFO:teuthology.orchestra.run.smithi188.stdout:2386 write 0x3779800 thru 0x378299b (0x919c bytes) 2024-09-14T08:41:04.317 INFO:teuthology.orchestra.run.smithi188.stdout:2389 read 0x4d2cc00 thru 0x4d2fe1c (0x321d bytes) 2024-09-14T08:41:04.317 INFO:teuthology.orchestra.run.smithi188.stdout:2390 punch from 0x3361000 to 0x3361600, (0x600 bytes) 2024-09-14T08:41:04.323 INFO:teuthology.orchestra.run.smithi188.stdout:2391 trunc from 0xc931c00 to 0xa6ee200 2024-09-14T08:41:04.344 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:04.344 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:04.361 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:04.363 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:04.364+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:04.389 INFO:teuthology.orchestra.run.smithi188.stdout:2392 read 0x8659400 thru 0x865d0e0 (0x3ce1 bytes) 2024-09-14T08:41:04.391 INFO:teuthology.orchestra.run.smithi188.stdout:2394 read 0x6f0d800 thru 0x6f15de3 (0x85e4 bytes) 2024-09-14T08:41:04.412 INFO:teuthology.orchestra.run.smithi188.stdout:2395 trunc from 0xa6ee200 to 0x22d2400 2024-09-14T08:41:04.456 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:04.485 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:04.485 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:04.489 INFO:teuthology.orchestra.run.smithi188.stdout:2396 trunc from 0x22d2400 to 0xfd5c00 2024-09-14T08:41:04.500 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:04.503 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:04.504+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:04.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:41:04.564 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:04.563+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:04.595 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout:2397 write 0xea1a200 thru 0xea209e9 (0x67ea bytes) 2024-09-14T08:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout:2398 trunc from 0xea20a00 to 0xd01dc00 2024-09-14T08:41:04.619 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:04.619 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:04.634 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:04.634 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:04.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:04.693 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:04.695+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:04.711 INFO:teuthology.orchestra.run.smithi188.stdout:2403 trunc from 0xd01dc00 to 0x1ad600 2024-09-14T08:41:04.766 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:04.767+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:04.818 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:04.819 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:04.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:04.852 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:04.853 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:04.881 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:04.883+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:04.884 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:04.884 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:04.917 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:04.917 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:04.940 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:04.941 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:04.943 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:04.944 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:04.968 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:04.971+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:05.014 INFO:teuthology.orchestra.run.smithi188.stdout:2404 write 0xd843c00 thru 0xd84f578 (0xb979 bytes) 2024-09-14T08:41:05.016 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:05.016 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:05.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:05.016 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:05.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.016 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.016 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:41:05.016 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.130350837999998, 2024-09-14T08:41:05.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.119098803, 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:41:05.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.118238918000003, 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:41:05.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:41:05.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.117932293000003, 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:05.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:41:05.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.117528958000001, 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.035 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:41:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.117125254999998, 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:41:05.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:41:05.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:05.044 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.116774509000003, 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:05.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:41:05.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.116388237000002, 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.049 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:41:05.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:41:05.053 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.116197704000001, 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.054 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:41:05.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:41:05.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:41:05.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:41:05.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:41:05.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.115690976000003, 2024-09-14T08:41:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:05.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:41:05.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.115364904000003, 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.065 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:41:05.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.065 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:05.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.115055292000001, 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.069 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:41:05.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.073 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.114559749999998, 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:41:05.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:41:05.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.078 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.114243991999999, 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.079 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:41:05.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.113756555999998, 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.084 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:41:05.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:41:05.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.113406544, 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:05.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.112615425000001, 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.094 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.098 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.112206366000002, 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:41:05.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.109573679, 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.103 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:41:05.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.107 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.283083038000001, 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:05.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:41:05.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:05.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:05.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.115 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.115 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:05.117 INFO:teuthology.orchestra.run.smithi188.stdout:2405 read 0x2e95000 thru 0x2e9984c (0x484d bytes) 2024-09-14T08:41:05.117 INFO:teuthology.orchestra.run.smithi188.stdout:2406 trunc from 0xd84f600 to 0xddeac00 2024-09-14T08:41:05.117 INFO:teuthology.orchestra.run.smithi188.stdout:2407 read 0x4073400 thru 0x4076c69 (0x386a bytes) 2024-09-14T08:41:05.117 INFO:teuthology.orchestra.run.smithi188.stdout:2409 write 0xb93bc00 thru 0xb949962 (0xdd63 bytes) 2024-09-14T08:41:05.117 INFO:teuthology.orchestra.run.smithi188.stdout:2410 write 0x43d3800 thru 0x43d69ae (0x31af bytes) 2024-09-14T08:41:05.117 INFO:teuthology.orchestra.run.smithi188.stdout:2414 trunc from 0xddeac00 to 0x3feb200 2024-09-14T08:41:05.117 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:05.118 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:05.115+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:05.214 INFO:teuthology.orchestra.run.smithi188.stdout:2415 read 0x2d88400 thru 0x2d946f2 (0xc2f3 bytes) 2024-09-14T08:41:05.216 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:05.219+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:05.217 INFO:teuthology.orchestra.run.smithi188.stdout:2417 punch from 0x3c17000 to 0x3c17200, (0x200 bytes) 2024-09-14T08:41:05.217 INFO:teuthology.orchestra.run.smithi188.stdout:2418 punch from 0x303a200 to 0x3049400, (0xf200 bytes) 2024-09-14T08:41:05.218 INFO:teuthology.orchestra.run.smithi188.stdout:2421 read 0x27f0e00 thru 0x27fe6a2 (0xd8a3 bytes) 2024-09-14T08:41:05.218 INFO:teuthology.orchestra.run.smithi188.stdout:2422 punch from 0x7dfa00 to 0x7ed200, (0xd800 bytes) 2024-09-14T08:41:05.219 INFO:teuthology.orchestra.run.smithi188.stdout:2423 punch from 0x1fc2400 to 0x1fccc00, (0xa800 bytes) 2024-09-14T08:41:05.296 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:05.297 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:05.311 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:05.313 INFO:teuthology.orchestra.run.smithi188.stdout:2425 write 0xa514400 thru 0xa519d24 (0x5925 bytes) 2024-09-14T08:41:05.320 INFO:teuthology.orchestra.run.smithi188.stdout:2427 trunc from 0xa519e00 to 0x89e2400 2024-09-14T08:41:05.353 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:05.355+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:05.393 INFO:teuthology.orchestra.run.smithi188.stdout:2428 trunc from 0x89e2400 to 0xec29e00 2024-09-14T08:41:05.416 INFO:teuthology.orchestra.run.smithi188.stdout:2430 punch from 0x2a7400 to 0x2b6400, (0xf000 bytes) 2024-09-14T08:41:05.417 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:05.419+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:05.418 INFO:teuthology.orchestra.run.smithi188.stdout:2432 read 0x6958c00 thru 0x6960d08 (0x8109 bytes) 2024-09-14T08:41:05.419 INFO:teuthology.orchestra.run.smithi188.stdout:2434 read 0x61b6400 thru 0x61ba688 (0x4289 bytes) 2024-09-14T08:41:05.419 INFO:teuthology.orchestra.run.smithi188.stdout:2436 read 0x771c600 thru 0x771e787 (0x2188 bytes) 2024-09-14T08:41:05.419 INFO:teuthology.orchestra.run.smithi188.stdout:2438 punch from 0xb72a000 to 0xb72cc00, (0x2c00 bytes) 2024-09-14T08:41:05.420 INFO:teuthology.orchestra.run.smithi188.stdout:2441 write 0x5ca7800 thru 0x5cabe5c (0x465d bytes) 2024-09-14T08:41:05.420 INFO:teuthology.orchestra.run.smithi188.stdout:2444 write 0x6d1a400 thru 0x6d1e388 (0x3f89 bytes) 2024-09-14T08:41:05.421 INFO:teuthology.orchestra.run.smithi188.stdout:2451 flatten 2024-09-14T08:41:05.485 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:05.485 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:05.485 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:05.485 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:05.485 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:05.499 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:05.509 INFO:teuthology.orchestra.run.smithi188.stdout:2452 read 0x2361c00 thru 0x2369cbe (0x80bf bytes) 2024-09-14T08:41:05.509 INFO:teuthology.orchestra.run.smithi188.stdout:2455 read 0xb148600 thru 0xb14ccb0 (0x46b1 bytes) 2024-09-14T08:41:05.509 INFO:teuthology.orchestra.run.smithi188.stdout:2456 write 0x795b000 thru 0x795d898 (0x2899 bytes) 2024-09-14T08:41:05.509 INFO:teuthology.orchestra.run.smithi188.stdout:2457 write 0x5d92c00 thru 0x5d9c596 (0x9997 bytes) 2024-09-14T08:41:05.516 INFO:teuthology.orchestra.run.smithi188.stdout:2458 trunc from 0xec29e00 to 0xc41f800 2024-09-14T08:41:05.541 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:05.543+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:05.546 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:41:05.579 INFO:teuthology.orchestra.run.smithi188.stdout:2460 write 0x8c8400 thru 0x8cb0a8 (0x2ca9 bytes) 2024-09-14T08:41:05.587 INFO:teuthology.orchestra.run.smithi188.stdout:2462 trunc from 0xc41f800 to 0xa9f3600 2024-09-14T08:41:05.619 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:05.620+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:05.631 INFO:teuthology.orchestra.run.smithi188.stdout:2463 write 0x32a3400 thru 0x32b0778 (0xd379 bytes) 2024-09-14T08:41:05.633 INFO:teuthology.orchestra.run.smithi188.stdout:2464 read 0x7ab2a00 thru 0x7ab9811 (0x6e12 bytes) 2024-09-14T08:41:05.635 INFO:teuthology.orchestra.run.smithi188.stdout:2466 read 0x7ef8800 thru 0x7f064a9 (0xdcaa bytes) 2024-09-14T08:41:05.635 INFO:teuthology.orchestra.run.smithi188.stdout:2468 write 0x33e8c00 thru 0x33eef9b (0x639c bytes) 2024-09-14T08:41:05.635 INFO:teuthology.orchestra.run.smithi188.stdout:2469 punch from 0x3004000 to 0x3013400, (0xf400 bytes) 2024-09-14T08:41:05.637 INFO:teuthology.orchestra.run.smithi188.stdout:2470 read 0x6cc5e00 thru 0x6cd2493 (0xc694 bytes) 2024-09-14T08:41:05.640 INFO:teuthology.orchestra.run.smithi188.stdout:2474 write 0x1861c00 thru 0x18631b5 (0x15b6 bytes) 2024-09-14T08:41:05.674 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:05.674 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:05.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:05.674 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:05.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.674 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54089 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5655552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.674 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:41:05.674 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.597167440000007, 2024-09-14T08:41:05.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096364895000000006, 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54089 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:41:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078651+0000", 2024-09-14T08:41:05.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078652+0000", 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078655+0000", 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078668+0000", 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2405000000000001e-05 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078680+0000", 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2736e-05 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174418+0000", 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095737992999999993 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.174648+0000", 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022988899999999999 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175016+0000", 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036784900000000001 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.597079343000004, 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:41:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:41:05.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.597011945999995, 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:05.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.596938249999994, 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.689 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:41:05.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:41:05.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:41:05.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:41:05.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:41:05.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:41:05.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.693 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.596862778000002, 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.694 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.695 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:41:05.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.695 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:05.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.596805574000001, 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:05.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:41:05.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:41:05.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.596746690000003, 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:41:05.704 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.596681763999996, 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:41:05.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:41:05.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.596620313000003, 2024-09-14T08:41:05.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:41:05.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:41:05.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:41:05.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.720 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.720 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.596560779000001, 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:41:05.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:41:05.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.596501469000003, 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.725 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:41:05.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.596429436999998, 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:41:05.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:41:05.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24681 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3076096~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:41:05.734 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.442094544, 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096091748000000005, 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24681 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:41:05.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233724+0000", 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233725+0000", 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.017e-06 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233735+0000", 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8430000000000005e-06 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233746+0000", 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1409e-05 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233756+0000", 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5230000000000001e-06 2024-09-14T08:41:05.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329376+0000", 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095619941 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329544+0000", 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000168269 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329816+0000", 2024-09-14T08:41:05.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027174600000000001 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24682 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.442020597999999, 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096544940999999995, 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.739 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24682 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233798+0000", 2024-09-14T08:41:05.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233799+0000", 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.08e-06 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233803+0000", 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4429999999999999e-06 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233816+0000", 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3816e-05 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233824+0000", 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5859999999999999e-06 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.329882+0000", 2024-09-14T08:41:05.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096058344000000004 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330073+0000", 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019082999999999999 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330343+0000", 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026984200000000001 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.441981943000002, 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:05.744 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:41:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.441951164999999, 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:05.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.441885462000002, 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:05.754 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:41:05.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.441763291000001, 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:41:05.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:41:05.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.44172906, 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:41:05.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.767 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.441697634999997, 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:05.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:41:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:41:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:05.772 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:05.774 INFO:teuthology.orchestra.run.smithi188.stdout:2476 write 0xe916400 thru 0xe91777b (0x137c bytes) 2024-09-14T08:41:05.774 INFO:teuthology.orchestra.run.smithi188.stdout:2478 read 0x9373a00 thru 0x937b789 (0x7d8a bytes) 2024-09-14T08:41:05.775 INFO:teuthology.orchestra.run.smithi188.stdout:2482 trunc from 0xe917800 to 0x57d5400 2024-09-14T08:41:05.775 INFO:teuthology.orchestra.run.smithi188.stdout:2484 read 0x18ab400 thru 0x18abceb (0x8ec bytes) 2024-09-14T08:41:05.775 INFO:teuthology.orchestra.run.smithi188.stdout:2486 read 0x3890000 thru 0x389e334 (0xe335 bytes) 2024-09-14T08:41:05.775 INFO:teuthology.orchestra.run.smithi188.stdout:2489 punch from 0x82a00 to 0x8ae00, (0x8400 bytes) 2024-09-14T08:41:05.775 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:05.775+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:05.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:05.784 INFO:teuthology.orchestra.run.smithi188.stdout:2491 trunc from 0x57d5400 to 0x13a3a00 2024-09-14T08:41:05.860 INFO:teuthology.orchestra.run.smithi188.stdout:2492 trunc from 0x13a3a00 to 0x83b6000 2024-09-14T08:41:05.874 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:05.875+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:05.876 INFO:teuthology.orchestra.run.smithi188.stdout:2493 write 0x3d5fc00 thru 0x3d65cee (0x60ef bytes) 2024-09-14T08:41:05.881 INFO:teuthology.orchestra.run.smithi188.stdout:2496 trunc from 0x83b6000 to 0x6124e00 2024-09-14T08:41:05.915 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:05.916 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:05.918 INFO:teuthology.orchestra.run.smithi188.stdout:2497 punch from 0x2001c00 to 0x2010800, (0xec00 bytes) 2024-09-14T08:41:05.920 INFO:teuthology.orchestra.run.smithi188.stdout:2498 punch from 0x5cdae00 to 0x5cde200, (0x3400 bytes) 2024-09-14T08:41:05.921 INFO:teuthology.orchestra.run.smithi188.stdout:2500 read 0x3515000 thru 0x352187c (0xc87d bytes) 2024-09-14T08:41:05.921 INFO:teuthology.orchestra.run.smithi188.stdout:2501 punch from 0x4971800 to 0x497d400, (0xbc00 bytes) 2024-09-14T08:41:05.933 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:05.939 INFO:teuthology.orchestra.run.smithi188.stdout:2505 trunc from 0x6124e00 to 0xc6d3c00 2024-09-14T08:41:05.979 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:05.980+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:05.982 INFO:teuthology.orchestra.run.smithi188.stdout:2506 write 0x23ca000 thru 0x23d795a (0xd95b bytes) 2024-09-14T08:41:05.985 INFO:teuthology.orchestra.run.smithi188.stdout:2508 write 0x26b4200 thru 0x26bc580 (0x8381 bytes) 2024-09-14T08:41:05.985 INFO:teuthology.orchestra.run.smithi188.stdout:2510 punch from 0xa325600 to 0xa32b800, (0x6200 bytes) 2024-09-14T08:41:05.992 INFO:teuthology.orchestra.run.smithi188.stdout:2511 trunc from 0xc6d3c00 to 0x98bb200 2024-09-14T08:41:06.060 INFO:teuthology.orchestra.run.smithi188.stdout:2512 read 0x2b71200 thru 0x2b808a1 (0xf6a2 bytes) 2024-09-14T08:41:06.062 INFO:teuthology.orchestra.run.smithi188.stdout:2514 read 0x2dc5400 thru 0x2dccd4f (0x7950 bytes) 2024-09-14T08:41:06.069 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:06.069 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:06.069 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:06.069 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:06.069 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:06.075 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:06.076+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:06.076 INFO:teuthology.orchestra.run.smithi188.stdout:2515 trunc from 0x98bb200 to 0x45c9200 2024-09-14T08:41:06.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:06.108 INFO:teuthology.orchestra.run.smithi188.stdout:2516 read 0xe5fa00 thru 0xe6c0a3 (0xc6a4 bytes) 2024-09-14T08:41:06.110 INFO:teuthology.orchestra.run.smithi188.stdout:2518 punch from 0x3c4b800 to 0x3c58a00, (0xd200 bytes) 2024-09-14T08:41:06.111 INFO:teuthology.orchestra.run.smithi188.stdout:2519 read 0x41b5800 thru 0x41c3802 (0xe003 bytes) 2024-09-14T08:41:06.111 INFO:teuthology.orchestra.run.smithi188.stdout:2520 clone 21 order 22 su 1048576 sc 10 2024-09-14T08:41:06.177 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:06.179+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:06.244 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:06.244 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:06.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:06.244 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:06.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.244 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.244 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.318490715999999, 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:41:06.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.318468159999995, 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.249 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:41:06.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:41:06.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:41:06.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:41:06.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:41:06.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.318400144999998, 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.254 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:06.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.258 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.318350417000005, 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:41:06.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:41:06.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.318299261999996, 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.263 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:41:06.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.318247259000003, 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:41:06.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:41:06.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:41:06.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:41:06.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.318184689000006, 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:41:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:41:06.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.318118111000004, 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:06.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.318040327000006, 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:41:06.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.317987631999998, 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:41:06.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.317941978999997, 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.292 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.317895508000007, 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.296 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.317849519999996, 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:41:06.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.317821261999995, 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.317766484000003, 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:41:06.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.889996025000002, 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.314 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.318 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.897391958, 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:41:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.896553587, 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:41:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:25957 3.6 3:63e7fb75:::rbd_object_map.10f1b8e048d3:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:06.328 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.0200991340000001, 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072282491000000004, 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 25957 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224018+0000", 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224025+0000", 2024-09-14T08:41:06.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4529999999999999e-06 2024-09-14T08:41:06.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224045+0000", 2024-09-14T08:41:06.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0115999999999998e-05 2024-09-14T08:41:06.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224061+0000", 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5892999999999998e-05 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.291466+0000", 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067405667000000002 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.291546+0000", 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9741999999999996e-05 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.295946+0000", 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0043998860000000004 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.296085+0000", 2024-09-14T08:41:06.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013912899999999999 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.296300+0000", 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214582 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:25958 3.6 3:63e7fb75:::rbd_object_map.10f1b8e048d3:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.0200341799999999, 2024-09-14T08:41:06.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073197778000000005, 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 25958 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:06.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224083+0000", 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1000000000000001e-06 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224090+0000", 2024-09-14T08:41:06.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5570000000000001e-06 2024-09-14T08:41:06.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224110+0000", 2024-09-14T08:41:06.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9825000000000001e-05 2024-09-14T08:41:06.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224126+0000", 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5874000000000001e-05 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.293676+0000", 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069550314000000002 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.293764+0000", 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7631000000000002e-05 2024-09-14T08:41:06.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297122+0000", 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033583250000000001 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297194+0000", 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2593000000000001e-05 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297280+0000", 2024-09-14T08:41:06.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5558999999999999e-05 2024-09-14T08:41:06.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.341 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.341 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.341 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:06.343 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:06.343 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:06.343+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:06.444 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:06.447+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:06.469 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:06.469 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:06.469 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:06.469 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:06.483 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:06.544 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:06.544+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:06.605 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:06.605 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:06.605 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:06.605 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:06.605 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:06.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:06.645 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:06.647+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:06.746 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:06.744+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:06.793 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.793 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.515090237999999, 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:41:06.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.515061442000004, 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.798 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:41:06.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.515032622999996, 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.803 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:41:06.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:41:06.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.515004293999993, 2024-09-14T08:41:06.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.811 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514975093999993, 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.812 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:41:06.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514943086000002, 2024-09-14T08:41:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:41:06.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.820 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514913809999996, 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.821 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.825 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514884144000007, 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:41:06.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514855600999994, 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.830 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:41:06.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514827295000003, 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:41:06.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514782027999999, 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:41:06.839 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:41:06.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.843 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514750406000005, 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.844 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:41:06.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:41:06.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514692593999996, 2024-09-14T08:41:06.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:06.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:41:06.852 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514624581000007, 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.853 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:06.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.857 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514589208999993, 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:41:06.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.514554810000007, 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.862 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:41:06.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.487484256999998, 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.867 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:06.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:06.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.873 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:06.873 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:06.873 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 24.225374078000002, 2024-09-14T08:41:06.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:06.873 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.873 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.873 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.873 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:06.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:06.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 24.225226907, 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:06.878 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.879 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.879 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.879 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.879 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:06.879 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:06.879 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:06.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.879 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:06.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:06.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.883 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 24.225085107000002, 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:06.884 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:06.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:06.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:06.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.889 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:06.889 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:06.889 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:06.890 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:06.891 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:06.891+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:06.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:06.991 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:06.991+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:07.022 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:07.022 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:07.023 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:07.023 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:07.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:07.084 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:07.103 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:07.103 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:07.120 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:07.120 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:07.129 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:07.131+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:07.137 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:07.150 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-14T08:41:07.155 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:07.174 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:07.174 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:07.177 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:07.178 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:07.192 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:07.191+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:07.199 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:07.199 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:07.213 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:07.288 INFO:teuthology.orchestra.run.smithi188.stdout:2521 write 0x886ea00 thru 0x8877965 (0x8f66 bytes) 2024-09-14T08:41:07.290 INFO:teuthology.orchestra.run.smithi188.stdout:2522 write 0x458ea00 thru 0x4599e5d (0xb45e bytes) 2024-09-14T08:41:07.290 INFO:teuthology.orchestra.run.smithi188.stdout:2523 write 0x2407400 thru 0x24080e1 (0xce2 bytes) 2024-09-14T08:41:07.293 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:07.292+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:07.348 INFO:teuthology.orchestra.run.smithi188.stdout:2525 trunc from 0x8877a00 to 0xe9df400 2024-09-14T08:41:07.386 INFO:teuthology.orchestra.run.smithi188.stdout:2528 write 0xdcfe800 thru 0xdd0c309 (0xdb0a bytes) 2024-09-14T08:41:07.387 INFO:teuthology.orchestra.run.smithi188.stdout:2530 read 0x5e6c00 thru 0x5ea571 (0x3972 bytes) 2024-09-14T08:41:07.389 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:07.389 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:07.394 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:07.395+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:07.404 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:07.440 INFO:teuthology.orchestra.run.smithi188.stdout:2531 trunc from 0xe9df400 to 0x1b56e00 2024-09-14T08:41:07.496 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:07.496+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:07.552 INFO:teuthology.orchestra.run.smithi188.stdout:2533 write 0x1e0a800 thru 0x1e0bba9 (0x13aa bytes) 2024-09-14T08:41:07.562 INFO:teuthology.orchestra.run.smithi188.stdout:2534 read 0x33ba00 thru 0x3421fe (0x67ff bytes) 2024-09-14T08:41:07.568 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5] out_osds: [3] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:41:07.569 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:41:07.569 INFO:tasks.thrashosds.thrasher:Removing osd 0, in_osds are: [0, 1, 2, 4, 5] 2024-09-14T08:41:07.569 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 0 2024-09-14T08:41:07.577 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:07.577 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:07.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:41:07.593 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:07.605 INFO:teuthology.orchestra.run.smithi188.stdout:2537 write 0x9702c00 thru 0x970b784 (0x8b85 bytes) 2024-09-14T08:41:07.609 INFO:teuthology.orchestra.run.smithi188.stdout:2538 read 0x8607800 thru 0x86139b2 (0xc1b3 bytes) 2024-09-14T08:41:07.609 INFO:teuthology.orchestra.run.smithi188.stdout:2539 read 0x6e3ce00 thru 0x6e43f3c (0x713d bytes) 2024-09-14T08:41:07.637 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:07.639+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:07.641 INFO:teuthology.orchestra.run.smithi188.stdout:2541 write 0xe753400 thru 0xe75e77d (0xb37e bytes) 2024-09-14T08:41:07.656 INFO:teuthology.orchestra.run.smithi188.stdout:2543 trunc from 0xe75e800 to 0x8de2200 2024-09-14T08:41:07.680 INFO:teuthology.orchestra.run.smithi188.stdout:2546 read 0x717da00 thru 0x7185270 (0x7871 bytes) 2024-09-14T08:41:07.682 INFO:teuthology.orchestra.run.smithi188.stdout:2548 read 0x4376c00 thru 0x437eae8 (0x7ee9 bytes) 2024-09-14T08:41:07.685 INFO:teuthology.orchestra.run.smithi188.stdout:2551 trunc from 0x8de2200 to 0xad7a400 2024-09-14T08:41:07.696 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:07.696+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:07.704 INFO:teuthology.orchestra.run.smithi188.stdout:2553 read 0x3845800 thru 0x384658f (0xd90 bytes) 2024-09-14T08:41:07.712 INFO:teuthology.orchestra.run.smithi188.stdout:2554 read 0x1070600 thru 0x1070b9f (0x5a0 bytes) 2024-09-14T08:41:07.712 INFO:teuthology.orchestra.run.smithi188.stdout:2555 read 0x4243600 thru 0x4250ec6 (0xd8c7 bytes) 2024-09-14T08:41:07.713 INFO:teuthology.orchestra.run.smithi188.stdout:2558 write 0x90d8800 thru 0x90dfa74 (0x7275 bytes) 2024-09-14T08:41:07.713 INFO:teuthology.orchestra.run.smithi188.stdout:2560 punch from 0xabd7600 to 0xabe1800, (0xa200 bytes) 2024-09-14T08:41:07.714 INFO:teuthology.orchestra.run.smithi188.stdout:2561 read 0x11a00 thru 0x142f0 (0x28f1 bytes) 2024-09-14T08:41:07.716 INFO:teuthology.orchestra.run.smithi188.stdout:2565 write 0x67a8a00 thru 0x67b71be (0xe7bf bytes) 2024-09-14T08:41:07.716 INFO:teuthology.orchestra.run.smithi188.stdout:2566 read 0x8579a00 thru 0x85818fc (0x7efd bytes) 2024-09-14T08:41:07.716 INFO:teuthology.orchestra.run.smithi188.stdout:2567 read 0x950200 thru 0x957385 (0x7186 bytes) 2024-09-14T08:41:07.717 INFO:teuthology.orchestra.run.smithi188.stdout:2568 read 0xa58f600 thru 0xa5944ed (0x4eee bytes) 2024-09-14T08:41:07.717 INFO:teuthology.orchestra.run.smithi188.stdout:2572 write 0x9eccc00 thru 0x9ed75dd (0xa9de bytes) 2024-09-14T08:41:07.717 INFO:teuthology.orchestra.run.smithi188.stdout:2576 write 0x4faaa00 thru 0x4fb95b2 (0xebb3 bytes) 2024-09-14T08:41:07.734 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:07.734 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:07.743 INFO:teuthology.orchestra.run.smithi188.stdout:2577 write 0xc89be00 thru 0xc8a2432 (0x6633 bytes) 2024-09-14T08:41:07.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:07.760 INFO:teuthology.orchestra.run.smithi188.stdout:2579 trunc from 0xc8a2600 to 0x421ae00 2024-09-14T08:41:07.797 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:07.796+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:07.898 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:07.899+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:07.902 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-14T08:41:07.900+0000 7f7148add640 -1 mon.a@0(leader).osd e94 definitely_dead 0 2024-09-14T08:41:07.909 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:07.909 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:07.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:08.009 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:08.011+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:08.060 INFO:teuthology.orchestra.run.smithi188.stdout:2584 write 0x4cd5200 thru 0x4cd6531 (0x1332 bytes) 2024-09-14T08:41:08.089 INFO:teuthology.orchestra.run.smithi188.stdout:2587 trunc from 0x4cd6600 to 0xe97d200 2024-09-14T08:41:08.089 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:08.089 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:08.100 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:08.099+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:08.105 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:08.112 INFO:teuthology.orchestra.run.smithi188.stdout:2589 write 0x46c8e00 thru 0x46cdaaf (0x4cb0 bytes) 2024-09-14T08:41:08.115 INFO:teuthology.orchestra.run.smithi188.stdout:2592 punch from 0xe4b800 to 0xe52e00, (0x7600 bytes) 2024-09-14T08:41:08.115 INFO:teuthology.orchestra.run.smithi188.stdout:2594 read 0x938da00 thru 0x9393166 (0x5767 bytes) 2024-09-14T08:41:08.116 INFO:teuthology.orchestra.run.smithi188.stdout:2597 punch from 0xa992800 to 0xa99b600, (0x8e00 bytes) 2024-09-14T08:41:08.116 INFO:teuthology.orchestra.run.smithi188.stdout:2600 write 0xbd8ba00 thru 0xbd95d70 (0xa371 bytes) 2024-09-14T08:41:08.116 INFO:teuthology.orchestra.run.smithi188.stdout:2603 read 0xdaa8200 thru 0xdaad5c5 (0x53c6 bytes) 2024-09-14T08:41:08.116 INFO:teuthology.orchestra.run.smithi188.stdout:2607 punch from 0xabe1a00 to 0xabf1000, (0xf600 bytes) 2024-09-14T08:41:08.117 INFO:teuthology.orchestra.run.smithi188.stdout:2610 punch from 0xbf97600 to 0xbf9b600, (0x4000 bytes) 2024-09-14T08:41:08.117 INFO:teuthology.orchestra.run.smithi188.stdout:2613 read 0x19cb600 thru 0x19d2e80 (0x7881 bytes) 2024-09-14T08:41:08.121 INFO:teuthology.orchestra.run.smithi188.stdout:2614 trunc from 0xe97d200 to 0xcc47600 2024-09-14T08:41:08.172 INFO:teuthology.orchestra.run.smithi188.stdout:2615 write 0xe78be00 thru 0xe7954f4 (0x96f5 bytes) 2024-09-14T08:41:08.173 INFO:teuthology.orchestra.run.smithi188.stdout:2617 read 0x5752800 thru 0x575ce67 (0xa668 bytes) 2024-09-14T08:41:08.181 INFO:teuthology.orchestra.run.smithi188.stdout:2618 trunc from 0xe795600 to 0xbdc6000 2024-09-14T08:41:08.200 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:08.199+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:08.216 INFO:teuthology.orchestra.run.smithi188.stdout:2622 read 0x7e48600 thru 0x7e551b3 (0xcbb4 bytes) 2024-09-14T08:41:08.221 INFO:teuthology.orchestra.run.smithi188.stdout:2623 trunc from 0xbdc6000 to 0xc653400 2024-09-14T08:41:08.240 INFO:teuthology.orchestra.run.smithi188.stdout:2624 write 0x13f0600 thru 0x13fc7d4 (0xc1d5 bytes) 2024-09-14T08:41:08.266 INFO:teuthology.orchestra.run.smithi188.stdout:2625 trunc from 0xc653400 to 0x3392000 2024-09-14T08:41:08.283 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:08.283 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:08.299 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:08.301 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:08.300+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:08.336 INFO:teuthology.orchestra.run.smithi188.stdout:2629 write 0xc649400 thru 0xc651f27 (0x8b28 bytes) 2024-09-14T08:41:08.344 INFO:teuthology.orchestra.run.smithi188.stdout:2630 trunc from 0xc652000 to 0xa775400 2024-09-14T08:41:08.396 INFO:teuthology.orchestra.run.smithi188.stdout:2631 write 0xbe34a00 thru 0xbe3b038 (0x6639 bytes) 2024-09-14T08:41:08.397 INFO:teuthology.orchestra.run.smithi188.stdout:2632 punch from 0x7f3200 to 0x7f6400, (0x3200 bytes) 2024-09-14T08:41:08.398 INFO:teuthology.orchestra.run.smithi188.stdout:2633 read 0xb855800 thru 0xb85f0ec (0x98ed bytes) 2024-09-14T08:41:08.398 INFO:teuthology.orchestra.run.smithi188.stdout:2635 write 0x3c26a00 thru 0x3c28e13 (0x2414 bytes) 2024-09-14T08:41:08.399 INFO:teuthology.orchestra.run.smithi188.stdout:2638 read 0x4afd600 thru 0x4b0d2d4 (0xfcd5 bytes) 2024-09-14T08:41:08.399 INFO:teuthology.orchestra.run.smithi188.stdout:2639 read 0xa907400 thru 0xa908b78 (0x1779 bytes) 2024-09-14T08:41:08.400 INFO:teuthology.orchestra.run.smithi188.stdout:2642 read 0x3490200 thru 0x34995bc (0x93bd bytes) 2024-09-14T08:41:08.400 INFO:teuthology.orchestra.run.smithi188.stdout:2643 read 0x8349c00 thru 0x8356875 (0xcc76 bytes) 2024-09-14T08:41:08.400 INFO:teuthology.orchestra.run.smithi188.stdout:2644 write 0xd12000 thru 0xd15d52 (0x3d53 bytes) 2024-09-14T08:41:08.401 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:08.403+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:08.401 INFO:teuthology.orchestra.run.smithi188.stdout:2647 read 0x756d800 thru 0x757924b (0xba4c bytes) 2024-09-14T08:41:08.401 INFO:teuthology.orchestra.run.smithi188.stdout:2649 write 0x10c4e00 thru 0x10c8c82 (0x3e83 bytes) 2024-09-14T08:41:08.402 INFO:teuthology.orchestra.run.smithi188.stdout:2650 flatten 2024-09-14T08:41:08.426 INFO:teuthology.orchestra.run.smithi188.stdout:2651 write 0x30ab200 thru 0x30b89a4 (0xd7a5 bytes) 2024-09-14T08:41:08.426 INFO:teuthology.orchestra.run.smithi188.stdout:2652 read 0xb09a00 thru 0xb0bccd (0x22ce bytes) 2024-09-14T08:41:08.427 INFO:teuthology.orchestra.run.smithi188.stdout:2653 write 0x2cfce00 thru 0x2d0292e (0x5b2f bytes) 2024-09-14T08:41:08.427 INFO:teuthology.orchestra.run.smithi188.stdout:2654 punch from 0x9eca600 to 0x9ed0600, (0x6000 bytes) 2024-09-14T08:41:08.428 INFO:teuthology.orchestra.run.smithi188.stdout:2655 read 0x4c12000 thru 0x4c1b6a7 (0x96a8 bytes) 2024-09-14T08:41:08.429 INFO:teuthology.orchestra.run.smithi188.stdout:2657 read 0x180a800 thru 0x1811243 (0x6a44 bytes) 2024-09-14T08:41:08.430 INFO:teuthology.orchestra.run.smithi188.stdout:2658 write 0x8287600 thru 0x828982d (0x222e bytes) 2024-09-14T08:41:08.430 INFO:teuthology.orchestra.run.smithi188.stdout:2661 write 0x81c6400 thru 0x81c8875 (0x2476 bytes) 2024-09-14T08:41:08.430 INFO:teuthology.orchestra.run.smithi188.stdout:2662 punch from 0x8619a00 to 0x861f200, (0x5800 bytes) 2024-09-14T08:41:08.430 INFO:teuthology.orchestra.run.smithi188.stdout:2665 read 0xbc7ec00 thru 0xbc8d2e5 (0xe6e6 bytes) 2024-09-14T08:41:08.431 INFO:teuthology.orchestra.run.smithi188.stdout:2668 read 0x2c72400 thru 0x2c79187 (0x6d88 bytes) 2024-09-14T08:41:08.431 INFO:teuthology.orchestra.run.smithi188.stdout:2669 read 0x1c38400 thru 0x1c3873e (0x33f bytes) 2024-09-14T08:41:08.432 INFO:teuthology.orchestra.run.smithi188.stdout:2670 read 0x8684600 thru 0x868b029 (0x6a2a bytes) 2024-09-14T08:41:08.449 INFO:teuthology.orchestra.run.smithi188.stdout:2672 trunc from 0xbe3b200 to 0x212f600 2024-09-14T08:41:08.483 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:08.483 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:08.489 INFO:teuthology.orchestra.run.smithi188.stdout:2673 read 0x19cf800 thru 0x19d4915 (0x5116 bytes) 2024-09-14T08:41:08.498 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:08.501 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:08.500+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:08.536 INFO:teuthology.orchestra.run.smithi188.stdout:2674 write 0xe7c1200 thru 0xe7c8bd4 (0x79d5 bytes) 2024-09-14T08:41:08.537 INFO:teuthology.orchestra.run.smithi188.stdout:2675 write 0x24cf800 thru 0x24deec6 (0xf6c7 bytes) 2024-09-14T08:41:08.538 INFO:teuthology.orchestra.run.smithi188.stdout:2678 read 0x8528800 thru 0x8532a62 (0xa263 bytes) 2024-09-14T08:41:08.538 INFO:teuthology.orchestra.run.smithi188.stdout:2682 read 0x9a67000 thru 0x9a67471 (0x472 bytes) 2024-09-14T08:41:08.539 INFO:teuthology.orchestra.run.smithi188.stdout:2683 punch from 0x4ebb400 to 0x4ebfc00, (0x4800 bytes) 2024-09-14T08:41:08.540 INFO:teuthology.orchestra.run.smithi188.stdout:2684 write 0x5dd7c00 thru 0x5de1a54 (0x9e55 bytes) 2024-09-14T08:41:08.540 INFO:teuthology.orchestra.run.smithi188.stdout:2686 clone 22 order 20 su 4096 sc 15 2024-09-14T08:41:08.575 INFO:teuthology.orchestra.run.smithi089.stderr:marked out osd.0. 2024-09-14T08:41:08.575 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:41:08.602 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:08.603+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:08.648 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:08.648 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:08.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:08.703 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:08.704+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:08.803 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:08.804+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:08.833 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:08.904 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:08.907+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:08.999 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:08.999 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:09.005 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:09.007+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:09.014 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:09.106 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:09.107+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:09.132 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:09.132 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:09.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:09.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:09.207 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:09.207+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:09.269 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:09.269 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:09.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:09.311 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:09.311 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:09.312+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:09.331 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:09.331 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:09.349 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:09.350 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:09.370 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:09.370 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:09.390 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:09.390 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:09.408 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:09.407+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:09.410 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:09.410 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:09.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:09.410 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:09.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.410 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.410 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133583826000006, 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:41:09.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:41:09.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:41:09.415 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.415 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.415 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.415 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.415 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:09.415 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133555029999997, 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:09.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:41:09.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.420 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133526211000003, 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:09.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:41:09.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133497882, 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:41:09.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133468682, 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:41:09.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:41:09.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133436673999995, 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.434 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:41:09.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.438 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133407398000003, 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.439 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.443 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133377732, 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:41:09.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133349189, 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.448 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.452 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133320882999996, 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:41:09.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:41:09.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.457 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133275616000006, 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:41:09.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:41:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:41:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:41:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:41:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133243993999997, 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:41:09.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:41:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133186182000003, 2024-09-14T08:41:09.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:41:09.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:41:09.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133118168999999, 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.472 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:09.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:41:09.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:41:09.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:41:09.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133082797, 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.477 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:41:09.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:41:09.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.133048398, 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:41:09.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:41:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.105977844999998, 2024-09-14T08:41:09.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:09.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:09.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:09.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:09.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:09.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.492 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.843867666000001, 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:09.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.843720494999999, 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:09.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:09.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.843578695000001, 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.507 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.508 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.508 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:09.508 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:09.508 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:09.508 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:09.509 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:09.509 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:09.510 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:09.510 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:09.511 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:09.508+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:09.609 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:09.611+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:09.655 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:09.655 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:09.656 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:09.656 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:09.671 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:09.713 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:09.715+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:09.811 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:09.811+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:09.838 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:09.839 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:09.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:09.912 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:09.912+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:10.013 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:10.012+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:10.020 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.773173220999993, 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:41:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.773111208000003, 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.026 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.773044877999993, 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:41:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772989417999995, 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.035 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:10.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:41:10.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772929798000007, 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.040 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:41:10.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772848257999996, 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:41:10.044 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:41:10.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772791929999997, 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:41:10.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:10.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:41:10.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:10.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772720434999997, 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:41:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:41:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772647563999996, 2024-09-14T08:41:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772605351999999, 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:41:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772575521999997, 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772547224999997, 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:41:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:41:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:41:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772506129999996, 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:41:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:41:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:41:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772477100000003, 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772448616000005, 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:41:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772420475999994, 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:41:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:41:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772391780000007, 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:41:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772363022999997, 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:41:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:41:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772334975999996, 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:41:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:41:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.772304998999999, 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:41:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:41:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:41:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.115 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:10.116 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:10.117 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:10.116+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:10.217 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:10.216+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:10.242 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:10.242 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:10.243 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:10.243 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:10.257 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:10.318 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:10.319+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:10.381 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:10.381 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:10.395 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:10.419 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:10.420+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:10.521 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:10.520+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:10.561 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:10.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15592 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2231296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.677030162999998, 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098163117999999994, 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15592 2024-09-14T08:41:10.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886332+0000", 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886796+0000", 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046455599999999998 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886803+0000", 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.939e-06 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886820+0000", 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6889e-05 2024-09-14T08:41:10.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.886834+0000", 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3769e-05 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984168+0000", 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097334459999999998 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984261+0000", 2024-09-14T08:41:10.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2541999999999996e-05 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.984495+0000", 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023396300000000001 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15668 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2120704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:41:10.566 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.665778127999999, 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098164215999999999, 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15668 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.897584+0000", 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898050+0000", 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046574399999999998 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898057+0000", 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0469999999999996e-06 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898072+0000", 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761e-05 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898084+0000", 2024-09-14T08:41:10.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1501000000000001e-05 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995429+0000", 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097345538999999995 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995570+0000", 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014023200000000001 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.995748+0000", 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017839200000000001 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.664918243000002, 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:41:10.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.664611618000002, 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.576 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:41:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.664208283000001, 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.581 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:41:10.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:41:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.663804579999997, 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:41:10.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.663453834000002, 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:41:10.590 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:41:10.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.663067562000002, 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.595 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:41:10.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.662877029000001, 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.600 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:41:10.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:41:10.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:41:10.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:41:10.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:41:10.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.604 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.662370301000003, 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:41:10.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.662044229000003, 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.609 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:41:10.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:41:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.661734617, 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.614 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.661239074999997, 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:41:10.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:41:10.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:41:10.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:41:10.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:41:10.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:41:10.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:41:10.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:41:10.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.626 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.660923316999998, 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.627 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:41:10.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:41:10.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.631 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.660435880999998, 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:41:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.660085869, 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.636 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:41:10.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.659294750000001, 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.641 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:41:10.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:41:10.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.658885691000002, 2024-09-14T08:41:10.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:10.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:41:10.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15699 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2300928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.656253004, 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098161286, 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:10.650 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15699 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907109+0000", 2024-09-14T08:41:10.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907533+0000", 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042363900000000001 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907540+0000", 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4939999999999997e-06 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907558+0000", 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7363999999999998e-05 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.907572+0000", 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4205e-05 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.004961+0000", 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097389616999999998 2024-09-14T08:41:10.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005082+0000", 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037800000000001 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.005270+0000", 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018858899999999999 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.829762363, 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:41:10.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:41:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.661 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:10.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:41:10.664 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:10.664 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:10.663+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:10.764 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:10.763+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:10.848 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:10.848 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:10.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.848 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "MOSDPGRecoveryDeleteReply(3.f e97,96 3:f5aa4140:::rbd_data.10f1b8e048d3.0000000000000030:head,92'206)", 2024-09-14T08:41:10.848 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:10.850836+0000", 2024-09-14T08:41:10.848 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00013974300000000001, 2024-09-14T08:41:10.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015675500000000001, 2024-09-14T08:41:10.848 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.848 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.850836+0000", 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.850836+0000", 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.850837+0000", 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0900000000000001e-07 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.850843+0000", 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1149999999999999e-06 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.850853+0000", 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0251999999999999e-05 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.850861+0000", 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9990000000000008e-06 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.850912+0000", 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0866999999999999e-05 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "MOSDPGRecoveryDelete(3.1f e97,96 3:f9ba7e7d:::rbd_data.10f1952d058d.0000000000000022:head,85'36)", 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:10.850998+0000", 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9999785, 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0063999999999999e-05, 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "no flag points reached", 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.850998+0000", 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.850998+0000", 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.850998+0000", 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0500000000000003e-07 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.851003+0000", 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7770000000000002e-06 2024-09-14T08:41:10.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.851013+0000", 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9320000000000008e-06 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 2 2024-09-14T08:41:10.854 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:10.864 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:10.865 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:10.864+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:10.966 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:10.967+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:11.034 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:11.059 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:11.059 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:11.059 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:11.059 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:11.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:11.067 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:11.064+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:11.168 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:11.167+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:11.226 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:11.226 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:11.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:11.226 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:11.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.226 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148948750000002, 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:41:11.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:41:11.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148881352999993, 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:11.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:41:11.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.235 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148807657000006, 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.236 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:11.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.240 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148732185, 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:41:11.244 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148674980999999, 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.245 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:41:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148616097000001, 2024-09-14T08:41:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:41:11.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:41:11.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148551170999994, 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:41:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148489720000001, 2024-09-14T08:41:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:41:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148430185999999, 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148370876000001, 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:41:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.148298843999996, 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 45.99385135, 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:41:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 45.993820571999997, 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 45.993754869, 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:41:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 45.993632697999999, 2024-09-14T08:41:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:41:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:41:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 45.993598466999998, 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:41:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:41:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 45.993567042000002, 2024-09-14T08:41:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:41:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.629703422, 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:41:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.6296440720000001, 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:41:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:41:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:41:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.62960412, 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:41:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:11.322 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:11.324 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:11.323+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:11.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:11.425 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:11.427+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:11.469 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:11.469 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:11.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.469 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPushReply(3.6 97/96 [PushReplyOp(3:60cd3a96:::rbd_data.10f15daa646d.0000000000000207:5)])", 2024-09-14T08:41:11.469 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:11.471513+0000", 2024-09-14T08:41:11.469 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.8939999999999998e-05, 2024-09-14T08:41:11.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013354600000000001, 2024-09-14T08:41:11.469 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471513+0000", 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471513+0000", 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:11.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471513+0000", 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471518+0000", 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5299999999999998e-06 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471531+0000", 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3020000000000001e-05 2024-09-14T08:41:11.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471539+0000", 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471596+0000", 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7756000000000001e-05 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPush(3.18 97/96 [PushOp(3:18f6d46b:::rbd_data.10f1663ce16c.0000000000000019:head, version: 38'37, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:18f6d46b:::rbd_data.10f1663ce16c.0000000000000019:head@38'37, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:11.471621+0000", 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999909, 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000169603, 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471621+0000", 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471621+0000", 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471621+0000", 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9200000000000001e-07 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471632+0000", 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.058e-05 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471648+0000", 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6464999999999999e-05 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:11.471664+0000", 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5645e-05 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 2 2024-09-14T08:41:11.476 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:11.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:11.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:11.527 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:11.528+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:11.588 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:41:11.627 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:11.627+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:11.630 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:11.630 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:11.630 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:11.630 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:11.630 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:11.648 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:11.663 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:11.684 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:11.684 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:11.704 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:11.726 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:11.726 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:11.727 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:11.727+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:11.750 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:11.750 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:11.773 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:11.776 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:11.776 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:11.785 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:11.785 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:11.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:11.828 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:11.827+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:11.929 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:11.931+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:11.963 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:11.963 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:11.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:12.030 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:12.028+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:12.101 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:12.101 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:12.116 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:12.131 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:12.131+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:12.231 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:12.232+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:12.284 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:12.284 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:12.298 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:12.339 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:12.340+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:12.433 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:12.433 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:12.433 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:12.435+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:12.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:12.534 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:12.536+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:12.625 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:12.625 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:12.634 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:12.632+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:12.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:12.735 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:12.736+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:12.762 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:12.763 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:12.777 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:12.835 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:12.835+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:12.894 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:12.894 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:12.907 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:12.949 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:12.950+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:13.037 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:13.038+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:13.069 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:13.069 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:13.083 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:13.169 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:13.170+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:13.240 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:13.240+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:13.241 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:13.241 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:13.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:13.345 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:13.346+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:13.422 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:13.422 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:13.436 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:13.477 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:13.478+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:13.543 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:13.542+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:13.601 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:13.601 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:13.613 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5] out_osds: [3, 0] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:41:13.613 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-14T08:41:13.613 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T08:41:13.614 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T08:41:13.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:13.617 INFO:tasks.ceph.osd.0:Started 2024-09-14T08:41:13.617 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:41:13.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:41:13.633 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-14T08:41:13.657 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:13.658+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:13.745 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:13.742+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:13.777 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:13.778 INFO:teuthology.orchestra.run.smithi089.stderr:no valid command found; 10 closest matches: 2024-09-14T08:41:13.778 INFO:teuthology.orchestra.run.smithi089.stderr:0 2024-09-14T08:41:13.778 INFO:teuthology.orchestra.run.smithi089.stderr:1 2024-09-14T08:41:13.778 INFO:teuthology.orchestra.run.smithi089.stderr:2 2024-09-14T08:41:13.778 INFO:teuthology.orchestra.run.smithi089.stderr:abort 2024-09-14T08:41:13.778 INFO:teuthology.orchestra.run.smithi089.stderr:assert 2024-09-14T08:41:13.778 INFO:teuthology.orchestra.run.smithi089.stderr:config diff 2024-09-14T08:41:13.778 INFO:teuthology.orchestra.run.smithi089.stderr:config diff get 2024-09-14T08:41:13.778 INFO:teuthology.orchestra.run.smithi089.stderr:config get 2024-09-14T08:41:13.779 INFO:teuthology.orchestra.run.smithi089.stderr:config help [] 2024-09-14T08:41:13.779 INFO:teuthology.orchestra.run.smithi089.stderr:config set ... 2024-09-14T08:41:13.779 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: invalid command 2024-09-14T08:41:13.779 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T08:41:13.780 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-14T08:41:13.799 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:13.799 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:13.814 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:13.857 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:13.858+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:13.926 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:13.946 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:13.946+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:13.948 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:13.948 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:13.971 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:13.971 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:13.971 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:13.972 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:13.972 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:13.972 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:13.988 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:14.000 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:14.000 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:14.023 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:14.023 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:14.047 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:14.046+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:14.051 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:14.051 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:14.054 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:14.055 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:14.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:14.148 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:14.146+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:14.249 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:14.250+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:14.261 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:14.261 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:14.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:14.261 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:14.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.261 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.261 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.335374560999995, 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:41:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:41:14.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.335352005000004, 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.266 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:41:14.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.335283989999994, 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:41:14.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:41:14.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.335234262, 2024-09-14T08:41:14.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:41:14.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:41:14.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.335183107000006, 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:41:14.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.335131103999998, 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.284 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.335068534000001, 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:41:14.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:41:14.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:14.293 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.335001955999999, 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:41:14.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:41:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.334924172000001, 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:41:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:41:14.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.334871476999993, 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.303 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:41:14.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:41:14.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.334825824000006, 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.308 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.334779353000002, 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:41:14.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:41:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.334733365000005, 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:14.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.321 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.334705107000005, 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:41:14.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.334650328999999, 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.326 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:41:14.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.906879869999997, 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:41:14.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.914275803000002, 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:41:14.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.913437432000002, 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:14.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:14.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.344 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.345 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.345 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:25957 3.6 3:63e7fb75:::rbd_object_map.10f1b8e048d3:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-14T08:41:14.345 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:14.345 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.0369829789999994, 2024-09-14T08:41:14.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072282491000000004, 2024-09-14T08:41:14.345 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.345 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 25957 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224018+0000", 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224025+0000", 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4529999999999999e-06 2024-09-14T08:41:14.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224045+0000", 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0115999999999998e-05 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224061+0000", 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5892999999999998e-05 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.291466+0000", 2024-09-14T08:41:14.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067405667000000002 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.291546+0000", 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9741999999999996e-05 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.295946+0000", 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0043998860000000004 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.296085+0000", 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013912899999999999 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.296300+0000", 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214582 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:25958 3.6 3:63e7fb75:::rbd_object_map.10f1b8e048d3:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-14T08:41:14.350 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.0369180250000003, 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073197778000000005, 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 25958 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224083+0000", 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1000000000000001e-06 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224090+0000", 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5570000000000001e-06 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224110+0000", 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9825000000000001e-05 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224126+0000", 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5874000000000001e-05 2024-09-14T08:41:14.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.293676+0000", 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069550314000000002 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.293764+0000", 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7631000000000002e-05 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297122+0000", 2024-09-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033583250000000001 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297194+0000", 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2593000000000001e-05 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297280+0000", 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5558999999999999e-05 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.356 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.356 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:14.357 INFO:teuthology.orchestra.run.smithi188.stdout:2688 write 0x40de400 thru 0x40e467d (0x627e bytes) 2024-09-14T08:41:14.357 INFO:teuthology.orchestra.run.smithi188.stdout:2690 read 0x490d200 thru 0x4919be7 (0xc9e8 bytes) 2024-09-14T08:41:14.357 INFO:teuthology.orchestra.run.smithi188.stdout:2691 punch from 0x81b7000 to 0x81c0800, (0x9800 bytes) 2024-09-14T08:41:14.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:14.358 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:14.358+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:14.385 INFO:teuthology.orchestra.run.smithi188.stdout:2693 write 0xdde1e00 thru 0xddedaad (0xbcae bytes) 2024-09-14T08:41:14.387 INFO:teuthology.orchestra.run.smithi188.stdout:2696 trunc from 0xe7c8c00 to 0xe533800 2024-09-14T08:41:14.458 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:14.456+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5284.0:1396 3.18 3:186e5818:::rbd_data.10f12785a04b.00000000000000ec:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 1048576 write_size 1048576,zero 290816~183296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:14.512265+0000", 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001416589, 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001445055, 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-14T08:41:14.511 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5284", 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1396 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.512265+0000", 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.512265+0000", 2024-09-14T08:41:14.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.512266+0000", 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1200000000000002e-07 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.512270+0000", 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2930000000000002e-06 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.512282+0000", 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1739000000000001e-05 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.512288+0000", 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7490000000000001e-06 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.512341+0000", 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2972e-05 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.512475+0000", 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013385900000000001 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.512651+0000", 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017597700000000001 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.513287+0000", 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00063563400000000005 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.515 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.5284.0:1396 3.18 e100/98 ondisk, result = 0)", 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:14.513680+0000", 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.263e-06, 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7917000000000005e-05, 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.513680+0000", 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.513680+0000", 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.513681+0000", 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3000000000000001e-07 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.513684+0000", 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.513693+0000", 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3180000000000007e-06 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.513697+0000", 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4469999999999999e-06 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.513740+0000", 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2540000000000003e-05 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:14.513744+0000", 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.34e-06 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:14.519 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 2 2024-09-14T08:41:14.520 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:14.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:14.528 INFO:teuthology.orchestra.run.smithi188.stdout:2699 write 0x617d200 thru 0x618b97f (0xe780 bytes) 2024-09-14T08:41:14.567 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:14.568+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:14.578 INFO:teuthology.orchestra.run.smithi188.stdout:2700 trunc from 0xe533800 to 0xaf87400 2024-09-14T08:41:14.632 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:41:14.659 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:14.658+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:14.684 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:14.684 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:14.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:14.783 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:14.784+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:14.840 INFO:teuthology.orchestra.run.smithi188.stdout:2702 write 0x125d800 thru 0x1263b8a (0x638b bytes) 2024-09-14T08:41:14.843 INFO:teuthology.orchestra.run.smithi188.stdout:2707 read 0x4c24200 thru 0x4c2a89f (0x66a0 bytes) 2024-09-14T08:41:14.843 INFO:teuthology.orchestra.run.smithi188.stdout:2709 write 0x644d400 thru 0x645cad8 (0xf6d9 bytes) 2024-09-14T08:41:14.844 INFO:teuthology.orchestra.run.smithi188.stdout:2710 punch from 0x8aa5a00 to 0x8aaee00, (0x9400 bytes) 2024-09-14T08:41:14.860 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:14.858+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:14.870 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592974053000006, 2024-09-14T08:41:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:41:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:41:14.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.875 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592945256999997, 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.876 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:14.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592916438000003, 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:14.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592888109, 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:41:14.885 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:41:14.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592858909, 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:41:14.890 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:41:14.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.894 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592826900999995, 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:41:14.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592797625000003, 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:41:14.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:41:14.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592767959, 2024-09-14T08:41:14.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:14.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:41:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:41:14.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592739416000001, 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.909 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:41:14.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592711109999996, 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:41:14.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:41:14.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:41:14.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:41:14.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:41:14.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:41:14.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:41:14.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:41:14.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:41:14.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592665843000006, 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592634220999997, 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:41:14.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.932 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.932 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:14.932 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592576409000003, 2024-09-14T08:41:14.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:41:14.932 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.932 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.932 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:41:14.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:41:14.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.936 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592508395999999, 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:41:14.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:14.941 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592473024, 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:14.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:41:14.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.946 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.946 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.946 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:14.946 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:14.946 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 77.592438625, 2024-09-14T08:41:14.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:41:14.946 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.946 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.947 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:14.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:14.947 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:41:14.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.947 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:14.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:14.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:41:14.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:41:14.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 64.565368071999998, 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:14.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:14.957 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.303257893000001, 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:14.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:14.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.303110722, 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.963 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:14.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.302968921999998, 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:14.968 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:14.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:14.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:14.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:14.975 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:14.976 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:14.974+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:14.989 INFO:teuthology.orchestra.run.smithi188.stdout:2711 write 0xcdf1e00 thru 0xce00c4c (0xee4d bytes) 2024-09-14T08:41:14.991 INFO:teuthology.orchestra.run.smithi188.stdout:2713 write 0x414da00 thru 0x415636f (0x8970 bytes) 2024-09-14T08:41:14.992 INFO:teuthology.orchestra.run.smithi188.stdout:2715 read 0x72000 thru 0x78f1f (0x6f20 bytes) 2024-09-14T08:41:14.994 INFO:teuthology.orchestra.run.smithi188.stdout:2717 write 0xc258000 thru 0xc2657b4 (0xd7b5 bytes) 2024-09-14T08:41:15.055 INFO:teuthology.orchestra.run.smithi188.stdout:2718 write 0xd8ee800 thru 0xd8f47c5 (0x5fc6 bytes) 2024-09-14T08:41:15.056 INFO:teuthology.orchestra.run.smithi188.stdout:2719 punch from 0xa189a00 to 0xa192800, (0x8e00 bytes) 2024-09-14T08:41:15.071 INFO:teuthology.orchestra.run.smithi188.stdout:2720 punch from 0x116b400 to 0x1175c00, (0xa800 bytes) 2024-09-14T08:41:15.075 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:15.076+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:15.096 INFO:teuthology.orchestra.run.smithi188.stdout:2722 punch from 0x2c75c00 to 0x2c84e00, (0xf200 bytes) 2024-09-14T08:41:15.133 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:15.133 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:15.133 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:15.151 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:15.176 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:15.176+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:15.277 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:15.278+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout:2723 trunc from 0xd8f4800 to 0x5f0e00 2024-09-14T08:41:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:15.314 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:15.401 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:15.402+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:15.478 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:15.478+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:15.524 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.278243817000003, 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:41:15.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.278181803999999, 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:41:15.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.278115474000003, 2024-09-14T08:41:15.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:41:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.538 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.278060014000005, 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:41:15.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.278000394000003, 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.543 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:41:15.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:41:15.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:41:15.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:41:15.547 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.547 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.547 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277918854000006, 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:41:15.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.549 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:15.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:15.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:41:15.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:41:15.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.552 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277862526000007, 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.553 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:41:15.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:15.557 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277791031000007, 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:41:15.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277718160000006, 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:41:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277675947999995, 2024-09-14T08:41:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:41:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:41:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277646118000007, 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:41:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277617821000007, 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:41:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277576726000007, 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:41:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277547695999999, 2024-09-14T08:41:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:41:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:41:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:41:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277519212000001, 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:41:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277491072000004, 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:41:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:41:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:41:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:41:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:41:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277462376000003, 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:41:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:41:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:41:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277433619000007, 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:41:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:41:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277405572000006, 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:41:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.277375594999995, 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:41:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.624 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:15.626 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:15.592+0000 7fda6fb8b7c0 -1 Falling back to public interface 2024-09-14T08:41:15.626 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:15.624+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:15.626 INFO:teuthology.orchestra.run.smithi188.stdout:2724 punch from 0x1cf400 to 0x1d7000, (0x7c00 bytes) 2024-09-14T08:41:15.627 INFO:teuthology.orchestra.run.smithi188.stdout:2728 read 0x1c1a00 thru 0x1c4bd6 (0x31d7 bytes) 2024-09-14T08:41:15.627 INFO:teuthology.orchestra.run.smithi188.stdout:2729 trunc from 0x5f0e00 to 0x20eb600 2024-09-14T08:41:15.627 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:15.649 INFO:teuthology.orchestra.run.smithi188.stdout:2731 write 0x78ffc00 thru 0x790e1a5 (0xe5a6 bytes) 2024-09-14T08:41:15.652 INFO:teuthology.orchestra.run.smithi188.stdout:2732 read 0xba7c00 thru 0xba84d1 (0x8d2 bytes) 2024-09-14T08:41:15.654 INFO:teuthology.orchestra.run.smithi188.stdout:2735 punch from 0x628ce00 to 0x6295a00, (0x8c00 bytes) 2024-09-14T08:41:15.656 INFO:teuthology.orchestra.run.smithi188.stdout:2740 write 0x2bd6a00 thru 0x2bdca0d (0x600e bytes) 2024-09-14T08:41:15.717 INFO:teuthology.orchestra.run.smithi188.stdout:2742 write 0xb2aaa00 thru 0xb2ae270 (0x3871 bytes) 2024-09-14T08:41:15.718 INFO:teuthology.orchestra.run.smithi188.stdout:2743 read 0x7a62400 thru 0x7a683eb (0x5fec bytes) 2024-09-14T08:41:15.720 INFO:teuthology.orchestra.run.smithi188.stdout:2744 write 0x60c00 thru 0x6aa17 (0x9e18 bytes) 2024-09-14T08:41:15.726 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:15.724+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:15.746 INFO:teuthology.orchestra.run.smithi188.stdout:2745 trunc from 0xb2ae400 to 0x231a000 2024-09-14T08:41:15.805 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:13726 3.3 3:c20f1b6c:::rbd_object_map.10f12785a04b:head [call lock.assert_locked in=44b,call rbd.object_map_resize in=29b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T08:41:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:15.806980+0000", 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0014947669999999999, 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015227319999999999, 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 13726 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:15.806980+0000", 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:15.806980+0000", 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:15.806981+0000", 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:41:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:15.806986+0000", 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6110000000000004e-06 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:15.806999+0000", 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2515e-05 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:15.807005+0000", 2024-09-14T08:41:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1430000000000003e-06 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:15.807051+0000", 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6788e-05 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:15.807100+0000", 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8112000000000003e-05 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:15.807238+0000", 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013862600000000001 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:15.807904+0000", 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066590599999999996 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:41:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 1 2024-09-14T08:41:15.811 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:15.811 INFO:teuthology.orchestra.run.smithi188.stdout:2746 read 0x1698600 thru 0x169fdf9 (0x77fa bytes) 2024-09-14T08:41:15.816 INFO:teuthology.orchestra.run.smithi188.stdout:2747 trunc from 0x231a000 to 0x125ea00 2024-09-14T08:41:15.822 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:15.850 INFO:teuthology.orchestra.run.smithi188.stdout:2749 read 0xfcb600 thru 0xfd2668 (0x7069 bytes) 2024-09-14T08:41:15.852 INFO:teuthology.orchestra.run.smithi188.stdout:2754 read 0x1169a00 thru 0x1177be2 (0xe1e3 bytes) 2024-09-14T08:41:15.865 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:15.866+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:15.872 INFO:teuthology.orchestra.run.smithi188.stdout:2756 write 0x235e600 thru 0x236aeaa (0xc8ab bytes) 2024-09-14T08:41:15.892 INFO:teuthology.orchestra.run.smithi188.stdout:2757 trunc from 0x236b000 to 0x9362800 2024-09-14T08:41:15.928 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:15.926+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:15.932 INFO:teuthology.orchestra.run.smithi188.stdout:2758 punch from 0x75d7a00 to 0x75e0000, (0x8600 bytes) 2024-09-14T08:41:15.948 INFO:teuthology.orchestra.run.smithi188.stdout:2760 trunc from 0x9362800 to 0x3c3ec00 2024-09-14T08:41:15.965 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:15.965 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:15.965 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:15.965 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:15.965 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:15.980 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:15.982 INFO:teuthology.orchestra.run.smithi188.stdout:2761 read 0xd53a00 thru 0xd5898b (0x4f8c bytes) 2024-09-14T08:41:16.006 INFO:teuthology.orchestra.run.smithi188.stdout:2762 write 0x4e10200 thru 0x4e128d8 (0x26d9 bytes) 2024-09-14T08:41:16.029 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:16.028+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:16.047 INFO:teuthology.orchestra.run.smithi188.stdout:2763 write 0xb4e7800 thru 0xb4e8234 (0xa35 bytes) 2024-09-14T08:41:16.049 INFO:teuthology.orchestra.run.smithi188.stdout:2764 write 0x7e91200 thru 0x7e9280c (0x160d bytes) 2024-09-14T08:41:16.050 INFO:teuthology.orchestra.run.smithi188.stdout:2765 read 0x3826200 thru 0x3831f6d (0xbd6e bytes) 2024-09-14T08:41:16.056 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:16.063 INFO:teuthology.orchestra.run.smithi188.stdout:2767 trunc from 0xb4e8400 to 0x4d4d400 2024-09-14T08:41:16.102 INFO:teuthology.orchestra.run.smithi188.stdout:2770 trunc from 0x4d4d400 to 0x2c2f600 2024-09-14T08:41:16.130 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:16.130+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:16.139 INFO:teuthology.orchestra.run.smithi188.stdout:2772 read 0x1680400 thru 0x168fd49 (0xf94a bytes) 2024-09-14T08:41:16.141 INFO:teuthology.orchestra.run.smithi188.stdout:2773 read 0x14fe200 thru 0x1509d6d (0xbb6e bytes) 2024-09-14T08:41:16.142 INFO:teuthology.orchestra.run.smithi188.stdout:2775 punch from 0x2004400 to 0x2005600, (0x1200 bytes) 2024-09-14T08:41:16.147 INFO:teuthology.orchestra.run.smithi188.stdout:2777 trunc from 0x2c2f600 to 0xe9c800 2024-09-14T08:41:16.167 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:16.167 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:16.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:16.167 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:16.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.269093807000004, 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:41:16.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:41:16.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:41:16.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.268787181999997, 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:16.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:41:16.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.268383846999996, 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:16.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.267980144000006, 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.182 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:41:16.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.267629397999997, 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:41:16.186 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:41:16.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.267243125999997, 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:41:16.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:41:16.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.267052593000003, 2024-09-14T08:41:16.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:16.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.266545864999998, 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:41:16.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:41:16.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.266219793000005, 2024-09-14T08:41:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:16.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.208 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.265910180999995, 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:41:16.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.265414638999999, 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.214 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:41:16.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.265098881, 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:41:16.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.264611445, 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.222 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:41:16.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.226 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.264261433000001, 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.227 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:41:16.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.263470314000003, 2024-09-14T08:41:16.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:41:16.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:41:16.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.263061254999997, 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.236 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:41:16.240 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.433937927000002, 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:16.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:16.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:41:16.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:41:16.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:41:16.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.8981841020000001, 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.248 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:41:16.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.8635192180000004, 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:41:16.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.257 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.8633182470000005, 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:16.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:16.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:16.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:41:16.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:41:16.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.262 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:16.263 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:16.263 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:16.264 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:16.264 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:16.265 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:16.266 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:16.266 INFO:teuthology.orchestra.run.smithi188.stdout:2780 trunc from 0xe9c800 to 0x18ff400 2024-09-14T08:41:16.266 INFO:teuthology.orchestra.run.smithi188.stdout:2783 punch from 0x1371200 to 0x137a400, (0x9200 bytes) 2024-09-14T08:41:16.266 INFO:teuthology.orchestra.run.smithi188.stdout:2786 write 0x7ae4c00 thru 0x7af3514 (0xe915 bytes) 2024-09-14T08:41:16.266 INFO:teuthology.orchestra.run.smithi188.stdout:2787 write 0x309600 thru 0x3126a5 (0x90a6 bytes) 2024-09-14T08:41:16.266 INFO:teuthology.orchestra.run.smithi188.stdout:2788 write 0x6991a00 thru 0x699b098 (0x9699 bytes) 2024-09-14T08:41:16.266 INFO:teuthology.orchestra.run.smithi188.stdout:2789 write 0x1e68a00 thru 0x1e72281 (0x9882 bytes) 2024-09-14T08:41:16.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:16.267 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:16.262+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:16.267 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:16.267 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:16.268 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:16.286 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:16.287 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:16.309 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:16.309 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:16.313 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:16.314 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:16.337 INFO:teuthology.orchestra.run.smithi188.stdout:2791 write 0xe3e2000 thru 0xe3e97f8 (0x77f9 bytes) 2024-09-14T08:41:16.339 INFO:teuthology.orchestra.run.smithi188.stdout:2794 read 0x618aa00 thru 0x619914a (0xe74b bytes) 2024-09-14T08:41:16.340 INFO:teuthology.orchestra.run.smithi188.stdout:2795 write 0x595fc00 thru 0x596a16b (0xa56c bytes) 2024-09-14T08:41:16.340 INFO:teuthology.orchestra.run.smithi188.stdout:2796 write 0x4f8800 thru 0x4fa30f (0x1b10 bytes) 2024-09-14T08:41:16.342 INFO:teuthology.orchestra.run.smithi188.stdout:2797 read 0x99d1000 thru 0x99d4de7 (0x3de8 bytes) 2024-09-14T08:41:16.342 INFO:teuthology.orchestra.run.smithi188.stdout:2799 read 0x26bfc00 thru 0x26cf73a (0xfb3b bytes) 2024-09-14T08:41:16.343 INFO:teuthology.orchestra.run.smithi188.stdout:2800 write 0x391de00 thru 0x392d429 (0xf62a bytes) 2024-09-14T08:41:16.344 INFO:teuthology.orchestra.run.smithi188.stdout:2801 write 0x28fdc00 thru 0x29040a8 (0x64a9 bytes) 2024-09-14T08:41:16.344 INFO:teuthology.orchestra.run.smithi188.stdout:2802 read 0x97c8800 thru 0x97d1fba (0x97bb bytes) 2024-09-14T08:41:16.345 INFO:teuthology.orchestra.run.smithi188.stdout:2805 read 0xde4f000 thru 0xde57413 (0x8414 bytes) 2024-09-14T08:41:16.345 INFO:teuthology.orchestra.run.smithi188.stdout:2807 punch from 0xaea6000 to 0xaea8a00, (0x2a00 bytes) 2024-09-14T08:41:16.347 INFO:teuthology.orchestra.run.smithi188.stdout:2808 write 0x3e57e00 thru 0x3e60367 (0x8568 bytes) 2024-09-14T08:41:16.347 INFO:teuthology.orchestra.run.smithi188.stdout:2809 write 0x869d600 thru 0x86a671e (0x911f bytes) 2024-09-14T08:41:16.349 INFO:teuthology.orchestra.run.smithi188.stdout:2810 write 0x8e09e00 thru 0x8e1965d (0xf85e bytes) 2024-09-14T08:41:16.349 INFO:teuthology.orchestra.run.smithi188.stdout:2812 write 0x560b800 thru 0x56164ba (0xacbb bytes) 2024-09-14T08:41:16.364 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:16.362+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:16.365 INFO:teuthology.orchestra.run.smithi188.stdout:2814 trunc from 0xe3e9800 to 0x5f01800 2024-09-14T08:41:16.465 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:16.464+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:16.472 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:16.473 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:16.488 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:16.510 INFO:teuthology.orchestra.run.smithi188.stdout:2815 write 0x7ff9a00 thru 0x8002059 (0x865a bytes) 2024-09-14T08:41:16.513 INFO:teuthology.orchestra.run.smithi188.stdout:2817 read 0x72be200 thru 0x72c54f1 (0x72f2 bytes) 2024-09-14T08:41:16.513 INFO:teuthology.orchestra.run.smithi188.stdout:2818 punch from 0x676fe00 to 0x6777400, (0x7600 bytes) 2024-09-14T08:41:16.553 INFO:teuthology.orchestra.run.smithi188.stdout:2820 write 0xd24ac00 thru 0xd24f863 (0x4c64 bytes) 2024-09-14T08:41:16.556 INFO:teuthology.orchestra.run.smithi188.stdout:2822 write 0x728da00 thru 0x7298ce3 (0xb2e4 bytes) 2024-09-14T08:41:16.556 INFO:teuthology.orchestra.run.smithi188.stdout:2823 write 0x2166400 thru 0x21703c6 (0x9fc7 bytes) 2024-09-14T08:41:16.566 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:16.564+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:16.580 INFO:teuthology.orchestra.run.smithi188.stdout:2824 trunc from 0xd24fa00 to 0x475f800 2024-09-14T08:41:16.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:41:16.669 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:16.669 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:16.671 INFO:teuthology.orchestra.run.smithi188.stdout:2825 read 0x1809a00 thru 0x180c346 (0x2947 bytes) 2024-09-14T08:41:16.674 INFO:teuthology.orchestra.run.smithi188.stdout:2826 read 0x3c0ee00 thru 0x3c18a42 (0x9c43 bytes) 2024-09-14T08:41:16.675 INFO:teuthology.orchestra.run.smithi188.stdout:2827 write 0x11a8a00 thru 0x11b3054 (0xa655 bytes) 2024-09-14T08:41:16.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:16.699 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:16.700+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:16.714 INFO:teuthology.orchestra.run.smithi188.stdout:2828 write 0x7d9e400 thru 0x7dad60e (0xf20f bytes) 2024-09-14T08:41:16.734 INFO:teuthology.orchestra.run.smithi188.stdout:2831 trunc from 0x7dad800 to 0xe8da200 2024-09-14T08:41:16.765 INFO:teuthology.orchestra.run.smithi188.stdout:2832 write 0x1128200 thru 0x1131168 (0x8f69 bytes) 2024-09-14T08:41:16.768 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:16.766+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:16.768 INFO:teuthology.orchestra.run.smithi188.stdout:2835 read 0xc44d600 thru 0xc45c4b6 (0xeeb7 bytes) 2024-09-14T08:41:16.768 INFO:teuthology.orchestra.run.smithi188.stdout:2836 punch from 0x6f6f800 to 0x6f72200, (0x2a00 bytes) 2024-09-14T08:41:16.789 INFO:teuthology.orchestra.run.smithi188.stdout:2837 trunc from 0xe8da200 to 0x7564a00 2024-09-14T08:41:16.814 INFO:teuthology.orchestra.run.smithi188.stdout:2838 punch from 0xdfe600 to 0xe0cc00, (0xe600 bytes) 2024-09-14T08:41:16.816 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:16.816 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:16.832 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:16.836 INFO:teuthology.orchestra.run.smithi188.stdout:2839 write 0xb616000 thru 0xb621195 (0xb196 bytes) 2024-09-14T08:41:16.837 INFO:teuthology.orchestra.run.smithi188.stdout:2840 read 0x7922a00 thru 0x7927133 (0x4734 bytes) 2024-09-14T08:41:16.837 INFO:teuthology.orchestra.run.smithi188.stdout:2845 write 0xae09400 thru 0xae0e9e3 (0x55e4 bytes) 2024-09-14T08:41:16.837 INFO:teuthology.orchestra.run.smithi188.stdout:2849 punch from 0x7993400 to 0x7999800, (0x6400 bytes) 2024-09-14T08:41:16.839 INFO:teuthology.orchestra.run.smithi188.stdout:2850 read 0x7512000 thru 0x7516195 (0x4196 bytes) 2024-09-14T08:41:16.855 INFO:teuthology.orchestra.run.smithi188.stdout:2852 trunc from 0xb621200 to 0x1a4e800 2024-09-14T08:41:16.873 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:16.874+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:16.970 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:16.970+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:16.970 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:16.970 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:16.975 INFO:teuthology.orchestra.run.smithi188.stdout:2853 write 0xc5e4200 thru 0xc5e7d45 (0x3b46 bytes) 2024-09-14T08:41:16.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:16.985 INFO:teuthology.orchestra.run.smithi188.stdout:2856 trunc from 0xc5e7e00 to 0x90a1a00 2024-09-14T08:41:17.038 INFO:teuthology.orchestra.run.smithi188.stdout:2857 punch from 0x76bb800 to 0x76bf800, (0x4000 bytes) 2024-09-14T08:41:17.040 INFO:teuthology.orchestra.run.smithi188.stdout:2858 read 0x11e9800 thru 0x11f3365 (0x9b66 bytes) 2024-09-14T08:41:17.058 INFO:teuthology.orchestra.run.smithi188.stdout:2859 trunc from 0x90a1a00 to 0x2e52e00 2024-09-14T08:41:17.070 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:17.068+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:17.117 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:17.117 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:17.125 INFO:teuthology.orchestra.run.smithi188.stdout:2860 write 0x6eb7a00 thru 0x6ec3efd (0xc4fe bytes) 2024-09-14T08:41:17.128 INFO:teuthology.orchestra.run.smithi188.stdout:2863 punch from 0x9b6200 to 0x9c5800, (0xf600 bytes) 2024-09-14T08:41:17.129 INFO:teuthology.orchestra.run.smithi188.stdout:2865 punch from 0x1499000 to 0x14a1c00, (0x8c00 bytes) 2024-09-14T08:41:17.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:17.171 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:17.170+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:17.186 INFO:teuthology.orchestra.run.smithi188.stdout:2867 write 0x8ff4200 thru 0x900419d (0xff9e bytes) 2024-09-14T08:41:17.263 INFO:teuthology.orchestra.run.smithi188.stdout:2868 write 0xe5d2a00 thru 0xe5ddf9a (0xb59b bytes) 2024-09-14T08:41:17.267 INFO:teuthology.orchestra.run.smithi188.stdout:2871 write 0x34e3a00 thru 0x34e96c6 (0x5cc7 bytes) 2024-09-14T08:41:17.267 INFO:teuthology.orchestra.run.smithi188.stdout:2873 punch from 0xb4e00 to 0xc3a00, (0xec00 bytes) 2024-09-14T08:41:17.270 INFO:teuthology.orchestra.run.smithi188.stdout:2875 read 0x5b85200 thru 0x5b91b7f (0xc980 bytes) 2024-09-14T08:41:17.270 INFO:teuthology.orchestra.run.smithi188.stdout:2878 read 0x28b5400 thru 0x28b670b (0x130c bytes) 2024-09-14T08:41:17.271 INFO:teuthology.orchestra.run.smithi188.stdout:2880 write 0x3f9ec00 thru 0x3fa8506 (0x9907 bytes) 2024-09-14T08:41:17.271 INFO:teuthology.orchestra.run.smithi188.stdout:2881 write 0x3952200 thru 0x395243a (0x23b bytes) 2024-09-14T08:41:17.271 INFO:teuthology.orchestra.run.smithi188.stdout:2885 write 0x618f800 thru 0x6190bbd (0x13be bytes) 2024-09-14T08:41:17.271 INFO:teuthology.orchestra.run.smithi188.stdout:2889 write 0x79eee00 thru 0x79f4e9b (0x609c bytes) 2024-09-14T08:41:17.273 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:17.270+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:17.282 INFO:teuthology.orchestra.run.smithi188.stdout:2893 trunc from 0xe5de000 to 0x8b3d400 2024-09-14T08:41:17.317 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:17.318 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:17.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:17.373 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:17.370+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:17.398 INFO:teuthology.orchestra.run.smithi188.stdout:2894 write 0x472e400 thru 0x4731081 (0x2c82 bytes) 2024-09-14T08:41:17.400 INFO:teuthology.orchestra.run.smithi188.stdout:2900 write 0x8033000 thru 0x8038b91 (0x5b92 bytes) 2024-09-14T08:41:17.407 INFO:teuthology.orchestra.run.smithi188.stdout:2901 trunc from 0x8b3d400 to 0x67cf200 2024-09-14T08:41:17.467 INFO:teuthology.orchestra.run.smithi188.stdout:2903 read 0x3729200 thru 0x3734b63 (0xb964 bytes) 2024-09-14T08:41:17.470 INFO:teuthology.orchestra.run.smithi188.stdout:2904 write 0x322ba00 thru 0x323025e (0x485f bytes) 2024-09-14T08:41:17.470 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:17.470 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:17.470 INFO:teuthology.orchestra.run.smithi188.stdout:2905 write 0x2029400 thru 0x2035528 (0xc129 bytes) 2024-09-14T08:41:17.471 INFO:teuthology.orchestra.run.smithi188.stdout:2912 write 0xd7a600 thru 0xd81181 (0x6b82 bytes) 2024-09-14T08:41:17.472 INFO:teuthology.orchestra.run.smithi188.stdout:2913 punch from 0x1b0ec00 to 0x1b0ee00, (0x200 bytes) 2024-09-14T08:41:17.473 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:17.472+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:17.473 INFO:teuthology.orchestra.run.smithi188.stdout:2914 read 0x183fe00 thru 0x18467b4 (0x69b5 bytes) 2024-09-14T08:41:17.488 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:17.529 INFO:teuthology.orchestra.run.smithi188.stdout:2915 write 0x85b3a00 thru 0x85b7748 (0x3d49 bytes) 2024-09-14T08:41:17.573 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:17.574+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:17.645 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:17.646 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:17.660 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:17.662 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:41:17.683 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:17.684+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:17.770 INFO:teuthology.orchestra.run.smithi188.stdout:2917 write 0x9cfa600 thru 0x9d09f0a (0xf90b bytes) 2024-09-14T08:41:17.772 INFO:teuthology.orchestra.run.smithi188.stdout:2918 clone 23 order 23 su 4194304 sc 12 2024-09-14T08:41:17.775 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:17.772+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:17.781 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:17.782 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:17.797 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:17.876 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:17.876+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:17.931 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:17.931 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:17.945 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:17.977 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:17.976+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:18.069 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:18.069 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:18.077 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:18.076+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:18.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:18.179 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:18.176+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:18.206 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:18.206 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:18.221 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:18.279 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:18.278+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:18.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:18.340 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:18.340 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:18.355 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:18.397 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:18.398+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:18.453 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:18.472 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:18.473 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:18.481 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:18.480+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:18.492 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:18.492 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:18.512 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:18.512 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:18.520 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:18.520 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:18.532 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:18.532 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:18.535 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:18.552 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:18.553 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:18.555 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:18.556 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:18.582 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:18.582+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:18.652 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.755855154000002, 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.653 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:41:18.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:41:18.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.755548528999995, 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:41:18.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:41:18.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:41:18.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.662 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.662 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.663 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:18.663 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.755145193999994, 2024-09-14T08:41:18.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:41:18.663 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.663 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.663 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.663 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:41:18.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.664 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:18.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:18.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:41:18.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:41:18.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:41:18.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:41:18.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:41:18.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:41:18.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:41:18.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:41:18.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:41:18.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:41:18.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:41:18.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:41:18.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:41:18.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:41:18.668 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.669 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.669 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.669 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:18.669 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.754741491000004, 2024-09-14T08:41:18.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:18.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:18.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:41:18.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:41:18.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:41:18.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:41:18.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:41:18.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:41:18.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:41:18.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:41:18.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.754390744999995, 2024-09-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:41:18.676 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.676 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.676 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.676 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:41:18.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.676 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:41:18.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:41:18.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.681 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.681 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.681 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:18.681 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.754004472999995, 2024-09-14T08:41:18.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:41:18.681 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:18.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:41:18.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:41:18.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:41:18.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:41:18.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:41:18.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.686 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.753813940000001, 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.687 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:41:18.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.688 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:18.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:41:18.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:41:18.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:41:18.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:41:18.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:41:18.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:41:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:41:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:41:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:41:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.753307211999996, 2024-09-14T08:41:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:41:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:41:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:41:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:41:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:41:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:41:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.752981140000003, 2024-09-14T08:41:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:41:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:41:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:41:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:41:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:41:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:41:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:41:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.752671527999993, 2024-09-14T08:41:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:41:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:41:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.752175985999997, 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.751860227999998, 2024-09-14T08:41:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:41:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:41:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:41:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:41:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.751372791999998, 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:41:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.75102278, 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:41:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:41:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:41:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:41:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.750231661000001, 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:41:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.749822601999995, 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:41:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:41:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 62.920699274, 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:41:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 7.3849454489999999, 2024-09-14T08:41:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:41:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 7.3502805650000003, 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 7.3500795940000003, 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:41:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:18.761 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:18.762 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:18.762 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:18.762+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:18.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:41:18.826 INFO:teuthology.orchestra.run.smithi188.stdout:leaving image image_client.0-clone22 intact 2024-09-14T08:41:18.862 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:18.860+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:18.911 INFO:teuthology.orchestra.run.smithi089.stderr:no valid command found; 10 closest matches: 2024-09-14T08:41:18.911 INFO:teuthology.orchestra.run.smithi089.stderr:0 2024-09-14T08:41:18.911 INFO:teuthology.orchestra.run.smithi089.stderr:1 2024-09-14T08:41:18.912 INFO:teuthology.orchestra.run.smithi089.stderr:2 2024-09-14T08:41:18.912 INFO:teuthology.orchestra.run.smithi089.stderr:abort 2024-09-14T08:41:18.912 INFO:teuthology.orchestra.run.smithi089.stderr:assert 2024-09-14T08:41:18.912 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs debug_inject_read_zeros 2024-09-14T08:41:18.912 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs files list 2024-09-14T08:41:18.912 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs stats 2024-09-14T08:41:18.912 INFO:teuthology.orchestra.run.smithi089.stderr:bluestore allocator dump block 2024-09-14T08:41:18.912 INFO:teuthology.orchestra.run.smithi089.stderr:bluestore allocator fragmentation block 2024-09-14T08:41:18.912 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: invalid command 2024-09-14T08:41:18.914 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T08:41:18.914 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-14T08:41:18.935 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:18.935 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:18.935 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:18.935 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:18.949 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:18.964 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:18.964+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:19.065 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:19.062+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:19.072 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:19.073 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:19.073 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:19.073 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:19.073 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:19.087 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:19.177 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:19.178+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:19.264 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:19.264 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:19.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:19.264 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:19.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.264 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.264 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.185281630000006, 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:41:19.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.185214232999996, 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:41:19.269 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:41:19.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.273 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.185140536999995, 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.274 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:41:19.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.185065065000003, 2024-09-14T08:41:19.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:19.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.282 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.185007861000003, 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:41:19.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:19.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:41:19.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:41:19.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:41:19.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.184948977000005, 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:41:19.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:41:19.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:19.292 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.184884050999997, 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:41:19.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.184822600000004, 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:41:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.301 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.184763066000002, 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.302 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:41:19.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.306 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.184703756000005, 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:41:19.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:41:19.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.184631723999999, 2024-09-14T08:41:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:41:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:41:19.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.030184230000003, 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.320 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.030153452, 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:41:19.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.030087749000003, 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:41:19.325 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.326 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.326 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.326 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.326 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:19.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:19.328 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:41:19.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:41:19.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:19.332 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.029965578000002, 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:19.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.336 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.029931347000002, 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:19.337 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:41:19.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:19.341 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.029899921999998, 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:41:19.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.6660363020000002, 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.346 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:41:19.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:19.351 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.6659769519999994, 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:19.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:41:19.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:19.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.6659369999999996, 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:19.358 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:19.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:41:19.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:41:19.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:19.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:41:19.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:41:19.364 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.364 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.364 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.364 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:19.364 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:19.366 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:19.366 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:19.364+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:19.404 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-14T08:41:19.466 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:19.466+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:19.500 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:19.500 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:19.501 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:19.501 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:19.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:19.566 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:19.564+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:19.638 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:19.639 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:19.639 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:19.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:19.668 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:19.666+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:19.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:41:19.768 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:19.766+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:19.773 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:19.772+0000 7fda6fb8b7c0 -1 osd.0 40 log_to_monitors true 2024-09-14T08:41:19.835 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:19.835 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:19.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:19.835 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:19.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.835 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.836 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:19.836 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910925402999993, 2024-09-14T08:41:19.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:41:19.836 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.836 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.836 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.836 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.836 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.836 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.836 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:41:19.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:41:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:41:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:41:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:41:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910902847000003, 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.841 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:41:19.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.846 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910834832000006, 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:41:19.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:41:19.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:41:19.851 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910785103999999, 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:41:19.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:41:19.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:41:19.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:41:19.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:41:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910733949000004, 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.858 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:19.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:19.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:41:19.862 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910681945999997, 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.863 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:41:19.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:19.868 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910619376, 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:19.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:19.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:41:19.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:41:19.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.873 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910552797999998, 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:19.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:41:19.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910475013999999, 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.879 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:41:19.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910422319000006, 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:41:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:19.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:41:19.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.889 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910376666000005, 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:41:19.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910330195, 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.895 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:41:19.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.899 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910284207000004, 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.900 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:41:19.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910255949000003, 2024-09-14T08:41:19.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:41:19.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:41:19.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:41:19.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:41:19.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:41:19.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.910201170999997, 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:19.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:19.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:41:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.482430711999996, 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.916 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:41:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:19.921 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.489826645000001, 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:41:19.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:41:19.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.488988274, 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.927 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:41:19.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:25957 3.6 3:63e7fb75:::rbd_object_map.10f1b8e048d3:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.612533821, 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072282491000000004, 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:19.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 25957 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:19.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224018+0000", 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224025+0000", 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4529999999999999e-06 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224045+0000", 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0115999999999998e-05 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224061+0000", 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5892999999999998e-05 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.291466+0000", 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067405667000000002 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.291546+0000", 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9741999999999996e-05 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.295946+0000", 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0043998860000000004 2024-09-14T08:41:19.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.296085+0000", 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013912899999999999 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.296300+0000", 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214582 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:25958 3.6 3:63e7fb75:::rbd_object_map.10f1b8e048d3:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.612468867, 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073197778000000005, 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:19.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 25958 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:19.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224083+0000", 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1000000000000001e-06 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224090+0000", 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5570000000000001e-06 2024-09-14T08:41:19.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224110+0000", 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9825000000000001e-05 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224126+0000", 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5874000000000001e-05 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.293676+0000", 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069550314000000002 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.293764+0000", 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7631000000000002e-05 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:19.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297122+0000", 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033583250000000001 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297194+0000", 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2593000000000001e-05 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297280+0000", 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5558999999999999e-05 2024-09-14T08:41:19.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.945 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:19.945 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:19.945 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:19.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:19.947 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:19.946+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:20.047 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:20.048+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:20.110 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:20.110 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:20.110 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:20.110 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:20.124 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:20.167 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:20.168+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:20.249 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:20.250+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:20.293 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:20.293 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:20.293 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:20.293 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:20.293 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:20.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:20.351 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:20.352+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:20.445 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167519553000005, 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.446 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:41:20.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167490756999996, 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.451 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:41:20.455 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167461938000002, 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:41:20.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.460 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167433609, 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:20.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:41:20.464 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167404409, 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.465 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:41:20.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:20.469 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167372400999994, 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167343125000002, 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:41:20.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:41:20.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:41:20.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:41:20.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:41:20.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167313458999999, 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:41:20.478 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.482 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167284916, 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:41:20.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:41:20.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167256609999995, 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.487 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:20.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.491 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167211343000005, 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:41:20.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167179720999997, 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:20.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.500 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167121909000002, 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:20.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:20.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:41:20.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167053895999999, 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:41:20.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.167018524, 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:41:20.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.166984124999999, 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.515 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:20.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:41:20.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:41:20.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:41:20.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:41:20.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:20.519 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:20.520 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 70.139913571999998, 2024-09-14T08:41:20.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:20.520 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.520 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.520 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:20.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:20.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:20.520 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:20.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 37.877803393000001, 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:20.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:20.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:20.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 37.877656221999999, 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:20.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.535 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 37.877514421999997, 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:20.536 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:20.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.540 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.541 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:20.541 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:20.541 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:20.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:20.543 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:20.540+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:20.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:20.643 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:20.642+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:20.675 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:41:20.678 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:20.678 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:20.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:20.714 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:20.712+0000 7fda63966640 -1 osd.0 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T08:41:20.724 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:20.744 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:20.744+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:20.744 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:20.745 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:20.761 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:20.761 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:20.779 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:20.779 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:20.798 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:20.798 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:20.819 INFO:teuthology.orchestra.run.smithi188.stdout:2919 trunc from 0x9d0a000 to 0x6c93400 2024-09-14T08:41:20.819 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:20.820 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:20.823 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:20.823 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:20.845 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:20.846+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:20.863 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:20.863 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:20.866 INFO:teuthology.orchestra.run.smithi188.stdout:2920 write 0xe6be00 thru 0xe7313b (0x733c bytes) 2024-09-14T08:41:20.870 INFO:teuthology.orchestra.run.smithi188.stdout:2921 read 0x5afd000 thru 0x5b0b801 (0xe802 bytes) 2024-09-14T08:41:20.878 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:20.900 INFO:teuthology.orchestra.run.smithi188.stdout:2924 write 0x74bf200 thru 0x74bffef (0xdf0 bytes) 2024-09-14T08:41:20.903 INFO:teuthology.orchestra.run.smithi188.stdout:2925 write 0x435f000 thru 0x436cd9b (0xdd9c bytes) 2024-09-14T08:41:20.903 INFO:teuthology.orchestra.run.smithi188.stdout:2930 read 0x28d2600 thru 0x28d37e0 (0x11e1 bytes) 2024-09-14T08:41:20.904 INFO:teuthology.orchestra.run.smithi188.stdout:2931 read 0x1977400 thru 0x1985fca (0xebcb bytes) 2024-09-14T08:41:20.935 INFO:teuthology.orchestra.run.smithi188.stdout:2933 trunc from 0x74c0000 to 0x4ef7400 2024-09-14T08:41:20.965 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:20.966+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:21.030 INFO:teuthology.orchestra.run.smithi188.stdout:2934 write 0x62b0000 thru 0x62b3fd9 (0x3fda bytes) 2024-09-14T08:41:21.039 INFO:teuthology.orchestra.run.smithi188.stdout:2935 trunc from 0x62b4000 to 0x8cb6200 2024-09-14T08:41:21.046 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:21.046+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:21.052 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:21.052 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:21.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:21.074 INFO:teuthology.orchestra.run.smithi188.stdout:2936 write 0x80d5800 thru 0x80da6d6 (0x4ed7 bytes) 2024-09-14T08:41:21.075 INFO:teuthology.orchestra.run.smithi188.stdout:2937 read 0x3ff8200 thru 0x3ffb7b9 (0x35ba bytes) 2024-09-14T08:41:21.077 INFO:teuthology.orchestra.run.smithi188.stdout:2938 punch from 0x4316800 to 0x4322e00, (0xc600 bytes) 2024-09-14T08:41:21.157 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:21.158+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:21.162 INFO:teuthology.orchestra.run.smithi188.stdout:2939 write 0xe146c00 thru 0xe156159 (0xf55a bytes) 2024-09-14T08:41:21.164 INFO:teuthology.orchestra.run.smithi188.stdout:2940 write 0x63f7400 thru 0x64072ff (0xff00 bytes) 2024-09-14T08:41:21.165 INFO:teuthology.orchestra.run.smithi188.stdout:2943 read 0x685e200 thru 0x6864481 (0x6282 bytes) 2024-09-14T08:41:21.166 INFO:teuthology.orchestra.run.smithi188.stdout:2945 read 0x1288400 thru 0x129174b (0x934c bytes) 2024-09-14T08:41:21.167 INFO:teuthology.orchestra.run.smithi188.stdout:2946 write 0xbdcc600 thru 0xbdd7305 (0xad06 bytes) 2024-09-14T08:41:21.169 INFO:teuthology.orchestra.run.smithi188.stdout:2948 trunc from 0xe156200 to 0xd471800 2024-09-14T08:41:21.216 INFO:teuthology.orchestra.run.smithi188.stdout:2949 read 0xb274c00 thru 0xb280584 (0xb985 bytes) 2024-09-14T08:41:21.218 INFO:teuthology.orchestra.run.smithi188.stdout:2950 write 0x175000 thru 0x17c893 (0x7894 bytes) 2024-09-14T08:41:21.219 INFO:teuthology.orchestra.run.smithi188.stdout:2952 read 0x5a8a600 thru 0x5a8d600 (0x3001 bytes) 2024-09-14T08:41:21.220 INFO:teuthology.orchestra.run.smithi188.stdout:2954 write 0x7fcc000 thru 0x7fcf56a (0x356b bytes) 2024-09-14T08:41:21.220 INFO:teuthology.orchestra.run.smithi188.stdout:2960 read 0x60bdc00 thru 0x60be504 (0x905 bytes) 2024-09-14T08:41:21.222 INFO:teuthology.orchestra.run.smithi188.stdout:2961 write 0x6934000 thru 0x6935914 (0x1915 bytes) 2024-09-14T08:41:21.222 INFO:teuthology.orchestra.run.smithi188.stdout:2962 read 0x6fbe200 thru 0x6fc6980 (0x8781 bytes) 2024-09-14T08:41:21.222 INFO:teuthology.orchestra.run.smithi188.stdout:2963 read 0xc594c00 thru 0xc59825d (0x365e bytes) 2024-09-14T08:41:21.222 INFO:teuthology.orchestra.run.smithi188.stdout:2968 write 0x913ca00 thru 0x913e857 (0x1e58 bytes) 2024-09-14T08:41:21.224 INFO:teuthology.orchestra.run.smithi188.stdout:2970 punch from 0x24fc600 to 0x2500000, (0x3a00 bytes) 2024-09-14T08:41:21.225 INFO:teuthology.orchestra.run.smithi188.stdout:2972 write 0x9c87a00 thru 0x9c8f8a5 (0x7ea6 bytes) 2024-09-14T08:41:21.225 INFO:teuthology.orchestra.run.smithi188.stdout:2974 clone 24 order 19 su 2048 sc 6 2024-09-14T08:41:21.244 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:21.244 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:21.249 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:21.248+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:21.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:21.349 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:21.350+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:21.423 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:21.423 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:21.437 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:21.481 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:21.482+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:21.551 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:21.550+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:21.606 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:21.606 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:21.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:21.661 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:21.662+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:21.753 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:21.754+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:21.783 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:21.784 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:21.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:21.854 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:21.852+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:21.867 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone23 from 0xd471800 (overlap 0x4ef7400) to 0x277ba00 2024-09-14T08:41:21.954 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:21.954+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:21.974 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:21.974 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:21.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:22.055 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:22.052+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:22.156 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:22.156+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:22.161 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:22.161 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:22.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:22.257 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:22.258+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:22.311 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:22.311 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:22.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:22.358 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:22.358+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:22.451 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:22.452 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:22.459 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:22.456+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:22.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:22.509 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-14T08:41:22.560 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:22.560+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:22.660 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:22.660+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:22.666 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:22.666 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:22.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:22.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:41:22.761 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:22.762+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:22.824 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:22.867 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:22.868+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:22.885 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:22.885 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:22.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:22.963 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:22.962+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:23.014 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:41:23.014 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-14T08:41:23.047 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:23.047 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:23.063 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:23.064+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:23.081 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:23.111 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:23.112 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:23.121 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:23.121 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:23.121 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:23.121 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:23.122 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:23.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:23.140 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:23.140 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:23.165 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:23.162+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:23.167 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:23.167 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:23.265 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:23.264+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:23.307 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33406 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3582976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.031142287999998, 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066133626000000001, 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33406 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277951+0000", 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277952+0000", 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4300000000000001e-07 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277955+0000", 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277964+0000", 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8850000000000005e-06 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277971+0000", 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8929999999999999e-06 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343793+0000", 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065822497999999993 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.343897+0000", 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103614 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344085+0000", 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018789699999999999 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33407 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3564544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.031113492000003, 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066410369999999996, 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33407 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277980+0000", 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277981+0000", 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277984+0000", 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9490000000000001e-06 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277992+0000", 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7420000000000003e-06 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.277999+0000", 2024-09-14T08:41:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344155+0000", 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066155367000000007 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344254+0000", 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9508999999999999e-05 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344390+0000", 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013604099999999999 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33408 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3575808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.031084672999995, 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066720471000000003, 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33408 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278009+0000", 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3e-07 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278012+0000", 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8159999999999998e-06 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278021+0000", 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4989999999999994e-06 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278028+0000", 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2289999999999997e-06 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344465+0000", 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066436871999999994 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344596+0000", 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013133599999999999 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344729+0000", 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133089 2024-09-14T08:41:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33409 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3594240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.031056344000007, 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066980242999999995, 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33409 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278037+0000", 2024-09-14T08:41:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278038+0000", 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278041+0000", 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8930000000000001e-06 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278050+0000", 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5720000000000003e-06 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278057+0000", 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344794+0000", 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066737348000000002 2024-09-14T08:41:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.344891+0000", 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6842999999999994e-05 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345017+0000", 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126105 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33410 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3587072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.031027144000007, 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067284273000000006, 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33410 2024-09-14T08:41:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278066+0000", 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278067+0000", 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278070+0000", 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9560000000000002e-06 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278082+0000", 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1759e-05 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278089+0000", 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2819999999999999e-06 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345101+0000", 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067011663999999999 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345197+0000", 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6327000000000001e-05 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345351+0000", 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015363900000000001 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33411 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3605504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030995136000001, 2024-09-14T08:41:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067543668000000001, 2024-09-14T08:41:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33411 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278098+0000", 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278099+0000", 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278102+0000", 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.853e-06 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278111+0000", 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8950000000000004e-06 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278118+0000", 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345416+0000", 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067298417999999999 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345514+0000", 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7666999999999998e-05 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345642+0000", 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012796199999999999 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33412 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3616768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030965859999995, 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067828713999999998, 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33412 2024-09-14T08:41:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278128+0000", 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278129+0000", 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278132+0000", 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2930000000000001e-06 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278141+0000", 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.619e-06 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278148+0000", 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4590000000000001e-06 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345716+0000", 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067567700999999994 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345818+0000", 2024-09-14T08:41:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010245499999999999 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.345956+0000", 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138164 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33413 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3628032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030936194000006, 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068127708999999995, 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33413 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278157+0000", 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278158+0000", 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1699999999999997e-07 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278161+0000", 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.942e-06 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278170+0000", 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278177+0000", 2024-09-14T08:41:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1019999999999999e-06 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346023+0000", 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067846525000000005 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346149+0000", 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125666 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346285+0000", 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136181 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33414 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030907651000007, 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068507944000000001, 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33414 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278186+0000", 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278189+0000", 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7829999999999999e-06 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278198+0000", 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.585e-06 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278205+0000", 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1189999999999999e-06 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346386+0000", 2024-09-14T08:41:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068181148999999996 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346547+0000", 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016042000000000001 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346694+0000", 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014728199999999999 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33415 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3650560~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030879345000002, 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068786209000000001, 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33415 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278214+0000", 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278215+0000", 2024-09-14T08:41:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278218+0000", 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8600000000000001e-06 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278226+0000", 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5320000000000006e-06 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278234+0000", 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5619999999999998e-06 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346763+0000", 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068529118999999999 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.346863+0000", 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100219 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347000+0000", 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013730099999999999 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33416 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3598336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030834077999998, 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069103396999999997, 2024-09-14T08:41:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33416 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278259+0000", 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278260+0000", 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278263+0000", 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.033e-06 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278273+0000", 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8320000000000001e-06 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278281+0000", 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3860000000000001e-06 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347086+0000", 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.068805793000000004 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347206+0000", 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119023 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347363+0000", 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33417 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3661824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030802456000004, 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069376285999999995, 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33417 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278291+0000", 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278292+0000", 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278303+0000", 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1185e-05 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278312+0000", 2024-09-14T08:41:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1679999999999993e-06 2024-09-14T08:41:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278320+0000", 2024-09-14T08:41:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:41:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347434+0000", 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069114106999999994 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347533+0000", 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9052e-05 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347667+0000", 2024-09-14T08:41:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134635 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33418 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3609600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030744643999995, 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069690057999999999, 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33418 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278349+0000", 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278350+0000", 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9999999999999996e-07 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278353+0000", 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4850000000000001e-06 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278364+0000", 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0316000000000001e-05 2024-09-14T08:41:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278371+0000", 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7719999999999994e-06 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347741+0000", 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069369264 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.347869+0000", 2024-09-14T08:41:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012845900000000001 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348039+0000", 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016986200000000001 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33420 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3620864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030676631000006, 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069936994000000002, 2024-09-14T08:41:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33420 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278417+0000", 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278418+0000", 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0070000000000001e-06 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278421+0000", 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9699999999999999e-06 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278433+0000", 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1773999999999999e-05 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278440+0000", 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.153e-06 2024-09-14T08:41:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348106+0000", 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069665774999999999 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348203+0000", 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7377e-05 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348354+0000", 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015093800000000001 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33421 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3632128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030641259000006, 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070232109000000001, 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33421 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278452+0000", 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278453+0000", 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278456+0000", 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-14T08:41:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278465+0000", 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8089999999999999e-06 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278474+0000", 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.755e-06 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348425+0000", 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069951435000000006 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348540+0000", 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011442699999999999 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348684+0000", 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144747 2024-09-14T08:41:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:33422 3.8 3:101af42e:::rbd_data.10f1c6465cc8.0000000000000001:8 [read 3554304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 86.030606860000006, 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.070494811000000004, 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33422 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278487+0000", 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.278490+0000", 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.903e-06 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330180+0000", 2024-09-14T08:41:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.051689435999999998 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.330210+0000", 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0812000000000002e-05 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348753+0000", 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018542966000000001 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348852+0000", 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8202999999999995e-05 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.348981+0000", 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012984499999999999 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.003536307000005, 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.741426128000001, 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.741278956999999, 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.741137156999997, 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:23.407 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:23.408 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:23.409 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:23.406+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:23.509 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:23.510+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:23.550 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:23.551 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:23.551 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:23.551 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:23.565 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:23.609 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:23.608+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:23.696 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:41:23.710 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:23.708+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:23.763 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:23.763 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:23.764 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:23.764 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:23.764 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:23.783 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:23.833 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:23.834+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:23.907 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.660163494000003, 2024-09-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:41:23.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:41:23.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.660101480999998, 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.913 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:23.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.660035151000002, 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:41:23.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:41:23.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659979691000004, 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:41:23.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.926 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659920071000002, 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:41:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:41:23.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659838531000005, 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.932 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:41:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:41:23.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659782203000006, 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.937 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:23.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:41:23.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659710708000006, 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.942 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659637837000005, 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:41:23.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659595624999994, 2024-09-14T08:41:23.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:23.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:41:23.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659565795000006, 2024-09-14T08:41:23.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:23.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:41:23.960 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659537498000006, 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.961 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:23.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:41:23.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659496403000006, 2024-09-14T08:41:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659467372999998, 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.970 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.974 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659438889, 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:23.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659410749000003, 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:41:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:41:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:41:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659382053000002, 2024-09-14T08:41:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:41:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659353296000006, 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:41:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659325249000005, 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:41:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:41:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 85.659295271999994, 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:41:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.004 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:24.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:41:24.006 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:24.007 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:24.006+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:24.072 INFO:teuthology.orchestra.run.smithi188.stdout:2975 punch from 0x241ea00 to 0x2421800, (0x2e00 bytes) 2024-09-14T08:41:24.106 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:24.104+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:24.138 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:24.139 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:24.139 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:24.139 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:24.153 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T08:41:24.175 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:24.175 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:24.189 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:24.237 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:24.238+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:24.308 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:24.306+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:24.313 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:24.327 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:24.409 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:24.408+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:24.425 INFO:teuthology.orchestra.run.smithi188.stdout:2977 write 0x1f3c600 thru 0x1f3f45e (0x2e5f bytes) 2024-09-14T08:41:24.427 INFO:teuthology.orchestra.run.smithi188.stdout:2978 read 0x46af800 thru 0x46b631d (0x6b1e bytes) 2024-09-14T08:41:24.429 INFO:teuthology.orchestra.run.smithi188.stdout:2981 punch from 0x118aa00 to 0x1190a00, (0x6000 bytes) 2024-09-14T08:41:24.492 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:24.492 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:24.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:24.492 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:24.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.492 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15670 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.593913958000002, 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098222009999999998, 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15670 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898444+0000", 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898680+0000", 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023620499999999999 2024-09-14T08:41:24.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898686+0000", 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3339999999999998e-06 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898713+0000", 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089000000000001e-05 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898728+0000", 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4783000000000001e-05 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996319+0000", 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097590848999999993 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996480+0000", 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016126700000000001 2024-09-14T08:41:24.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996666+0000", 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018548300000000001 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15671 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2277376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.593607332999994, 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098330253000000006, 2024-09-14T08:41:24.497 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15671 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.898750+0000", 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899110+0000", 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035973899999999998 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899115+0000", 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1320000000000002e-06 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899129+0000", 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.402e-05 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899139+0000", 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0148e-05 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996732+0000", 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097592904999999994 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.996861+0000", 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012851299999999999 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997081+0000", 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021979599999999999 2024-09-14T08:41:24.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15672 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2143232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.593203998000007, 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098289721999999996, 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15672 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899154+0000", 2024-09-14T08:41:24.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899499+0000", 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034539 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899506+0000", 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6479999999999997e-06 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899523+0000", 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.683e-05 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899537+0000", 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3969e-05 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997142+0000", 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097605406000000006 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997231+0000", 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8568999999999999e-05 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997443+0000", 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021290999999999999 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15673 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2288640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.506 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.592800295000004, 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098305504000000002, 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15673 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899557+0000", 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899857+0000", 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000299234 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899862+0000", 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899874+0000", 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2283000000000001e-05 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899884+0000", 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0023e-05 2024-09-14T08:41:24.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997506+0000", 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097622180000000003 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997632+0000", 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012604599999999999 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997863+0000", 2024-09-14T08:41:24.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000230638 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15674 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2154496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.592449548999994, 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098325855000000004, 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15674 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.899908+0000", 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900202+0000", 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029382399999999998 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900209+0000", 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900237+0000", 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8302000000000001e-05 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900266+0000", 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9062000000000001e-05 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.997925+0000", 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097658574999999997 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998055+0000", 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013080899999999999 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998234+0000", 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017857600000000001 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15675 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2299904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.515 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.592063276999994, 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098351372000000006, 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15675 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900294+0000", 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900418+0000", 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012379200000000001 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900436+0000", 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8201000000000001e-05 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900450+0000", 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3087e-05 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900458+0000", 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9409999999999996e-06 2024-09-14T08:41:24.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998296+0000", 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097837809999999997 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998421+0000", 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124406 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998646+0000", 2024-09-14T08:41:24.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022513500000000001 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15676 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2165760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.591872744, 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098462675999999999, 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15676 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900485+0000", 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900909+0000", 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042353900000000001 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900915+0000", 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.754e-06 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900944+0000", 2024-09-14T08:41:24.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8883000000000001e-05 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900957+0000", 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2632999999999999e-05 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998704+0000", 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097747165999999996 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998797+0000", 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3140999999999995e-05 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.998948+0000", 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015056 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15677 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2311168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.591366015999995, 2024-09-14T08:41:24.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098353114000000005, 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15677 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.900992+0000", 2024-09-14T08:41:24.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901250+0000", 2024-09-14T08:41:24.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025851900000000002 2024-09-14T08:41:24.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901257+0000", 2024-09-14T08:41:24.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8979999999999999e-06 2024-09-14T08:41:24.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901272+0000", 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4399000000000001e-05 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901296+0000", 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3981999999999998e-05 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999010+0000", 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097714067000000002 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999135+0000", 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999345+0000", 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020971 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.530 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15678 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2177024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.591039944000002, 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098316776999999994, 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15678 2024-09-14T08:41:24.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901318+0000", 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901573+0000", 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025547500000000002 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901580+0000", 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901594+0000", 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4389000000000001e-05 2024-09-14T08:41:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901606+0000", 2024-09-14T08:41:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1301000000000001e-05 2024-09-14T08:41:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999403+0000", 2024-09-14T08:41:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097797144000000003 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999489+0000", 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5999000000000001e-05 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999635+0000", 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014582000000000001 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.535 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15679 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2322432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.590730332000007, 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098411090000000007, 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.536 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15679 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.901627+0000", 2024-09-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902052+0000", 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042502399999999997 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902060+0000", 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902074+0000", 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4939e-05 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902090+0000", 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5063e-05 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999696+0000", 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097606227000000004 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.999820+0000", 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012418600000000001 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000038+0000", 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021856600000000001 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15680 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2188288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.540 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.590234789999997, 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098248542999999994, 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15680 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902123+0000", 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902370+0000", 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000246908 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902376+0000", 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6470000000000001e-06 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902393+0000", 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6319000000000001e-05 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902418+0000", 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5072e-05 2024-09-14T08:41:24.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000092+0000", 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097673895999999996 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000167+0000", 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4915999999999999e-05 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000371+0000", 2024-09-14T08:41:24.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204785 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15681 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2333696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.589919031999997, 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098370079999999999, 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.545 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15681 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902439+0000", 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902857+0000", 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041791000000000002 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902864+0000", 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9040000000000003e-06 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902884+0000", 2024-09-14T08:41:24.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0672000000000001e-05 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902903+0000", 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9233999999999999e-05 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000446+0000", 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097542693 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000594+0000", 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014755200000000001 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000809+0000", 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021511499999999999 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.549 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15682 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2199552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.589431595999997, 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098268049999999996, 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15682 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.902926+0000", 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903206+0000", 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000279788 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903212+0000", 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5749999999999997e-06 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903231+0000", 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8088999999999999e-05 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903256+0000", 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5327999999999999e-05 2024-09-14T08:41:24.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.000883+0000", 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627507000000002 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001022+0000", 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013881899999999999 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001194+0000", 2024-09-14T08:41:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017194399999999999 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15683 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2344960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.589081583999999, 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098255345999999993, 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.554 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15683 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903276+0000", 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903700+0000", 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042337700000000001 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903707+0000", 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1600000000000001e-06 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903724+0000", 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7096e-05 2024-09-14T08:41:24.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.903738+0000", 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4051e-05 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001256+0000", 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097517673999999999 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001353+0000", 2024-09-14T08:41:24.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7217000000000001e-05 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001531+0000", 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017877100000000001 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15685 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2356224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.588290465, 2024-09-14T08:41:24.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098211227999999998, 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15685 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904067+0000", 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904418+0000", 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035105999999999999 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904424+0000", 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1689999999999997e-06 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904450+0000", 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5386000000000001e-05 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904460+0000", 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.001968+0000", 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097508616000000006 2024-09-14T08:41:24.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002071+0000", 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102769 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002278+0000", 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020756299999999999 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:15686 3.3 3:c690aaa3:::rbd_data.10f1c6465cc8.0000000000000010:8 [read 2222080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.587881405999994, 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098181130000000005, 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15686 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.904476+0000", 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905377+0000", 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000900236 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905388+0000", 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1513e-05 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905406+0000", 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7957000000000001e-05 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:09.905437+0000", 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1263000000000002e-05 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002338+0000", 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096900699000000007 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002481+0000", 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014292100000000001 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:10.002657+0000", 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000176541 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.758758078, 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.567 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:41:24.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:41:24.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:24.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.223004252999999, 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:24.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:41:24.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:41:24.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:24.578 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.188339368999999, 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:41:24.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:41:24.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.188138398, 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.584 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:24.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.589 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:24.589 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:24.589 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:24.590 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:24.591 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:24.590+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:24.691 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:24.688+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:24.705 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T08:41:24.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T08:41:24.771 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:24.771 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:24.771 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:24.771 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:24.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:24.815 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:24.816+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:24.892 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:24.892+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:24.919 INFO:teuthology.orchestra.run.smithi188.stdout:2982 read 0xc7e1000 thru 0xc7e9c28 (0x8c29 bytes) 2024-09-14T08:41:24.927 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:24.928 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:24.928 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:24.928 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:24.928 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:24.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:24.950 INFO:teuthology.orchestra.run.smithi188.stdout:2983 trunc from 0xd471800 to 0xae88c00 2024-09-14T08:41:24.993 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:24.994+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:25.076 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.999081408999999, 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:41:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:41:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.999014012000004, 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:41:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:41:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.998940316000002, 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:41:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:41:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.998864843999996, 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:41:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:41:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.998807639999995, 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:41:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:41:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.998748755999998, 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.998683830000004, 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.998622378999997, 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:41:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.998562844999995, 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:41:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.998503534999998, 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:41:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:41:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:41:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.998431503000006, 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:41:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.843984009000003, 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:41:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:41:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.843953231, 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:41:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:41:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:41:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:41:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:41:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.843887528000003, 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.138 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:41:25.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.843765357000002, 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:41:25.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.843731126000002, 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:25.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:41:25.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.843699700999998, 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.152 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:41:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:41:25.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.479836081, 2024-09-14T08:41:25.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:25.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:41:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.161 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.479776730999999, 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:25.162 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:41:25.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:41:25.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.168 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.479736779, 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:25.169 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:41:25.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:25.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:41:25.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:41:25.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:25.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:25.175 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:25.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:41:25.177 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:25.176+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:25.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:25.277 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:25.274+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:25.303 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:25.304 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:25.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:41:25.347 INFO:teuthology.orchestra.run.smithi188.stdout:2984 write 0x5c74800 thru 0x5c7cbd2 (0x83d3 bytes) 2024-09-14T08:41:25.350 INFO:teuthology.orchestra.run.smithi188.stdout:2988 trunc from 0xae88c00 to 0xad54600 2024-09-14T08:41:25.374 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:41:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:41:25.378 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:25.378+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:25.396 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:25.396 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:25.425 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:25.425 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:25.457 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:25.479 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:25.478+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:25.481 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:25.481 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:25.486 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:25.486 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:25.502 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:41:25.504 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:25.505 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:25.580 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:25.580+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:25.618 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:25.618 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:25.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:25.681 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:25.682+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:25.714 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T08:41:25.723 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:41:25.734 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T08:41:25.781 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:25.782+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:25.794 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:25.795 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:25.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:25.882 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:25.882+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:25.965 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:25.965 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:25.969 INFO:teuthology.orchestra.run.smithi188.stdout:2992 read 0x34afe00 thru 0x34b6300 (0x6501 bytes) 2024-09-14T08:41:25.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:26.023 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:26.024+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:26.036 INFO:teuthology.orchestra.run.smithi188.stdout:2993 trunc from 0xad54600 to 0x67cd400 2024-09-14T08:41:26.083 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:26.082+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:26.098 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:26.098 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:26.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:26.199 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:26.200+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:26.268 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:26.269 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:26.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:26.324 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:26.324+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:26.386 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:26.386+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:26.467 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:26.467 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:26.483 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:26.485 INFO:teuthology.orchestra.run.smithi188.stdout:2994 punch from 0x11c2600 to 0x11c8000, (0x5a00 bytes) 2024-09-14T08:41:26.486 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:26.484+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:26.488 INFO:teuthology.orchestra.run.smithi188.stdout:2997 write 0xad0c00 thru 0xad90f6 (0x84f7 bytes) 2024-09-14T08:41:26.490 INFO:teuthology.orchestra.run.smithi188.stdout:2998 read 0x6184e00 thru 0x619088f (0xba90 bytes) 2024-09-14T08:41:26.527 INFO:teuthology.orchestra.run.smithi188.stdout:3001 trunc from 0x67cd400 to 0xdfd4e00 2024-09-14T08:41:26.587 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:26.588+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:26.592 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:26.593 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:26.605 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:26.688 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:26.686+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:26.727 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:41:26.727 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T08:41:26.752 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T08:41:26.768 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:26.768 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:26.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:26.795 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:26.796+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:26.889 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:26.890+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:26.926 INFO:teuthology.orchestra.run.smithi188.stdout:3003 punch from 0x58e8800 to 0x58ee600, (0x5e00 bytes) 2024-09-14T08:41:26.974 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:26.974 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:26.977 INFO:teuthology.orchestra.run.smithi188.stdout:3005 read 0xc33be00 thru 0xc34711b (0xb31c bytes) 2024-09-14T08:41:26.977 INFO:teuthology.orchestra.run.smithi188.stdout:3007 punch from 0xcb79a00 to 0xcb79c00, (0x200 bytes) 2024-09-14T08:41:26.978 INFO:teuthology.orchestra.run.smithi188.stdout:3008 write 0x511a600 thru 0x511f605 (0x5006 bytes) 2024-09-14T08:41:26.990 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:26.988+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:26.991 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:27.089 INFO:teuthology.orchestra.run.smithi188.stdout:3010 read 0x7b0d800 thru 0x7b191bb (0xb9bc bytes) 2024-09-14T08:41:27.090 INFO:teuthology.orchestra.run.smithi188.stdout:3011 punch from 0x1ec7800 to 0x1ed6800, (0xf000 bytes) 2024-09-14T08:41:27.090 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:27.090+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:27.163 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:27.164 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:27.179 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:27.221 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:27.222+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout:3012 trunc from 0xdfd4e00 to 0x81a3400 2024-09-14T08:41:27.291 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:27.292+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:27.342 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:27.342 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:27.356 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:27.393 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:27.392+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:27.478 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:27.478 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:27.492 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:27.495 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:27.494+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:27.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:27.594 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:27.594+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:27.614 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:27.614 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:27.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:27.686 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:41:27.686 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:41:27.702 INFO:teuthology.orchestra.run.smithi188.stdout:3013 write 0xbee6600 thru 0xbeefb60 (0x9561 bytes) 2024-09-14T08:41:27.704 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:27.704 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:27.705 INFO:teuthology.orchestra.run.smithi188.stdout:3015 trunc from 0xbeefc00 to 0xd1a5200 2024-09-14T08:41:27.713 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:27.714+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:27.722 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:27.722 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:27.730 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T08:41:27.743 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:27.743 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:27.748 INFO:teuthology.orchestra.run.smithi188.stdout:3016 write 0xf87000 thru 0xf92a60 (0xba61 bytes) 2024-09-14T08:41:27.751 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T08:41:27.751 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:41:27.764 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:27.764 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:27.781 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:27.783 INFO:teuthology.orchestra.run.smithi188.stdout:3019 trunc from 0xd1a5200 to 0x5734600 2024-09-14T08:41:27.795 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:27.796+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:27.808 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:27.808 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:27.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:27.808 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:17419 3.17 3:ee56b1dd:::rbd_object_map.10f1b915d14f:head [call lock.assert_locked in=44b,call rbd.object_map_update in=39b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:27.808 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:27.809901+0000", 2024-09-14T08:41:27.808 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00098767899999999999, 2024-09-14T08:41:27.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010204369999999999, 2024-09-14T08:41:27.808 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:27.808 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17419 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:27.809901+0000", 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:27.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:27.809901+0000", 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:27.809903+0000", 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.891e-06 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:27.809910+0000", 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2529999999999998e-06 2024-09-14T08:41:27.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:27.809938+0000", 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7809000000000001e-05 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:27.809950+0000", 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1440000000000001e-05 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:27.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:27.810026+0000", 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6608999999999998e-05 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:27.810139+0000", 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011302300000000001 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:27.810610+0000", 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047084399999999999 2024-09-14T08:41:27.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:27.813 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:27.813 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:27.813 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:27.813 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:41:27.813 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 1 2024-09-14T08:41:27.813 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:27.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:27.856 INFO:teuthology.orchestra.run.smithi188.stdout:3021 write 0xcfb4600 thru 0xcfbb59b (0x6f9c bytes) 2024-09-14T08:41:27.858 INFO:teuthology.orchestra.run.smithi188.stdout:3022 read 0x7309e00 thru 0x7311940 (0x7b41 bytes) 2024-09-14T08:41:27.859 INFO:teuthology.orchestra.run.smithi188.stdout:3024 write 0x4373a00 thru 0x4383201 (0xf802 bytes) 2024-09-14T08:41:27.868 INFO:teuthology.orchestra.run.smithi188.stdout:3025 trunc from 0xcfbb600 to 0x96ece00 2024-09-14T08:41:27.913 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:27.914+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:27.998 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:27.996+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:28.032 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:28.032 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:28.032 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:28.032 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:28.032 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:28.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:41:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:41:28.100 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-14T08:41:27.732421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":820424376,"num_objects":1209,"num_object_clones":210,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":497,"num_read":428805,"num_read_kb":825522,"num_write":14801,"num_write_kb":196313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1285,"num_bytes_recovered":35144917,"num_keys_recovered":219,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12781,"ondisk_log_size":12781,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":330836,"kb_used_data":147776,"kb_used_omap":6,"kb_used_meta":182969,"kb_avail":377156524,"statfs":{"total":386547056640,"available":386208280576,"internally_reserved":0,"allocated":151322624,"data_stored":176808025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6380,"internal_metadata":187361044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31505584,"num_objects":50,"num_object_clones":18,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":9,"num_read":22094,"num_read_kb":69839,"num_write":208,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031378"},"pg_stats":[{"pgid":"3.1f","version":"107'188","reported_seq":2660,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716525+0000","last_change":"2024-09-14T08:41:12.613999+0000","last_active":"2024-09-14T08:41:25.716525+0000","last_peered":"2024-09-14T08:41:25.716525+0000","last_clean":"2024-09-14T08:41:25.716525+0000","last_became_active":"2024-09-14T08:41:12.610989+0000","last_became_peered":"2024-09-14T08:41:12.610989+0000","last_unstale":"2024-09-14T08:41:25.716525+0000","last_undegraded":"2024-09-14T08:41:25.716525+0000","last_fullsized":"2024-09-14T08:41:25.716525+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:40.698863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001451897,"stat_sum":{"num_bytes":10496090,"num_objects":32,"num_object_clones":5,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":17,"num_read":2346,"num_read_kb":8144,"num_write":182,"num_write_kb":2915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":1404084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"106'232","reported_seq":28775,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716324+0000","last_change":"2024-09-14T08:40:40.488885+0000","last_active":"2024-09-14T08:41:25.716324+0000","last_peered":"2024-09-14T08:41:25.716324+0000","last_clean":"2024-09-14T08:41:25.716324+0000","last_became_active":"2024-09-14T08:40:40.416949+0000","last_became_peered":"2024-09-14T08:40:40.416949+0000","last_unstale":"2024-09-14T08:41:25.716324+0000","last_undegraded":"2024-09-14T08:41:25.716324+0000","last_fullsized":"2024-09-14T08:41:25.716324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:31.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013459450000000001,"stat_sum":{"num_bytes":23830560,"num_objects":40,"num_object_clones":7,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":20,"num_read":28329,"num_read_kb":31998,"num_write":214,"num_write_kb":1541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"102'367","reported_seq":5501,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805309+0000","last_change":"2024-09-14T08:40:16.727831+0000","last_active":"2024-09-14T08:41:25.805309+0000","last_peered":"2024-09-14T08:41:25.805309+0000","last_clean":"2024-09-14T08:41:25.805309+0000","last_became_active":"2024-09-14T08:40:16.726695+0000","last_became_peered":"2024-09-14T08:40:16.726695+0000","last_unstale":"2024-09-14T08:41:25.805309+0000","last_undegraded":"2024-09-14T08:41:25.805309+0000","last_fullsized":"2024-09-14T08:41:25.805309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:15.266925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003027493,"stat_sum":{"num_bytes":16354334,"num_objects":46,"num_object_clones":9,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":21,"num_read":6542,"num_read_kb":33008,"num_write":326,"num_write_kb":2885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"105'462","reported_seq":6443,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804876+0000","last_change":"2024-09-14T08:40:16.728168+0000","last_active":"2024-09-14T08:41:25.804876+0000","last_peered":"2024-09-14T08:41:25.804876+0000","last_clean":"2024-09-14T08:41:25.804876+0000","last_became_active":"2024-09-14T08:40:16.726971+0000","last_became_peered":"2024-09-14T08:40:16.726971+0000","last_unstale":"2024-09-14T08:41:25.804876+0000","last_undegraded":"2024-09-14T08:41:25.804876+0000","last_fullsized":"2024-09-14T08:41:25.804876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:28.209308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001345691,"stat_sum":{"num_bytes":27904046,"num_objects":36,"num_object_clones":4,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":15,"num_read":6677,"num_read_kb":37615,"num_write":549,"num_write_kb":4805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"106'677","reported_seq":8346,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804766+0000","last_change":"2024-09-14T08:41:13.630764+0000","last_active":"2024-09-14T08:41:25.804766+0000","last_peered":"2024-09-14T08:41:25.804766+0000","last_clean":"2024-09-14T08:41:25.804766+0000","last_became_active":"2024-09-14T08:41:13.628717+0000","last_became_peered":"2024-09-14T08:41:13.628717+0000","last_unstale":"2024-09-14T08:41:25.804766+0000","last_undegraded":"2024-09-14T08:41:25.804766+0000","last_fullsized":"2024-09-14T08:41:25.804766+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:18.463628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910279999999999,"stat_sum":{"num_bytes":15829155,"num_objects":33,"num_object_clones":4,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":11,"num_read":9226,"num_read_kb":34085,"num_write":745,"num_write_kb":3654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":1165399,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"105'262","reported_seq":4187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.971688+0000","last_change":"2024-09-14T08:39:20.388365+0000","last_active":"2024-09-14T08:41:25.971688+0000","last_peered":"2024-09-14T08:41:25.971688+0000","last_clean":"2024-09-14T08:41:25.971688+0000","last_became_active":"2024-09-14T08:39:18.383879+0000","last_became_peered":"2024-09-14T08:39:18.383879+0000","last_unstale":"2024-09-14T08:41:25.971688+0000","last_undegraded":"2024-09-14T08:41:25.971688+0000","last_fullsized":"2024-09-14T08:41:25.971688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:21.226698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211712,"stat_sum":{"num_bytes":21003846,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":12,"num_read":4119,"num_read_kb":7737,"num_write":304,"num_write_kb":2185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"107'363","reported_seq":2815,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.368081+0000","last_change":"2024-09-14T08:39:20.386019+0000","last_active":"2024-09-14T08:41:26.368081+0000","last_peered":"2024-09-14T08:41:26.368081+0000","last_clean":"2024-09-14T08:41:26.368081+0000","last_became_active":"2024-09-14T08:39:18.384097+0000","last_became_peered":"2024-09-14T08:39:18.384097+0000","last_unstale":"2024-09-14T08:41:26.368081+0000","last_undegraded":"2024-09-14T08:41:26.368081+0000","last_fullsized":"2024-09-14T08:41:26.368081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:01.815488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014331750000000001,"stat_sum":{"num_bytes":11979527,"num_objects":40,"num_object_clones":4,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":15,"num_read":2921,"num_read_kb":13849,"num_write":439,"num_write_kb":5012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"108'254","reported_seq":3962,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.085537+0000","last_change":"2024-09-14T08:41:12.610519+0000","last_active":"2024-09-14T08:41:26.085537+0000","last_peered":"2024-09-14T08:41:26.085537+0000","last_clean":"2024-09-14T08:41:26.085537+0000","last_became_active":"2024-09-14T08:41:12.608616+0000","last_became_peered":"2024-09-14T08:41:12.608616+0000","last_unstale":"2024-09-14T08:41:26.085537+0000","last_undegraded":"2024-09-14T08:41:26.085537+0000","last_fullsized":"2024-09-14T08:41:26.085537+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:49.237431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922599999999997,"stat_sum":{"num_bytes":31239332,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":19,"num_read":3505,"num_read_kb":22838,"num_write":224,"num_write_kb":1869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":68,"num_bytes_recovered":110244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"107'244","reported_seq":5230,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.337329+0000","last_change":"2024-09-14T08:41:12.609333+0000","last_active":"2024-09-14T08:41:25.337329+0000","last_peered":"2024-09-14T08:41:25.337329+0000","last_clean":"2024-09-14T08:41:25.337329+0000","last_became_active":"2024-09-14T08:41:12.608651+0000","last_became_peered":"2024-09-14T08:41:12.608651+0000","last_unstale":"2024-09-14T08:41:25.337329+0000","last_undegraded":"2024-09-14T08:41:25.337329+0000","last_fullsized":"2024-09-14T08:41:25.337329+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:34.316586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862059999999999,"stat_sum":{"num_bytes":26000267,"num_objects":37,"num_object_clones":6,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":5120,"num_read_kb":32628,"num_write":252,"num_write_kb":3377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":1537296,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"107'250","reported_seq":2663,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831163+0000","last_change":"2024-09-14T08:40:40.555724+0000","last_active":"2024-09-14T08:41:25.831163+0000","last_peered":"2024-09-14T08:41:25.831163+0000","last_clean":"2024-09-14T08:41:25.831163+0000","last_became_active":"2024-09-14T08:40:40.416704+0000","last_became_peered":"2024-09-14T08:40:40.416704+0000","last_unstale":"2024-09-14T08:41:25.831163+0000","last_undegraded":"2024-09-14T08:41:25.831163+0000","last_fullsized":"2024-09-14T08:41:25.831163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:51.887608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029337040000000001,"stat_sum":{"num_bytes":13593327,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":17,"num_read":26711,"num_read_kb":26160,"num_write":246,"num_write_kb":3703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"106'235","reported_seq":2414,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.366888+0000","last_change":"2024-09-14T08:41:12.611692+0000","last_active":"2024-09-14T08:41:26.366888+0000","last_peered":"2024-09-14T08:41:26.366888+0000","last_clean":"2024-09-14T08:41:26.366888+0000","last_became_active":"2024-09-14T08:41:12.610726+0000","last_became_peered":"2024-09-14T08:41:12.610726+0000","last_unstale":"2024-09-14T08:41:26.366888+0000","last_undegraded":"2024-09-14T08:41:26.366888+0000","last_fullsized":"2024-09-14T08:41:26.366888+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:42.823421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018449409999999999,"stat_sum":{"num_bytes":46756449,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":19,"num_read":2854,"num_read_kb":15947,"num_write":231,"num_write_kb":5407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":4475074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"108'232","reported_seq":31418,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.993155+0000","last_change":"2024-09-14T08:40:40.495288+0000","last_active":"2024-09-14T08:41:25.993155+0000","last_peered":"2024-09-14T08:41:25.993155+0000","last_clean":"2024-09-14T08:41:25.993155+0000","last_became_active":"2024-09-14T08:40:40.411694+0000","last_became_peered":"2024-09-14T08:40:40.411694+0000","last_unstale":"2024-09-14T08:41:25.993155+0000","last_undegraded":"2024-09-14T08:41:25.993155+0000","last_fullsized":"2024-09-14T08:41:25.993155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:42:06.156101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014343330000000001,"stat_sum":{"num_bytes":37907700,"num_objects":31,"num_object_clones":3,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":11,"num_read":31118,"num_read_kb":34784,"num_write":246,"num_write_kb":1508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":222964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805384+0000","last_change":"2024-09-14T08:40:40.408528+0000","last_active":"2024-09-14T08:41:25.805384+0000","last_peered":"2024-09-14T08:41:25.805384+0000","last_clean":"2024-09-14T08:41:25.805384+0000","last_became_active":"2024-09-14T08:40:40.408122+0000","last_became_peered":"2024-09-14T08:40:40.408122+0000","last_unstale":"2024-09-14T08:41:25.805384+0000","last_undegraded":"2024-09-14T08:41:25.805384+0000","last_fullsized":"2024-09-14T08:41:25.805384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:43.290991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"105'1754","reported_seq":49623,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.004952+0000","last_change":"2024-09-14T08:41:13.633860+0000","last_active":"2024-09-14T08:41:26.004952+0000","last_peered":"2024-09-14T08:41:26.004952+0000","last_clean":"2024-09-14T08:41:26.004952+0000","last_became_active":"2024-09-14T08:41:13.630960+0000","last_became_peered":"2024-09-14T08:41:13.630960+0000","last_unstale":"2024-09-14T08:41:26.004952+0000","last_undegraded":"2024-09-14T08:41:26.004952+0000","last_fullsized":"2024-09-14T08:41:26.004952+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:10.739240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484614,"stat_sum":{"num_bytes":40925881,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":17,"num_read":56813,"num_read_kb":45101,"num_write":3080,"num_write_kb":6480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":796857,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831315+0000","last_change":"2024-09-14T08:40:40.418897+0000","last_active":"2024-09-14T08:41:25.831315+0000","last_peered":"2024-09-14T08:41:25.831315+0000","last_clean":"2024-09-14T08:41:25.831315+0000","last_became_active":"2024-09-14T08:40:40.418160+0000","last_became_peered":"2024-09-14T08:40:40.418160+0000","last_unstale":"2024-09-14T08:41:25.831315+0000","last_undegraded":"2024-09-14T08:41:25.831315+0000","last_fullsized":"2024-09-14T08:41:25.831315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:39.281258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"106'305","reported_seq":44672,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716582+0000","last_change":"2024-09-14T08:39:20.419181+0000","last_active":"2024-09-14T08:41:25.716582+0000","last_peered":"2024-09-14T08:41:25.716582+0000","last_clean":"2024-09-14T08:41:25.716582+0000","last_became_active":"2024-09-14T08:39:18.382867+0000","last_became_peered":"2024-09-14T08:39:18.382867+0000","last_unstale":"2024-09-14T08:41:25.716582+0000","last_undegraded":"2024-09-14T08:41:25.716582+0000","last_fullsized":"2024-09-14T08:41:25.716582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:05.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015322599999999999,"stat_sum":{"num_bytes":27953221,"num_objects":44,"num_object_clones":9,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":17,"num_read":44325,"num_read_kb":42097,"num_write":313,"num_write_kb":31867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805123+0000","last_change":"2024-09-14T08:41:10.634099+0000","last_active":"2024-09-14T08:41:25.805123+0000","last_peered":"2024-09-14T08:41:25.805123+0000","last_clean":"2024-09-14T08:41:25.805123+0000","last_became_active":"2024-09-14T08:41:10.633569+0000","last_became_peered":"2024-09-14T08:41:10.633569+0000","last_unstale":"2024-09-14T08:41:25.805123+0000","last_undegraded":"2024-09-14T08:41:25.805123+0000","last_fullsized":"2024-09-14T08:41:25.805123+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:19.076436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"107'401","reported_seq":4029,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831152+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:41:25.831152+0000","last_peered":"2024-09-14T08:41:25.831152+0000","last_clean":"2024-09-14T08:41:25.831152+0000","last_became_active":"2024-09-14T08:39:18.387737+0000","last_became_peered":"2024-09-14T08:39:18.387737+0000","last_unstale":"2024-09-14T08:41:25.831152+0000","last_undegraded":"2024-09-14T08:41:25.831152+0000","last_fullsized":"2024-09-14T08:41:25.831152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:50.419016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010096059999999999,"stat_sum":{"num_bytes":38804623,"num_objects":34,"num_object_clones":4,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":17,"num_read":4526,"num_read_kb":13566,"num_write":447,"num_write_kb":18803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831202+0000","last_change":"2024-09-14T08:41:09.599832+0000","last_active":"2024-09-14T08:41:25.831202+0000","last_peered":"2024-09-14T08:41:25.831202+0000","last_clean":"2024-09-14T08:41:25.831202+0000","last_became_active":"2024-09-14T08:41:09.599051+0000","last_became_peered":"2024-09-14T08:41:09.599051+0000","last_unstale":"2024-09-14T08:41:25.831202+0000","last_undegraded":"2024-09-14T08:41:25.831202+0000","last_fullsized":"2024-09-14T08:41:25.831202+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:04.825931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"107'592","reported_seq":4690,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716309+0000","last_change":"2024-09-14T08:40:16.717901+0000","last_active":"2024-09-14T08:41:25.716309+0000","last_peered":"2024-09-14T08:41:25.716309+0000","last_clean":"2024-09-14T08:41:25.716309+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:41:25.716309+0000","last_undegraded":"2024-09-14T08:41:25.716309+0000","last_fullsized":"2024-09-14T08:41:25.716309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:42.279977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032365710000000002,"stat_sum":{"num_bytes":21401320,"num_objects":44,"num_object_clones":8,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":19,"num_read":6026,"num_read_kb":22885,"num_write":812,"num_write_kb":4932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"107'838","reported_seq":18723,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804973+0000","last_change":"2024-09-14T08:41:12.620093+0000","last_active":"2024-09-14T08:41:25.804973+0000","last_peered":"2024-09-14T08:41:25.804973+0000","last_clean":"2024-09-14T08:41:25.804973+0000","last_became_active":"2024-09-14T08:41:12.618099+0000","last_became_peered":"2024-09-14T08:41:12.618099+0000","last_unstale":"2024-09-14T08:41:25.804973+0000","last_undegraded":"2024-09-14T08:41:25.804973+0000","last_fullsized":"2024-09-14T08:41:25.804973+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:10.557988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599846,"stat_sum":{"num_bytes":11734092,"num_objects":35,"num_object_clones":5,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":18,"num_read":21277,"num_read_kb":19699,"num_write":1417,"num_write_kb":2252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":129536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":131,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831148+0000","last_change":"2024-09-14T08:40:16.717703+0000","last_active":"2024-09-14T08:41:25.831148+0000","last_peered":"2024-09-14T08:41:25.831148+0000","last_clean":"2024-09-14T08:41:25.831148+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:41:25.831148+0000","last_undegraded":"2024-09-14T08:41:25.831148+0000","last_fullsized":"2024-09-14T08:41:25.831148+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:18.988966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"102'225","reported_seq":26367,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.830886+0000","last_change":"2024-09-14T08:39:20.385113+0000","last_active":"2024-09-14T08:41:25.830886+0000","last_peered":"2024-09-14T08:41:25.830886+0000","last_clean":"2024-09-14T08:41:25.830886+0000","last_became_active":"2024-09-14T08:39:18.387585+0000","last_became_peered":"2024-09-14T08:39:18.387585+0000","last_unstale":"2024-09-14T08:41:25.830886+0000","last_undegraded":"2024-09-14T08:41:25.830886+0000","last_fullsized":"2024-09-14T08:41:25.830886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:30.252998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058750299999999996,"stat_sum":{"num_bytes":15575102,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":26180,"num_read_kb":24302,"num_write":244,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716462+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:41:25.716462+0000","last_peered":"2024-09-14T08:41:25.716462+0000","last_clean":"2024-09-14T08:41:25.716462+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:41:25.716462+0000","last_undegraded":"2024-09-14T08:41:25.716462+0000","last_fullsized":"2024-09-14T08:41:25.716462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"107'246","reported_seq":5350,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.953290+0000","last_change":"2024-09-14T08:41:12.608255+0000","last_active":"2024-09-14T08:41:25.953290+0000","last_peered":"2024-09-14T08:41:25.953290+0000","last_clean":"2024-09-14T08:41:25.953290+0000","last_became_active":"2024-09-14T08:41:12.607243+0000","last_became_peered":"2024-09-14T08:41:12.607243+0000","last_unstale":"2024-09-14T08:41:25.953290+0000","last_undegraded":"2024-09-14T08:41:25.953290+0000","last_fullsized":"2024-09-14T08:41:25.953290+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:50.129225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047135900000000002,"stat_sum":{"num_bytes":41615397,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":10,"num_read":4843,"num_read_kb":8217,"num_write":241,"num_write_kb":2837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":264741,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831003+0000","last_change":"2024-09-14T08:41:10.604621+0000","last_active":"2024-09-14T08:41:25.831003+0000","last_peered":"2024-09-14T08:41:25.831003+0000","last_clean":"2024-09-14T08:41:25.831003+0000","last_became_active":"2024-09-14T08:41:10.603797+0000","last_became_peered":"2024-09-14T08:41:10.603797+0000","last_unstale":"2024-09-14T08:41:25.831003+0000","last_undegraded":"2024-09-14T08:41:25.831003+0000","last_fullsized":"2024-09-14T08:41:25.831003+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:14.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"108'322","reported_seq":16382,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.086018+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:41:26.086018+0000","last_peered":"2024-09-14T08:41:26.086018+0000","last_clean":"2024-09-14T08:41:26.086018+0000","last_became_active":"2024-09-14T08:39:18.387242+0000","last_became_peered":"2024-09-14T08:39:18.387242+0000","last_unstale":"2024-09-14T08:41:26.086018+0000","last_undegraded":"2024-09-14T08:41:26.086018+0000","last_fullsized":"2024-09-14T08:41:26.086018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:43.812916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332069,"stat_sum":{"num_bytes":33540340,"num_objects":35,"num_object_clones":6,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":12,"num_read":16614,"num_read_kb":53339,"num_write":424,"num_write_kb":5467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":116,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716347+0000","last_change":"2024-09-14T08:40:16.718478+0000","last_active":"2024-09-14T08:41:25.716347+0000","last_peered":"2024-09-14T08:41:25.716347+0000","last_clean":"2024-09-14T08:41:25.716347+0000","last_became_active":"2024-09-14T08:40:16.717575+0000","last_became_peered":"2024-09-14T08:40:16.717575+0000","last_unstale":"2024-09-14T08:41:25.716347+0000","last_undegraded":"2024-09-14T08:41:25.716347+0000","last_fullsized":"2024-09-14T08:41:25.716347+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:50.808473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.830815+0000","last_change":"2024-09-14T08:41:11.435115+0000","last_active":"2024-09-14T08:41:25.830815+0000","last_peered":"2024-09-14T08:41:25.830815+0000","last_clean":"2024-09-14T08:41:25.830815+0000","last_became_active":"2024-09-14T08:41:10.643080+0000","last_became_peered":"2024-09-14T08:41:10.643080+0000","last_unstale":"2024-09-14T08:41:25.830815+0000","last_undegraded":"2024-09-14T08:41:25.830815+0000","last_fullsized":"2024-09-14T08:41:25.830815+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:40:48.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"105'365","reported_seq":33155,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716448+0000","last_change":"2024-09-14T08:39:20.418935+0000","last_active":"2024-09-14T08:41:25.716448+0000","last_peered":"2024-09-14T08:41:25.716448+0000","last_clean":"2024-09-14T08:41:25.716448+0000","last_became_active":"2024-09-14T08:39:18.382844+0000","last_became_peered":"2024-09-14T08:39:18.382844+0000","last_unstale":"2024-09-14T08:41:25.716448+0000","last_undegraded":"2024-09-14T08:41:25.716448+0000","last_fullsized":"2024-09-14T08:41:25.716448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:13.664235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013334390000000001,"stat_sum":{"num_bytes":19813491,"num_objects":36,"num_object_clones":3,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":14,"num_read":31831,"num_read_kb":31155,"num_write":289,"num_write_kb":1209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"101'726","reported_seq":12105,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804748+0000","last_change":"2024-09-14T08:41:11.611116+0000","last_active":"2024-09-14T08:41:25.804748+0000","last_peered":"2024-09-14T08:41:25.804748+0000","last_clean":"2024-09-14T08:41:25.804748+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:41:25.804748+0000","last_undegraded":"2024-09-14T08:41:25.804748+0000","last_fullsized":"2024-09-14T08:41:25.804748+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:10:52.089871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011980249999999999,"stat_sum":{"num_bytes":22313574,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":19,"num_read":11619,"num_read_kb":18466,"num_write":532,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"107'422","reported_seq":7991,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716306+0000","last_change":"2024-09-14T08:40:36.360897+0000","last_active":"2024-09-14T08:41:25.716306+0000","last_peered":"2024-09-14T08:41:25.716306+0000","last_clean":"2024-09-14T08:41:25.716306+0000","last_became_active":"2024-09-14T08:40:36.358876+0000","last_became_peered":"2024-09-14T08:40:36.358876+0000","last_unstale":"2024-09-14T08:41:25.716306+0000","last_undegraded":"2024-09-14T08:41:25.716306+0000","last_fullsized":"2024-09-14T08:41:25.716306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:33.739641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002911753,"stat_sum":{"num_bytes":44676673,"num_objects":30,"num_object_clones":5,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":9007,"num_read_kb":68313,"num_write":449,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":5746688,"num_keys_recovered":33,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"108'214","reported_seq":3749,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.993745+0000","last_change":"2024-09-14T08:41:12.615018+0000","last_active":"2024-09-14T08:41:25.993745+0000","last_peered":"2024-09-14T08:41:25.993745+0000","last_clean":"2024-09-14T08:41:25.993745+0000","last_became_active":"2024-09-14T08:41:12.612738+0000","last_became_peered":"2024-09-14T08:41:12.612738+0000","last_unstale":"2024-09-14T08:41:25.993745+0000","last_undegraded":"2024-09-14T08:41:25.993745+0000","last_fullsized":"2024-09-14T08:41:25.993745+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:39.985722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013500459999999999,"stat_sum":{"num_bytes":15667232,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":12,"num_read":3256,"num_read_kb":17137,"num_write":208,"num_write_kb":2667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1187360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"108'425","reported_seq":30061,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.988769+0000","last_change":"2024-09-14T08:41:13.635192+0000","last_active":"2024-09-14T08:41:25.988769+0000","last_peered":"2024-09-14T08:41:25.988769+0000","last_clean":"2024-09-14T08:41:25.988769+0000","last_became_active":"2024-09-14T08:41:13.633802+0000","last_became_peered":"2024-09-14T08:41:13.633802+0000","last_unstale":"2024-09-14T08:41:25.988769+0000","last_undegraded":"2024-09-14T08:41:25.988769+0000","last_fullsized":"2024-09-14T08:41:25.988769+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:30.965053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652499,"stat_sum":{"num_bytes":31342631,"num_objects":44,"num_object_clones":8,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":18,"num_read":32204,"num_read_kb":40814,"num_write":356,"num_write_kb":5107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":2725415,"num_keys_recovered":34,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"108'469","reported_seq":5575,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.993749+0000","last_change":"2024-09-14T08:40:43.437156+0000","last_active":"2024-09-14T08:41:25.993749+0000","last_peered":"2024-09-14T08:41:25.993749+0000","last_clean":"2024-09-14T08:41:25.993749+0000","last_became_active":"2024-09-14T08:40:43.436214+0000","last_became_peered":"2024-09-14T08:40:43.436214+0000","last_unstale":"2024-09-14T08:41:25.993749+0000","last_undegraded":"2024-09-14T08:41:25.993749+0000","last_fullsized":"2024-09-14T08:41:25.993749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:29.720933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024901429999999998,"stat_sum":{"num_bytes":18276352,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":7224,"num_read_kb":16295,"num_write":352,"num_write_kb":4951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":1135104,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"105'177","reported_seq":4482,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805355+0000","last_change":"2024-09-14T08:40:16.728183+0000","last_active":"2024-09-14T08:41:25.805355+0000","last_peered":"2024-09-14T08:41:25.805355+0000","last_clean":"2024-09-14T08:41:25.805355+0000","last_became_active":"2024-09-14T08:40:16.727022+0000","last_became_peered":"2024-09-14T08:40:16.727022+0000","last_unstale":"2024-09-14T08:41:25.805355+0000","last_undegraded":"2024-09-14T08:41:25.805355+0000","last_fullsized":"2024-09-14T08:41:25.805355+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:54.999706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002389113,"stat_sum":{"num_bytes":22237696,"num_objects":29,"num_object_clones":3,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":12,"num_read":4164,"num_read_kb":15753,"num_write":175,"num_write_kb":1689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"106'330","reported_seq":4797,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831300+0000","last_change":"2024-09-14T08:41:12.616269+0000","last_active":"2024-09-14T08:41:25.831300+0000","last_peered":"2024-09-14T08:41:25.831300+0000","last_clean":"2024-09-14T08:41:25.831300+0000","last_became_active":"2024-09-14T08:41:12.612680+0000","last_became_peered":"2024-09-14T08:41:12.612680+0000","last_unstale":"2024-09-14T08:41:25.831300+0000","last_undegraded":"2024-09-14T08:41:25.831300+0000","last_fullsized":"2024-09-14T08:41:25.831300+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:03.929265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023917970000000002,"stat_sum":{"num_bytes":47791120,"num_objects":54,"num_object_clones":13,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":22,"num_read":4369,"num_read_kb":29855,"num_write":311,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4367376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"107'270","reported_seq":3802,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716141+0000","last_change":"2024-09-14T08:41:12.610800+0000","last_active":"2024-09-14T08:41:25.716141+0000","last_peered":"2024-09-14T08:41:25.716141+0000","last_clean":"2024-09-14T08:41:25.716141+0000","last_became_active":"2024-09-14T08:41:12.608500+0000","last_became_peered":"2024-09-14T08:41:12.608500+0000","last_unstale":"2024-09-14T08:41:25.716141+0000","last_undegraded":"2024-09-14T08:41:25.716141+0000","last_fullsized":"2024-09-14T08:41:25.716141+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:50.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024547029999999999,"stat_sum":{"num_bytes":44448398,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":4940,"num_read_kb":25763,"num_write":265,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":461564,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"108'252","reported_seq":3715,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.105972+0000","last_change":"2024-09-14T08:41:13.629949+0000","last_active":"2024-09-14T08:41:26.105972+0000","last_peered":"2024-09-14T08:41:26.105972+0000","last_clean":"2024-09-14T08:41:26.105972+0000","last_became_active":"2024-09-14T08:41:13.628700+0000","last_became_peered":"2024-09-14T08:41:13.628700+0000","last_unstale":"2024-09-14T08:41:26.105972+0000","last_undegraded":"2024-09-14T08:41:26.105972+0000","last_fullsized":"2024-09-14T08:41:26.105972+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:01.135980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001362044,"stat_sum":{"num_bytes":11798095,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":20,"num_read":3899,"num_read_kb":11147,"num_write":213,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":841295,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"102'365","reported_seq":3913,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.830889+0000","last_change":"2024-09-14T08:41:12.619512+0000","last_active":"2024-09-14T08:41:25.830889+0000","last_peered":"2024-09-14T08:41:25.830889+0000","last_clean":"2024-09-14T08:41:25.830889+0000","last_became_active":"2024-09-14T08:41:12.616601+0000","last_became_peered":"2024-09-14T08:41:12.616601+0000","last_unstale":"2024-09-14T08:41:25.830889+0000","last_undegraded":"2024-09-14T08:41:25.830889+0000","last_fullsized":"2024-09-14T08:41:25.830889+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:51.614893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013117140000000001,"stat_sum":{"num_bytes":13324914,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":15,"num_read":3918,"num_read_kb":13891,"num_write":360,"num_write_kb":5180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":5260516,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"101'242","reported_seq":2045,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716225+0000","last_change":"2024-09-14T08:40:41.553903+0000","last_active":"2024-09-14T08:41:25.716225+0000","last_peered":"2024-09-14T08:41:25.716225+0000","last_clean":"2024-09-14T08:41:25.716225+0000","last_became_active":"2024-09-14T08:40:41.420572+0000","last_became_peered":"2024-09-14T08:40:41.420572+0000","last_unstale":"2024-09-14T08:41:25.716225+0000","last_undegraded":"2024-09-14T08:41:25.716225+0000","last_fullsized":"2024-09-14T08:41:25.716225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:05.821148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018326740000000001,"stat_sum":{"num_bytes":13699204,"num_objects":39,"num_object_clones":5,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":18,"num_read":2236,"num_read_kb":8879,"num_write":252,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":515126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":819833989,"num_objects":1205,"num_object_clones":210,"num_object_copies":2410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1205,"num_whiteouts":497,"num_read":428739,"num_read_kb":825467,"num_write":14698,"num_write_kb":194683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1279,"num_bytes_recovered":33373813,"num_keys_recovered":219,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":176943104,"data_stored":206775098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8169,"internal_metadata":0},"log_size":12706,"ondisk_log_size":12706,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80276,"kb_used_data":31036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94291564,"statfs":{"total":96636764160,"available":96554561536,"internally_reserved":0,"allocated":31780864,"data_stored":37088235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574881,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66512,"kb_used_data":35324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94305328,"statfs":{"total":96636764160,"available":96568655872,"internally_reserved":0,"allocated":36171776,"data_stored":38506977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118804,"kb_used_data":43196,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94253036,"statfs":{"total":96636764160,"available":96515108864,"internally_reserved":0,"allocated":44232704,"data_stored":54423502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607585,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65244,"kb_used_data":38220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94306596,"statfs":{"total":96636764160,"available":96569954304,"internally_reserved":0,"allocated":39137280,"data_stored":46789311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":0,"seq":450971566082,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16867328,"data_stored":16742054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8169,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42373120,"data_stored":53309639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34304000,"data_stored":37388132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12910592,"data_stored":14407564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30507008,"data_stored":36559760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39981056,"data_stored":48367949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:41:28.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:41:28.122 INFO:teuthology.orchestra.run.smithi188.stdout:3026 write 0xaaa3c00 thru 0xaaaeb75 (0xaf76 bytes) 2024-09-14T08:41:28.123 INFO:teuthology.orchestra.run.smithi188.stdout:3028 write 0x57e5400 thru 0x57e69a2 (0x15a3 bytes) 2024-09-14T08:41:28.125 INFO:teuthology.orchestra.run.smithi188.stdout:3030 write 0x40c7c00 thru 0x40cf0f6 (0x74f7 bytes) 2024-09-14T08:41:28.137 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:28.138+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:28.200 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:28.200+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:28.249 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54090 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5744640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171855809999997, 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096973644999999997, 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54090 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078739+0000", 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078741+0000", 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.297e-06 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078746+0000", 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6999999999999996e-06 2024-09-14T08:41:28.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078765+0000", 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8287999999999998e-05 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078778+0000", 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3865e-05 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175107+0000", 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096328178 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175336+0000", 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000228913 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175713+0000", 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037740400000000002 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.254 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171788413000002, 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:28.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:41:28.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171714717, 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.260 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:41:28.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:41:28.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:28.264 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171639244999994, 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:41:28.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171582040999994, 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.269 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:41:28.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.273 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171523156999996, 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:41:28.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.278 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171458231000003, 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.279 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.283 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171396779999995, 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:41:28.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:41:28.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:28.288 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171337245999993, 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:41:28.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:41:28.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:41:28.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:41:28.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:41:28.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.293 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.294 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.294 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:28.294 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171277935999996, 2024-09-14T08:41:28.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:41:28.294 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:28.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:41:28.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.171205904000004, 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.299 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:41:28.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:41:28.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:41:28.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:41:28.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:41:28.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24683 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3087360~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.016758410000001, 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097034945999999997, 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.304 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24683 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233837+0000", 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233840+0000", 2024-09-14T08:41:28.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233849+0000", 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1900000000000001e-06 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233857+0000", 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330418+0000", 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096560823000000004 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330591+0000", 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017270100000000001 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330872+0000", 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028107300000000001 2024-09-14T08:41:28.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.016727631999998, 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.309 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:28.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:41:28.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.016661929000001, 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:28.318 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.016539758, 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:41:28.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:41:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.016505527, 2024-09-14T08:41:28.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:28.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:41:28.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:41:28.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.016474101999997, 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.328 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:41:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.332 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.652610482, 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:28.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:41:28.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.652551131999999, 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:41:28.338 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:41:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:41:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.652511180000001, 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:41:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:41:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:41:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:41:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:28.351 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:28.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:41:28.353 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:28.352+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:28.410 INFO:teuthology.orchestra.run.smithi188.stdout:3031 write 0xe66ca00 thru 0xe675a5f (0x9060 bytes) 2024-09-14T08:41:28.412 INFO:teuthology.orchestra.run.smithi188.stdout:3032 read 0x80ec400 thru 0x80f481e (0x841f bytes) 2024-09-14T08:41:28.412 INFO:teuthology.orchestra.run.smithi188.stdout:3033 read 0xe3ede00 thru 0xe3f6ef2 (0x90f3 bytes) 2024-09-14T08:41:28.420 INFO:teuthology.orchestra.run.smithi188.stdout:3038 trunc from 0xe675c00 to 0xa7d8000 2024-09-14T08:41:28.454 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:28.452+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:28.479 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:41:28.480 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:41:28.484 INFO:teuthology.orchestra.run.smithi188.stdout:3040 read 0xdf0a00 thru 0xdf11e8 (0x7e9 bytes) 2024-09-14T08:41:28.490 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:28.490 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:28.490 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:28.490 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:28.498 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-14T08:41:28.305365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":820424376,"num_objects":1209,"num_object_clones":210,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":497,"num_read":428805,"num_read_kb":825522,"num_write":14801,"num_write_kb":196313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1285,"num_bytes_recovered":35144917,"num_keys_recovered":219,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12781,"ondisk_log_size":12781,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":330836,"kb_used_data":147776,"kb_used_omap":6,"kb_used_meta":182969,"kb_avail":377156524,"statfs":{"total":386547056640,"available":386208280576,"internally_reserved":0,"allocated":151322624,"data_stored":176808025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6380,"internal_metadata":187361044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31505584,"num_objects":50,"num_object_clones":18,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":9,"num_read":22094,"num_read_kb":69839,"num_write":208,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001037"},"pg_stats":[{"pgid":"3.1f","version":"107'188","reported_seq":2660,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716525+0000","last_change":"2024-09-14T08:41:12.613999+0000","last_active":"2024-09-14T08:41:25.716525+0000","last_peered":"2024-09-14T08:41:25.716525+0000","last_clean":"2024-09-14T08:41:25.716525+0000","last_became_active":"2024-09-14T08:41:12.610989+0000","last_became_peered":"2024-09-14T08:41:12.610989+0000","last_unstale":"2024-09-14T08:41:25.716525+0000","last_undegraded":"2024-09-14T08:41:25.716525+0000","last_fullsized":"2024-09-14T08:41:25.716525+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:40.698863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001451897,"stat_sum":{"num_bytes":10496090,"num_objects":32,"num_object_clones":5,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":17,"num_read":2346,"num_read_kb":8144,"num_write":182,"num_write_kb":2915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":1404084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"106'232","reported_seq":28775,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716324+0000","last_change":"2024-09-14T08:40:40.488885+0000","last_active":"2024-09-14T08:41:25.716324+0000","last_peered":"2024-09-14T08:41:25.716324+0000","last_clean":"2024-09-14T08:41:25.716324+0000","last_became_active":"2024-09-14T08:40:40.416949+0000","last_became_peered":"2024-09-14T08:40:40.416949+0000","last_unstale":"2024-09-14T08:41:25.716324+0000","last_undegraded":"2024-09-14T08:41:25.716324+0000","last_fullsized":"2024-09-14T08:41:25.716324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:31.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013459450000000001,"stat_sum":{"num_bytes":23830560,"num_objects":40,"num_object_clones":7,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":20,"num_read":28329,"num_read_kb":31998,"num_write":214,"num_write_kb":1541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"102'367","reported_seq":5501,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805309+0000","last_change":"2024-09-14T08:40:16.727831+0000","last_active":"2024-09-14T08:41:25.805309+0000","last_peered":"2024-09-14T08:41:25.805309+0000","last_clean":"2024-09-14T08:41:25.805309+0000","last_became_active":"2024-09-14T08:40:16.726695+0000","last_became_peered":"2024-09-14T08:40:16.726695+0000","last_unstale":"2024-09-14T08:41:25.805309+0000","last_undegraded":"2024-09-14T08:41:25.805309+0000","last_fullsized":"2024-09-14T08:41:25.805309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:15.266925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003027493,"stat_sum":{"num_bytes":16354334,"num_objects":46,"num_object_clones":9,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":21,"num_read":6542,"num_read_kb":33008,"num_write":326,"num_write_kb":2885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"105'462","reported_seq":6443,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804876+0000","last_change":"2024-09-14T08:40:16.728168+0000","last_active":"2024-09-14T08:41:25.804876+0000","last_peered":"2024-09-14T08:41:25.804876+0000","last_clean":"2024-09-14T08:41:25.804876+0000","last_became_active":"2024-09-14T08:40:16.726971+0000","last_became_peered":"2024-09-14T08:40:16.726971+0000","last_unstale":"2024-09-14T08:41:25.804876+0000","last_undegraded":"2024-09-14T08:41:25.804876+0000","last_fullsized":"2024-09-14T08:41:25.804876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:28.209308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001345691,"stat_sum":{"num_bytes":27904046,"num_objects":36,"num_object_clones":4,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":15,"num_read":6677,"num_read_kb":37615,"num_write":549,"num_write_kb":4805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"106'677","reported_seq":8346,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804766+0000","last_change":"2024-09-14T08:41:13.630764+0000","last_active":"2024-09-14T08:41:25.804766+0000","last_peered":"2024-09-14T08:41:25.804766+0000","last_clean":"2024-09-14T08:41:25.804766+0000","last_became_active":"2024-09-14T08:41:13.628717+0000","last_became_peered":"2024-09-14T08:41:13.628717+0000","last_unstale":"2024-09-14T08:41:25.804766+0000","last_undegraded":"2024-09-14T08:41:25.804766+0000","last_fullsized":"2024-09-14T08:41:25.804766+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:18.463628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910279999999999,"stat_sum":{"num_bytes":15829155,"num_objects":33,"num_object_clones":4,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":11,"num_read":9226,"num_read_kb":34085,"num_write":745,"num_write_kb":3654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":1165399,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"105'262","reported_seq":4187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.971688+0000","last_change":"2024-09-14T08:39:20.388365+0000","last_active":"2024-09-14T08:41:25.971688+0000","last_peered":"2024-09-14T08:41:25.971688+0000","last_clean":"2024-09-14T08:41:25.971688+0000","last_became_active":"2024-09-14T08:39:18.383879+0000","last_became_peered":"2024-09-14T08:39:18.383879+0000","last_unstale":"2024-09-14T08:41:25.971688+0000","last_undegraded":"2024-09-14T08:41:25.971688+0000","last_fullsized":"2024-09-14T08:41:25.971688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:21.226698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211712,"stat_sum":{"num_bytes":21003846,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":12,"num_read":4119,"num_read_kb":7737,"num_write":304,"num_write_kb":2185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"107'363","reported_seq":2815,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.368081+0000","last_change":"2024-09-14T08:39:20.386019+0000","last_active":"2024-09-14T08:41:26.368081+0000","last_peered":"2024-09-14T08:41:26.368081+0000","last_clean":"2024-09-14T08:41:26.368081+0000","last_became_active":"2024-09-14T08:39:18.384097+0000","last_became_peered":"2024-09-14T08:39:18.384097+0000","last_unstale":"2024-09-14T08:41:26.368081+0000","last_undegraded":"2024-09-14T08:41:26.368081+0000","last_fullsized":"2024-09-14T08:41:26.368081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:01.815488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014331750000000001,"stat_sum":{"num_bytes":11979527,"num_objects":40,"num_object_clones":4,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":15,"num_read":2921,"num_read_kb":13849,"num_write":439,"num_write_kb":5012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"108'254","reported_seq":3962,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.085537+0000","last_change":"2024-09-14T08:41:12.610519+0000","last_active":"2024-09-14T08:41:26.085537+0000","last_peered":"2024-09-14T08:41:26.085537+0000","last_clean":"2024-09-14T08:41:26.085537+0000","last_became_active":"2024-09-14T08:41:12.608616+0000","last_became_peered":"2024-09-14T08:41:12.608616+0000","last_unstale":"2024-09-14T08:41:26.085537+0000","last_undegraded":"2024-09-14T08:41:26.085537+0000","last_fullsized":"2024-09-14T08:41:26.085537+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:49.237431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922599999999997,"stat_sum":{"num_bytes":31239332,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":19,"num_read":3505,"num_read_kb":22838,"num_write":224,"num_write_kb":1869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":68,"num_bytes_recovered":110244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"107'244","reported_seq":5230,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.337329+0000","last_change":"2024-09-14T08:41:12.609333+0000","last_active":"2024-09-14T08:41:25.337329+0000","last_peered":"2024-09-14T08:41:25.337329+0000","last_clean":"2024-09-14T08:41:25.337329+0000","last_became_active":"2024-09-14T08:41:12.608651+0000","last_became_peered":"2024-09-14T08:41:12.608651+0000","last_unstale":"2024-09-14T08:41:25.337329+0000","last_undegraded":"2024-09-14T08:41:25.337329+0000","last_fullsized":"2024-09-14T08:41:25.337329+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:34.316586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862059999999999,"stat_sum":{"num_bytes":26000267,"num_objects":37,"num_object_clones":6,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":5120,"num_read_kb":32628,"num_write":252,"num_write_kb":3377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":1537296,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"107'250","reported_seq":2663,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831163+0000","last_change":"2024-09-14T08:40:40.555724+0000","last_active":"2024-09-14T08:41:25.831163+0000","last_peered":"2024-09-14T08:41:25.831163+0000","last_clean":"2024-09-14T08:41:25.831163+0000","last_became_active":"2024-09-14T08:40:40.416704+0000","last_became_peered":"2024-09-14T08:40:40.416704+0000","last_unstale":"2024-09-14T08:41:25.831163+0000","last_undegraded":"2024-09-14T08:41:25.831163+0000","last_fullsized":"2024-09-14T08:41:25.831163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:51.887608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029337040000000001,"stat_sum":{"num_bytes":13593327,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":17,"num_read":26711,"num_read_kb":26160,"num_write":246,"num_write_kb":3703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"106'235","reported_seq":2414,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.366888+0000","last_change":"2024-09-14T08:41:12.611692+0000","last_active":"2024-09-14T08:41:26.366888+0000","last_peered":"2024-09-14T08:41:26.366888+0000","last_clean":"2024-09-14T08:41:26.366888+0000","last_became_active":"2024-09-14T08:41:12.610726+0000","last_became_peered":"2024-09-14T08:41:12.610726+0000","last_unstale":"2024-09-14T08:41:26.366888+0000","last_undegraded":"2024-09-14T08:41:26.366888+0000","last_fullsized":"2024-09-14T08:41:26.366888+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:42.823421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018449409999999999,"stat_sum":{"num_bytes":46756449,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":19,"num_read":2854,"num_read_kb":15947,"num_write":231,"num_write_kb":5407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":4475074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"108'232","reported_seq":31418,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.993155+0000","last_change":"2024-09-14T08:40:40.495288+0000","last_active":"2024-09-14T08:41:25.993155+0000","last_peered":"2024-09-14T08:41:25.993155+0000","last_clean":"2024-09-14T08:41:25.993155+0000","last_became_active":"2024-09-14T08:40:40.411694+0000","last_became_peered":"2024-09-14T08:40:40.411694+0000","last_unstale":"2024-09-14T08:41:25.993155+0000","last_undegraded":"2024-09-14T08:41:25.993155+0000","last_fullsized":"2024-09-14T08:41:25.993155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:42:06.156101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014343330000000001,"stat_sum":{"num_bytes":37907700,"num_objects":31,"num_object_clones":3,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":11,"num_read":31118,"num_read_kb":34784,"num_write":246,"num_write_kb":1508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":222964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805384+0000","last_change":"2024-09-14T08:40:40.408528+0000","last_active":"2024-09-14T08:41:25.805384+0000","last_peered":"2024-09-14T08:41:25.805384+0000","last_clean":"2024-09-14T08:41:25.805384+0000","last_became_active":"2024-09-14T08:40:40.408122+0000","last_became_peered":"2024-09-14T08:40:40.408122+0000","last_unstale":"2024-09-14T08:41:25.805384+0000","last_undegraded":"2024-09-14T08:41:25.805384+0000","last_fullsized":"2024-09-14T08:41:25.805384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:43.290991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"105'1754","reported_seq":49623,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.004952+0000","last_change":"2024-09-14T08:41:13.633860+0000","last_active":"2024-09-14T08:41:26.004952+0000","last_peered":"2024-09-14T08:41:26.004952+0000","last_clean":"2024-09-14T08:41:26.004952+0000","last_became_active":"2024-09-14T08:41:13.630960+0000","last_became_peered":"2024-09-14T08:41:13.630960+0000","last_unstale":"2024-09-14T08:41:26.004952+0000","last_undegraded":"2024-09-14T08:41:26.004952+0000","last_fullsized":"2024-09-14T08:41:26.004952+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:10.739240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484614,"stat_sum":{"num_bytes":40925881,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":17,"num_read":56813,"num_read_kb":45101,"num_write":3080,"num_write_kb":6480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":796857,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831315+0000","last_change":"2024-09-14T08:40:40.418897+0000","last_active":"2024-09-14T08:41:25.831315+0000","last_peered":"2024-09-14T08:41:25.831315+0000","last_clean":"2024-09-14T08:41:25.831315+0000","last_became_active":"2024-09-14T08:40:40.418160+0000","last_became_peered":"2024-09-14T08:40:40.418160+0000","last_unstale":"2024-09-14T08:41:25.831315+0000","last_undegraded":"2024-09-14T08:41:25.831315+0000","last_fullsized":"2024-09-14T08:41:25.831315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:39.281258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"106'305","reported_seq":44672,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716582+0000","last_change":"2024-09-14T08:39:20.419181+0000","last_active":"2024-09-14T08:41:25.716582+0000","last_peered":"2024-09-14T08:41:25.716582+0000","last_clean":"2024-09-14T08:41:25.716582+0000","last_became_active":"2024-09-14T08:39:18.382867+0000","last_became_peered":"2024-09-14T08:39:18.382867+0000","last_unstale":"2024-09-14T08:41:25.716582+0000","last_undegraded":"2024-09-14T08:41:25.716582+0000","last_fullsized":"2024-09-14T08:41:25.716582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:05.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015322599999999999,"stat_sum":{"num_bytes":27953221,"num_objects":44,"num_object_clones":9,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":17,"num_read":44325,"num_read_kb":42097,"num_write":313,"num_write_kb":31867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805123+0000","last_change":"2024-09-14T08:41:10.634099+0000","last_active":"2024-09-14T08:41:25.805123+0000","last_peered":"2024-09-14T08:41:25.805123+0000","last_clean":"2024-09-14T08:41:25.805123+0000","last_became_active":"2024-09-14T08:41:10.633569+0000","last_became_peered":"2024-09-14T08:41:10.633569+0000","last_unstale":"2024-09-14T08:41:25.805123+0000","last_undegraded":"2024-09-14T08:41:25.805123+0000","last_fullsized":"2024-09-14T08:41:25.805123+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:19.076436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"107'401","reported_seq":4029,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831152+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:41:25.831152+0000","last_peered":"2024-09-14T08:41:25.831152+0000","last_clean":"2024-09-14T08:41:25.831152+0000","last_became_active":"2024-09-14T08:39:18.387737+0000","last_became_peered":"2024-09-14T08:39:18.387737+0000","last_unstale":"2024-09-14T08:41:25.831152+0000","last_undegraded":"2024-09-14T08:41:25.831152+0000","last_fullsized":"2024-09-14T08:41:25.831152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:50.419016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010096059999999999,"stat_sum":{"num_bytes":38804623,"num_objects":34,"num_object_clones":4,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":17,"num_read":4526,"num_read_kb":13566,"num_write":447,"num_write_kb":18803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831202+0000","last_change":"2024-09-14T08:41:09.599832+0000","last_active":"2024-09-14T08:41:25.831202+0000","last_peered":"2024-09-14T08:41:25.831202+0000","last_clean":"2024-09-14T08:41:25.831202+0000","last_became_active":"2024-09-14T08:41:09.599051+0000","last_became_peered":"2024-09-14T08:41:09.599051+0000","last_unstale":"2024-09-14T08:41:25.831202+0000","last_undegraded":"2024-09-14T08:41:25.831202+0000","last_fullsized":"2024-09-14T08:41:25.831202+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:04.825931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"107'592","reported_seq":4690,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716309+0000","last_change":"2024-09-14T08:40:16.717901+0000","last_active":"2024-09-14T08:41:25.716309+0000","last_peered":"2024-09-14T08:41:25.716309+0000","last_clean":"2024-09-14T08:41:25.716309+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:41:25.716309+0000","last_undegraded":"2024-09-14T08:41:25.716309+0000","last_fullsized":"2024-09-14T08:41:25.716309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:42.279977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032365710000000002,"stat_sum":{"num_bytes":21401320,"num_objects":44,"num_object_clones":8,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":19,"num_read":6026,"num_read_kb":22885,"num_write":812,"num_write_kb":4932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"107'838","reported_seq":18723,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804973+0000","last_change":"2024-09-14T08:41:12.620093+0000","last_active":"2024-09-14T08:41:25.804973+0000","last_peered":"2024-09-14T08:41:25.804973+0000","last_clean":"2024-09-14T08:41:25.804973+0000","last_became_active":"2024-09-14T08:41:12.618099+0000","last_became_peered":"2024-09-14T08:41:12.618099+0000","last_unstale":"2024-09-14T08:41:25.804973+0000","last_undegraded":"2024-09-14T08:41:25.804973+0000","last_fullsized":"2024-09-14T08:41:25.804973+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:10.557988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599846,"stat_sum":{"num_bytes":11734092,"num_objects":35,"num_object_clones":5,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":18,"num_read":21277,"num_read_kb":19699,"num_write":1417,"num_write_kb":2252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":129536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":131,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831148+0000","last_change":"2024-09-14T08:40:16.717703+0000","last_active":"2024-09-14T08:41:25.831148+0000","last_peered":"2024-09-14T08:41:25.831148+0000","last_clean":"2024-09-14T08:41:25.831148+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:41:25.831148+0000","last_undegraded":"2024-09-14T08:41:25.831148+0000","last_fullsized":"2024-09-14T08:41:25.831148+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:18.988966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"102'225","reported_seq":26367,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.830886+0000","last_change":"2024-09-14T08:39:20.385113+0000","last_active":"2024-09-14T08:41:25.830886+0000","last_peered":"2024-09-14T08:41:25.830886+0000","last_clean":"2024-09-14T08:41:25.830886+0000","last_became_active":"2024-09-14T08:39:18.387585+0000","last_became_peered":"2024-09-14T08:39:18.387585+0000","last_unstale":"2024-09-14T08:41:25.830886+0000","last_undegraded":"2024-09-14T08:41:25.830886+0000","last_fullsized":"2024-09-14T08:41:25.830886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:30.252998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058750299999999996,"stat_sum":{"num_bytes":15575102,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":26180,"num_read_kb":24302,"num_write":244,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716462+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:41:25.716462+0000","last_peered":"2024-09-14T08:41:25.716462+0000","last_clean":"2024-09-14T08:41:25.716462+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:41:25.716462+0000","last_undegraded":"2024-09-14T08:41:25.716462+0000","last_fullsized":"2024-09-14T08:41:25.716462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"107'246","reported_seq":5350,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.953290+0000","last_change":"2024-09-14T08:41:12.608255+0000","last_active":"2024-09-14T08:41:25.953290+0000","last_peered":"2024-09-14T08:41:25.953290+0000","last_clean":"2024-09-14T08:41:25.953290+0000","last_became_active":"2024-09-14T08:41:12.607243+0000","last_became_peered":"2024-09-14T08:41:12.607243+0000","last_unstale":"2024-09-14T08:41:25.953290+0000","last_undegraded":"2024-09-14T08:41:25.953290+0000","last_fullsized":"2024-09-14T08:41:25.953290+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:50.129225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047135900000000002,"stat_sum":{"num_bytes":41615397,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":10,"num_read":4843,"num_read_kb":8217,"num_write":241,"num_write_kb":2837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":264741,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831003+0000","last_change":"2024-09-14T08:41:10.604621+0000","last_active":"2024-09-14T08:41:25.831003+0000","last_peered":"2024-09-14T08:41:25.831003+0000","last_clean":"2024-09-14T08:41:25.831003+0000","last_became_active":"2024-09-14T08:41:10.603797+0000","last_became_peered":"2024-09-14T08:41:10.603797+0000","last_unstale":"2024-09-14T08:41:25.831003+0000","last_undegraded":"2024-09-14T08:41:25.831003+0000","last_fullsized":"2024-09-14T08:41:25.831003+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:14.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"108'322","reported_seq":16382,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.086018+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:41:26.086018+0000","last_peered":"2024-09-14T08:41:26.086018+0000","last_clean":"2024-09-14T08:41:26.086018+0000","last_became_active":"2024-09-14T08:39:18.387242+0000","last_became_peered":"2024-09-14T08:39:18.387242+0000","last_unstale":"2024-09-14T08:41:26.086018+0000","last_undegraded":"2024-09-14T08:41:26.086018+0000","last_fullsized":"2024-09-14T08:41:26.086018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:43.812916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332069,"stat_sum":{"num_bytes":33540340,"num_objects":35,"num_object_clones":6,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":12,"num_read":16614,"num_read_kb":53339,"num_write":424,"num_write_kb":5467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":116,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716347+0000","last_change":"2024-09-14T08:40:16.718478+0000","last_active":"2024-09-14T08:41:25.716347+0000","last_peered":"2024-09-14T08:41:25.716347+0000","last_clean":"2024-09-14T08:41:25.716347+0000","last_became_active":"2024-09-14T08:40:16.717575+0000","last_became_peered":"2024-09-14T08:40:16.717575+0000","last_unstale":"2024-09-14T08:41:25.716347+0000","last_undegraded":"2024-09-14T08:41:25.716347+0000","last_fullsized":"2024-09-14T08:41:25.716347+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:50.808473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.830815+0000","last_change":"2024-09-14T08:41:11.435115+0000","last_active":"2024-09-14T08:41:25.830815+0000","last_peered":"2024-09-14T08:41:25.830815+0000","last_clean":"2024-09-14T08:41:25.830815+0000","last_became_active":"2024-09-14T08:41:10.643080+0000","last_became_peered":"2024-09-14T08:41:10.643080+0000","last_unstale":"2024-09-14T08:41:25.830815+0000","last_undegraded":"2024-09-14T08:41:25.830815+0000","last_fullsized":"2024-09-14T08:41:25.830815+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:40:48.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"105'365","reported_seq":33155,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716448+0000","last_change":"2024-09-14T08:39:20.418935+0000","last_active":"2024-09-14T08:41:25.716448+0000","last_peered":"2024-09-14T08:41:25.716448+0000","last_clean":"2024-09-14T08:41:25.716448+0000","last_became_active":"2024-09-14T08:39:18.382844+0000","last_became_peered":"2024-09-14T08:39:18.382844+0000","last_unstale":"2024-09-14T08:41:25.716448+0000","last_undegraded":"2024-09-14T08:41:25.716448+0000","last_fullsized":"2024-09-14T08:41:25.716448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:13.664235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013334390000000001,"stat_sum":{"num_bytes":19813491,"num_objects":36,"num_object_clones":3,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":14,"num_read":31831,"num_read_kb":31155,"num_write":289,"num_write_kb":1209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"101'726","reported_seq":12105,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804748+0000","last_change":"2024-09-14T08:41:11.611116+0000","last_active":"2024-09-14T08:41:25.804748+0000","last_peered":"2024-09-14T08:41:25.804748+0000","last_clean":"2024-09-14T08:41:25.804748+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:41:25.804748+0000","last_undegraded":"2024-09-14T08:41:25.804748+0000","last_fullsized":"2024-09-14T08:41:25.804748+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:10:52.089871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011980249999999999,"stat_sum":{"num_bytes":22313574,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":19,"num_read":11619,"num_read_kb":18466,"num_write":532,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"107'422","reported_seq":7991,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716306+0000","last_change":"2024-09-14T08:40:36.360897+0000","last_active":"2024-09-14T08:41:25.716306+0000","last_peered":"2024-09-14T08:41:25.716306+0000","last_clean":"2024-09-14T08:41:25.716306+0000","last_became_active":"2024-09-14T08:40:36.358876+0000","last_became_peered":"2024-09-14T08:40:36.358876+0000","last_unstale":"2024-09-14T08:41:25.716306+0000","last_undegraded":"2024-09-14T08:41:25.716306+0000","last_fullsized":"2024-09-14T08:41:25.716306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:33.739641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002911753,"stat_sum":{"num_bytes":44676673,"num_objects":30,"num_object_clones":5,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":9007,"num_read_kb":68313,"num_write":449,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":5746688,"num_keys_recovered":33,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"108'214","reported_seq":3749,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.993745+0000","last_change":"2024-09-14T08:41:12.615018+0000","last_active":"2024-09-14T08:41:25.993745+0000","last_peered":"2024-09-14T08:41:25.993745+0000","last_clean":"2024-09-14T08:41:25.993745+0000","last_became_active":"2024-09-14T08:41:12.612738+0000","last_became_peered":"2024-09-14T08:41:12.612738+0000","last_unstale":"2024-09-14T08:41:25.993745+0000","last_undegraded":"2024-09-14T08:41:25.993745+0000","last_fullsized":"2024-09-14T08:41:25.993745+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:39.985722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013500459999999999,"stat_sum":{"num_bytes":15667232,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":12,"num_read":3256,"num_read_kb":17137,"num_write":208,"num_write_kb":2667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1187360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"108'425","reported_seq":30061,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.988769+0000","last_change":"2024-09-14T08:41:13.635192+0000","last_active":"2024-09-14T08:41:25.988769+0000","last_peered":"2024-09-14T08:41:25.988769+0000","last_clean":"2024-09-14T08:41:25.988769+0000","last_became_active":"2024-09-14T08:41:13.633802+0000","last_became_peered":"2024-09-14T08:41:13.633802+0000","last_unstale":"2024-09-14T08:41:25.988769+0000","last_undegraded":"2024-09-14T08:41:25.988769+0000","last_fullsized":"2024-09-14T08:41:25.988769+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:30.965053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652499,"stat_sum":{"num_bytes":31342631,"num_objects":44,"num_object_clones":8,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":18,"num_read":32204,"num_read_kb":40814,"num_write":356,"num_write_kb":5107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":2725415,"num_keys_recovered":34,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"108'469","reported_seq":5575,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.993749+0000","last_change":"2024-09-14T08:40:43.437156+0000","last_active":"2024-09-14T08:41:25.993749+0000","last_peered":"2024-09-14T08:41:25.993749+0000","last_clean":"2024-09-14T08:41:25.993749+0000","last_became_active":"2024-09-14T08:40:43.436214+0000","last_became_peered":"2024-09-14T08:40:43.436214+0000","last_unstale":"2024-09-14T08:41:25.993749+0000","last_undegraded":"2024-09-14T08:41:25.993749+0000","last_fullsized":"2024-09-14T08:41:25.993749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:29.720933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024901429999999998,"stat_sum":{"num_bytes":18276352,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":7224,"num_read_kb":16295,"num_write":352,"num_write_kb":4951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":1135104,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"105'177","reported_seq":4482,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805355+0000","last_change":"2024-09-14T08:40:16.728183+0000","last_active":"2024-09-14T08:41:25.805355+0000","last_peered":"2024-09-14T08:41:25.805355+0000","last_clean":"2024-09-14T08:41:25.805355+0000","last_became_active":"2024-09-14T08:40:16.727022+0000","last_became_peered":"2024-09-14T08:40:16.727022+0000","last_unstale":"2024-09-14T08:41:25.805355+0000","last_undegraded":"2024-09-14T08:41:25.805355+0000","last_fullsized":"2024-09-14T08:41:25.805355+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:54.999706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002389113,"stat_sum":{"num_bytes":22237696,"num_objects":29,"num_object_clones":3,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":12,"num_read":4164,"num_read_kb":15753,"num_write":175,"num_write_kb":1689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"106'330","reported_seq":4797,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831300+0000","last_change":"2024-09-14T08:41:12.616269+0000","last_active":"2024-09-14T08:41:25.831300+0000","last_peered":"2024-09-14T08:41:25.831300+0000","last_clean":"2024-09-14T08:41:25.831300+0000","last_became_active":"2024-09-14T08:41:12.612680+0000","last_became_peered":"2024-09-14T08:41:12.612680+0000","last_unstale":"2024-09-14T08:41:25.831300+0000","last_undegraded":"2024-09-14T08:41:25.831300+0000","last_fullsized":"2024-09-14T08:41:25.831300+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:03.929265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023917970000000002,"stat_sum":{"num_bytes":47791120,"num_objects":54,"num_object_clones":13,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":22,"num_read":4369,"num_read_kb":29855,"num_write":311,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4367376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"107'270","reported_seq":3802,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716141+0000","last_change":"2024-09-14T08:41:12.610800+0000","last_active":"2024-09-14T08:41:25.716141+0000","last_peered":"2024-09-14T08:41:25.716141+0000","last_clean":"2024-09-14T08:41:25.716141+0000","last_became_active":"2024-09-14T08:41:12.608500+0000","last_became_peered":"2024-09-14T08:41:12.608500+0000","last_unstale":"2024-09-14T08:41:25.716141+0000","last_undegraded":"2024-09-14T08:41:25.716141+0000","last_fullsized":"2024-09-14T08:41:25.716141+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:50.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024547029999999999,"stat_sum":{"num_bytes":44448398,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":4940,"num_read_kb":25763,"num_write":265,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":461564,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"108'252","reported_seq":3715,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.105972+0000","last_change":"2024-09-14T08:41:13.629949+0000","last_active":"2024-09-14T08:41:26.105972+0000","last_peered":"2024-09-14T08:41:26.105972+0000","last_clean":"2024-09-14T08:41:26.105972+0000","last_became_active":"2024-09-14T08:41:13.628700+0000","last_became_peered":"2024-09-14T08:41:13.628700+0000","last_unstale":"2024-09-14T08:41:26.105972+0000","last_undegraded":"2024-09-14T08:41:26.105972+0000","last_fullsized":"2024-09-14T08:41:26.105972+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:01.135980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001362044,"stat_sum":{"num_bytes":11798095,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":20,"num_read":3899,"num_read_kb":11147,"num_write":213,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":841295,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"102'365","reported_seq":3913,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.830889+0000","last_change":"2024-09-14T08:41:12.619512+0000","last_active":"2024-09-14T08:41:25.830889+0000","last_peered":"2024-09-14T08:41:25.830889+0000","last_clean":"2024-09-14T08:41:25.830889+0000","last_became_active":"2024-09-14T08:41:12.616601+0000","last_became_peered":"2024-09-14T08:41:12.616601+0000","last_unstale":"2024-09-14T08:41:25.830889+0000","last_undegraded":"2024-09-14T08:41:25.830889+0000","last_fullsized":"2024-09-14T08:41:25.830889+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:51.614893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013117140000000001,"stat_sum":{"num_bytes":13324914,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":15,"num_read":3918,"num_read_kb":13891,"num_write":360,"num_write_kb":5180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":5260516,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"101'242","reported_seq":2045,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716225+0000","last_change":"2024-09-14T08:40:41.553903+0000","last_active":"2024-09-14T08:41:25.716225+0000","last_peered":"2024-09-14T08:41:25.716225+0000","last_clean":"2024-09-14T08:41:25.716225+0000","last_became_active":"2024-09-14T08:40:41.420572+0000","last_became_peered":"2024-09-14T08:40:41.420572+0000","last_unstale":"2024-09-14T08:41:25.716225+0000","last_undegraded":"2024-09-14T08:41:25.716225+0000","last_fullsized":"2024-09-14T08:41:25.716225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:05.821148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018326740000000001,"stat_sum":{"num_bytes":13699204,"num_objects":39,"num_object_clones":5,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":18,"num_read":2236,"num_read_kb":8879,"num_write":252,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":515126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":819833989,"num_objects":1205,"num_object_clones":210,"num_object_copies":2410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1205,"num_whiteouts":497,"num_read":428739,"num_read_kb":825467,"num_write":14698,"num_write_kb":194683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1279,"num_bytes_recovered":33373813,"num_keys_recovered":219,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":176943104,"data_stored":206775098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8169,"internal_metadata":0},"log_size":12706,"ondisk_log_size":12706,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80276,"kb_used_data":31036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94291564,"statfs":{"total":96636764160,"available":96554561536,"internally_reserved":0,"allocated":31780864,"data_stored":37088235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574881,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66512,"kb_used_data":35324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94305328,"statfs":{"total":96636764160,"available":96568655872,"internally_reserved":0,"allocated":36171776,"data_stored":38506977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118804,"kb_used_data":43196,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94253036,"statfs":{"total":96636764160,"available":96515108864,"internally_reserved":0,"allocated":44232704,"data_stored":54423502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607585,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65244,"kb_used_data":38220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94306596,"statfs":{"total":96636764160,"available":96569954304,"internally_reserved":0,"allocated":39137280,"data_stored":46789311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":0,"seq":450971566082,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16867328,"data_stored":16742054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8169,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42373120,"data_stored":53309639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34304000,"data_stored":37388132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12910592,"data_stored":14407564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30507008,"data_stored":36559760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39981056,"data_stored":48367949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:41:28.500 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T08:41:28.501 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:41:28.501 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T08:41:28.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T08:41:28.507 INFO:teuthology.orchestra.run.smithi188.stdout:3042 write 0xbc7e200 thru 0xbc85da1 (0x7ba2 bytes) 2024-09-14T08:41:28.507 INFO:teuthology.orchestra.run.smithi188.stdout:3044 read 0x7669a00 thru 0x7670d34 (0x7335 bytes) 2024-09-14T08:41:28.508 INFO:teuthology.orchestra.run.smithi188.stdout:3046 read 0xb292a00 thru 0xb29a802 (0x7e03 bytes) 2024-09-14T08:41:28.508 INFO:teuthology.orchestra.run.smithi188.stdout:3048 punch from 0x624c400 to 0x6259a00, (0xd600 bytes) 2024-09-14T08:41:28.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:41:28.510 INFO:teuthology.orchestra.run.smithi188.stdout:3050 read 0xa553c00 thru 0xa55ccb4 (0x90b5 bytes) 2024-09-14T08:41:28.510 INFO:teuthology.orchestra.run.smithi188.stdout:3051 write 0x6949a00 thru 0x695287a (0x8e7b bytes) 2024-09-14T08:41:28.510 INFO:teuthology.orchestra.run.smithi188.stdout:3053 punch from 0xae68000 to 0xae76e00, (0xee00 bytes) 2024-09-14T08:41:28.511 INFO:teuthology.orchestra.run.smithi188.stdout:3055 punch from 0xa91e600 to 0xa92ac00, (0xc600 bytes) 2024-09-14T08:41:28.511 INFO:teuthology.orchestra.run.smithi188.stdout:3057 write 0x42c4000 thru 0x42d0ce5 (0xcce6 bytes) 2024-09-14T08:41:28.512 INFO:teuthology.orchestra.run.smithi188.stdout:3058 read 0x1b8f400 thru 0x1b8f579 (0x17a bytes) 2024-09-14T08:41:28.513 INFO:teuthology.orchestra.run.smithi188.stdout:3067 write 0x2a32600 thru 0x2a332bb (0xcbc bytes) 2024-09-14T08:41:28.514 INFO:teuthology.orchestra.run.smithi188.stdout:3068 write 0x25d400 thru 0x266eac (0x9aad bytes) 2024-09-14T08:41:28.545 INFO:teuthology.orchestra.run.smithi188.stdout:3069 trunc from 0xbc85e00 to 0xa17da00 2024-09-14T08:41:28.554 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:28.554+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:28.655 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:28.654+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:28.697 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:28.697 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:28.697 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:28.697 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:28.698 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:28.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:41:28.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:41:28.755 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:28.754+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:28.830 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:28.831 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:28.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:28.831 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [] 2024-09-14T08:41:28.831 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:28.845 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:28.855 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:28.854+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:28.885 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:41:28.885 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:28.885 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 110, 2024-09-14T08:41:28.885 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "57b092b7-5550-41a0-8f78-531de0e7c469", 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-09-14T08:38:48.610112+0000", 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-09-14T08:41:27.729277+0000", 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-09-14T08:41:21.666444+0000", 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-09-14T08:41:08.566849+0000", 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5799936, 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-09-14T08:41:28.886 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 6, 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 3, 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 6, 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "luminous", 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-09-14T08:41:28.887 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:00.306403+0000", 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:41:28.888 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:41:28.889 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "15", 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-09-14T08:41:28.890 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:41:28.891 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:41:28.892 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.893 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 6.059999942779541, 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 6.059999942779541, 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:06.370159+0000", 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:41:28.895 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:41:28.896 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 2, 2024-09-14T08:41:28.897 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 19, 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:41:28.898 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:41:28.899 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.9900000095367432, 2024-09-14T08:41:28.900 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.9900000095367432, 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.67000001668930054, 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "pool_client.0", 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:16.437713+0000", 2024-09-14T08:41:28.901 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:41:28.902 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:41:28.903 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "105", 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 26, 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 105, 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:41:28.904 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:41:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:41:28.906 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.059999942779541, 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.059999942779541, 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.67000001668930054, 2024-09-14T08:41:28.907 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.85593926906585693, 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.86000001430511475, 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d", 2024-09-14T08:41:28.908 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 0, 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0, 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 12, 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 40, 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 105, 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 41, 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.909 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6800", 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 225180985 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6801", 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 225180985 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6802", 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 225180985 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6803", 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 225180985 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6806", 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 225180985 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6807", 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 225180985 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:28.912 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6804", 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 225180985 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6805", 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 225180985 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6801/225180985", 2024-09-14T08:41:28.913 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6803/225180985", 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6807/225180985", 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6805/225180985", 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "09ba1390-a0d1-48a3-9342-5f5aa64e2217", 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:41:28.914 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 99, 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6808", 2024-09-14T08:41:28.915 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6809", 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6810", 2024-09-14T08:41:28.916 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6811", 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.917 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6814", 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6815", 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6812", 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6813", 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6809/2739597491", 2024-09-14T08:41:28.919 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6811/2739597491", 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6815/2739597491", 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6813/2739597491", 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "a7cd8610-d8e1-44e7-a423-4419cad90d8e", 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:28.920 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 98, 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6816", 2024-09-14T08:41:28.922 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:28.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.922 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.922 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817", 2024-09-14T08:41:28.922 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:28.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.922 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.922 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818", 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819", 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.923 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.924 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:28.924 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.924 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.924 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6822", 2024-09-14T08:41:28.924 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:28.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.924 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6823", 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6820", 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:28.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6821", 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6817/1157205327", 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6819/1157205327", 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6823/1157205327", 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6821/1157205327", 2024-09-14T08:41:28.926 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "1339fb05-5d1c-4c0a-8388-314119543bb6", 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 0, 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0, 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:41:28.927 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 79, 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6808", 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:28.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6809", 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.929 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6810", 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6811", 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6814", 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6815", 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:28.931 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6812", 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6813", 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6809/1656791341", 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6811/1656791341", 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6815/1656791341", 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6813/1656791341", 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "0cebba54-9019-47bd-870f-306664e390e1", 2024-09-14T08:41:28.933 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 99, 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6816", 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6817", 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6818", 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6819", 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6822", 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6823", 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:28.937 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6820", 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6821", 2024-09-14T08:41:28.938 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6817/1186206237", 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6819/1186206237", 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6823/1186206237", 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6821/1186206237", 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "e571e73b-0e9d-417d-b01c-59b651016763", 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0.1356353759765625, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 98, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:41:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6800", 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6801", 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.941 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6802", 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6803", 2024-09-14T08:41:28.942 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6806", 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6807", 2024-09-14T08:41:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6804", 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.944 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6805", 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6801/796623465", 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6803/796623465", 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6807/796623465", 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6805/796623465", 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:41:28.945 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 65536, 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.174731+0000", 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 41 2024-09-14T08:41:28.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.475467+0000", 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:41:28.947 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.606174+0000", 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:28.948 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 65536, 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.835957+0000", 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.753547+0000", 2024-09-14T08:41:28.949 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.284212+0000", 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:28.950 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [ 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.a", 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: 5 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [ 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:41:28.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 5, 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 2 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-09-14T08:41:28.952 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-09-14T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-09-14T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-09-14T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-09-14T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-09-14T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-09-14T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-09-14T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-09-14T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-09-14T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-09-14T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-09-14T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-09-14T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-09-14T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-09-14T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-09-14T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-09-14T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-09-14T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:28.956 INFO:tasks.thrashosds.thrasher:j is {'epoch': 110, 'fsid': '57b092b7-5550-41a0-8f78-531de0e7c469', 'created': '2024-09-14T08:38:48.610112+0000', 'modified': '2024-09-14T08:41:27.729277+0000', 'last_up_change': '2024-09-14T08:41:21.666444+0000', 'last_in_change': '2024-09-14T08:41:08.566849+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T08:39:00.306403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T08:39:06.370159+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T08:39:16.437713+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 26, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 0.8559392690658569, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}], 'osds': [{'osd': 0, 'uuid': '2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 12, 'last_clean_end': 40, 'up_from': 105, 'up_thru': 21, 'down_at': 41, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 225180985}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 225180985}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 225180985}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 225180985}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 225180985}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 225180985}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 225180985}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 225180985}]}, 'public_addr': '172.21.15.89:6801/225180985', 'cluster_addr': '172.21.15.89:6803/225180985', 'heartbeat_back_addr': '172.21.15.89:6807/225180985', 'heartbeat_front_addr': '172.21.15.89:6805/225180985', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '09ba1390-a0d1-48a3-9342-5f5aa64e2217', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 99, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6808', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6809', 'nonce': 2739597491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6810', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6811', 'nonce': 2739597491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6814', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6815', 'nonce': 2739597491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6812', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6813', 'nonce': 2739597491}]}, 'public_addr': '172.21.15.89:6809/2739597491', 'cluster_addr': '172.21.15.89:6811/2739597491', 'heartbeat_back_addr': '172.21.15.89:6815/2739597491', 'heartbeat_front_addr': '172.21.15.89:6813/2739597491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a7cd8610-d8e1-44e7-a423-4419cad90d8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 98, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6816', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6817', 'nonce': 1157205327}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6818', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 1157205327}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6822', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6823', 'nonce': 1157205327}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6820', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6821', 'nonce': 1157205327}]}, 'public_addr': '172.21.15.89:6817/1157205327', 'cluster_addr': '172.21.15.89:6819/1157205327', 'heartbeat_back_addr': '172.21.15.89:6823/1157205327', 'heartbeat_front_addr': '172.21.15.89:6821/1157205327', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1339fb05-5d1c-4c0a-8388-314119543bb6', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 79, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6808', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6809', 'nonce': 1656791341}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6810', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6811', 'nonce': 1656791341}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6814', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6815', 'nonce': 1656791341}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6812', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6813', 'nonce': 1656791341}]}, 'public_addr': '172.21.15.112:6809/1656791341', 'cluster_addr': '172.21.15.112:6811/1656791341', 'heartbeat_back_addr': '172.21.15.112:6815/1656791341', 'heartbeat_front_addr': '172.21.15.112:6813/1656791341', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0cebba54-9019-47bd-870f-306664e390e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 99, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6816', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6817', 'nonce': 1186206237}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6818', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6819', 'nonce': 1186206237}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6822', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6823', 'nonce': 1186206237}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6820', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6821', 'nonce': 1186206237}]}, 'public_addr': '172.21.15.112:6817/1186206237', 'cluster_addr': '172.21.15.112:6819/1186206237', 'heartbeat_back_addr': '172.21.15.112:6823/1186206237', 'heartbeat_front_addr': '172.21.15.112:6821/1186206237', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e571e73b-0e9d-417d-b01c-59b651016763', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1356353759765625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 98, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 796623465}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 796623465}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 796623465}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 796623465}]}, 'public_addr': '172.21.15.112:6801/796623465', 'cluster_addr': '172.21.15.112:6803/796623465', 'heartbeat_back_addr': '172.21.15.112:6807/796623465', 'heartbeat_front_addr': '172.21.15.112:6805/796623465', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.174731+0000', 'dead_epoch': 41}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.475467+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.606174+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.835957+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.753547+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.284212+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.a', 'osds': [2, 5]}], 'pg_upmap_items': [{'pgid': '3.10', 'mappings': [{'from': 5, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T08:41:28.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:41:28.970 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:28.970 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:28.970 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:28.970 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:28.971 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:28.968+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:28.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:29.058 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:29.058+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:29.147 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:29.148 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:29.159 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:29.160+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:29.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:29.260 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:29.258+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:29.268 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:41:29.269 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:41:29.286 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-14T08:41:28.305365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":820424376,"num_objects":1209,"num_object_clones":210,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":497,"num_read":428805,"num_read_kb":825522,"num_write":14801,"num_write_kb":196313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1285,"num_bytes_recovered":35144917,"num_keys_recovered":219,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12781,"ondisk_log_size":12781,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":330836,"kb_used_data":147776,"kb_used_omap":6,"kb_used_meta":182969,"kb_avail":377156524,"statfs":{"total":386547056640,"available":386208280576,"internally_reserved":0,"allocated":151322624,"data_stored":176808025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6380,"internal_metadata":187361044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31505584,"num_objects":50,"num_object_clones":18,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":9,"num_read":22094,"num_read_kb":69839,"num_write":208,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001037"},"pg_stats":[{"pgid":"3.1f","version":"107'188","reported_seq":2660,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716525+0000","last_change":"2024-09-14T08:41:12.613999+0000","last_active":"2024-09-14T08:41:25.716525+0000","last_peered":"2024-09-14T08:41:25.716525+0000","last_clean":"2024-09-14T08:41:25.716525+0000","last_became_active":"2024-09-14T08:41:12.610989+0000","last_became_peered":"2024-09-14T08:41:12.610989+0000","last_unstale":"2024-09-14T08:41:25.716525+0000","last_undegraded":"2024-09-14T08:41:25.716525+0000","last_fullsized":"2024-09-14T08:41:25.716525+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:40.698863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001451897,"stat_sum":{"num_bytes":10496090,"num_objects":32,"num_object_clones":5,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":17,"num_read":2346,"num_read_kb":8144,"num_write":182,"num_write_kb":2915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":1404084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"106'232","reported_seq":28775,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716324+0000","last_change":"2024-09-14T08:40:40.488885+0000","last_active":"2024-09-14T08:41:25.716324+0000","last_peered":"2024-09-14T08:41:25.716324+0000","last_clean":"2024-09-14T08:41:25.716324+0000","last_became_active":"2024-09-14T08:40:40.416949+0000","last_became_peered":"2024-09-14T08:40:40.416949+0000","last_unstale":"2024-09-14T08:41:25.716324+0000","last_undegraded":"2024-09-14T08:41:25.716324+0000","last_fullsized":"2024-09-14T08:41:25.716324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:31.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013459450000000001,"stat_sum":{"num_bytes":23830560,"num_objects":40,"num_object_clones":7,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":20,"num_read":28329,"num_read_kb":31998,"num_write":214,"num_write_kb":1541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"102'367","reported_seq":5501,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805309+0000","last_change":"2024-09-14T08:40:16.727831+0000","last_active":"2024-09-14T08:41:25.805309+0000","last_peered":"2024-09-14T08:41:25.805309+0000","last_clean":"2024-09-14T08:41:25.805309+0000","last_became_active":"2024-09-14T08:40:16.726695+0000","last_became_peered":"2024-09-14T08:40:16.726695+0000","last_unstale":"2024-09-14T08:41:25.805309+0000","last_undegraded":"2024-09-14T08:41:25.805309+0000","last_fullsized":"2024-09-14T08:41:25.805309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:15.266925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003027493,"stat_sum":{"num_bytes":16354334,"num_objects":46,"num_object_clones":9,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":21,"num_read":6542,"num_read_kb":33008,"num_write":326,"num_write_kb":2885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"105'462","reported_seq":6443,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804876+0000","last_change":"2024-09-14T08:40:16.728168+0000","last_active":"2024-09-14T08:41:25.804876+0000","last_peered":"2024-09-14T08:41:25.804876+0000","last_clean":"2024-09-14T08:41:25.804876+0000","last_became_active":"2024-09-14T08:40:16.726971+0000","last_became_peered":"2024-09-14T08:40:16.726971+0000","last_unstale":"2024-09-14T08:41:25.804876+0000","last_undegraded":"2024-09-14T08:41:25.804876+0000","last_fullsized":"2024-09-14T08:41:25.804876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:28.209308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001345691,"stat_sum":{"num_bytes":27904046,"num_objects":36,"num_object_clones":4,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":15,"num_read":6677,"num_read_kb":37615,"num_write":549,"num_write_kb":4805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"106'677","reported_seq":8346,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804766+0000","last_change":"2024-09-14T08:41:13.630764+0000","last_active":"2024-09-14T08:41:25.804766+0000","last_peered":"2024-09-14T08:41:25.804766+0000","last_clean":"2024-09-14T08:41:25.804766+0000","last_became_active":"2024-09-14T08:41:13.628717+0000","last_became_peered":"2024-09-14T08:41:13.628717+0000","last_unstale":"2024-09-14T08:41:25.804766+0000","last_undegraded":"2024-09-14T08:41:25.804766+0000","last_fullsized":"2024-09-14T08:41:25.804766+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:18.463628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910279999999999,"stat_sum":{"num_bytes":15829155,"num_objects":33,"num_object_clones":4,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":11,"num_read":9226,"num_read_kb":34085,"num_write":745,"num_write_kb":3654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":1165399,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"105'262","reported_seq":4187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.971688+0000","last_change":"2024-09-14T08:39:20.388365+0000","last_active":"2024-09-14T08:41:25.971688+0000","last_peered":"2024-09-14T08:41:25.971688+0000","last_clean":"2024-09-14T08:41:25.971688+0000","last_became_active":"2024-09-14T08:39:18.383879+0000","last_became_peered":"2024-09-14T08:39:18.383879+0000","last_unstale":"2024-09-14T08:41:25.971688+0000","last_undegraded":"2024-09-14T08:41:25.971688+0000","last_fullsized":"2024-09-14T08:41:25.971688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:21.226698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211712,"stat_sum":{"num_bytes":21003846,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":12,"num_read":4119,"num_read_kb":7737,"num_write":304,"num_write_kb":2185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"107'363","reported_seq":2815,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.368081+0000","last_change":"2024-09-14T08:39:20.386019+0000","last_active":"2024-09-14T08:41:26.368081+0000","last_peered":"2024-09-14T08:41:26.368081+0000","last_clean":"2024-09-14T08:41:26.368081+0000","last_became_active":"2024-09-14T08:39:18.384097+0000","last_became_peered":"2024-09-14T08:39:18.384097+0000","last_unstale":"2024-09-14T08:41:26.368081+0000","last_undegraded":"2024-09-14T08:41:26.368081+0000","last_fullsized":"2024-09-14T08:41:26.368081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:01.815488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014331750000000001,"stat_sum":{"num_bytes":11979527,"num_objects":40,"num_object_clones":4,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":15,"num_read":2921,"num_read_kb":13849,"num_write":439,"num_write_kb":5012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"108'254","reported_seq":3962,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.085537+0000","last_change":"2024-09-14T08:41:12.610519+0000","last_active":"2024-09-14T08:41:26.085537+0000","last_peered":"2024-09-14T08:41:26.085537+0000","last_clean":"2024-09-14T08:41:26.085537+0000","last_became_active":"2024-09-14T08:41:12.608616+0000","last_became_peered":"2024-09-14T08:41:12.608616+0000","last_unstale":"2024-09-14T08:41:26.085537+0000","last_undegraded":"2024-09-14T08:41:26.085537+0000","last_fullsized":"2024-09-14T08:41:26.085537+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:49.237431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922599999999997,"stat_sum":{"num_bytes":31239332,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":19,"num_read":3505,"num_read_kb":22838,"num_write":224,"num_write_kb":1869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":68,"num_bytes_recovered":110244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"107'244","reported_seq":5230,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.337329+0000","last_change":"2024-09-14T08:41:12.609333+0000","last_active":"2024-09-14T08:41:25.337329+0000","last_peered":"2024-09-14T08:41:25.337329+0000","last_clean":"2024-09-14T08:41:25.337329+0000","last_became_active":"2024-09-14T08:41:12.608651+0000","last_became_peered":"2024-09-14T08:41:12.608651+0000","last_unstale":"2024-09-14T08:41:25.337329+0000","last_undegraded":"2024-09-14T08:41:25.337329+0000","last_fullsized":"2024-09-14T08:41:25.337329+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:34.316586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862059999999999,"stat_sum":{"num_bytes":26000267,"num_objects":37,"num_object_clones":6,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":5120,"num_read_kb":32628,"num_write":252,"num_write_kb":3377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":1537296,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"107'250","reported_seq":2663,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831163+0000","last_change":"2024-09-14T08:40:40.555724+0000","last_active":"2024-09-14T08:41:25.831163+0000","last_peered":"2024-09-14T08:41:25.831163+0000","last_clean":"2024-09-14T08:41:25.831163+0000","last_became_active":"2024-09-14T08:40:40.416704+0000","last_became_peered":"2024-09-14T08:40:40.416704+0000","last_unstale":"2024-09-14T08:41:25.831163+0000","last_undegraded":"2024-09-14T08:41:25.831163+0000","last_fullsized":"2024-09-14T08:41:25.831163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:51.887608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029337040000000001,"stat_sum":{"num_bytes":13593327,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":17,"num_read":26711,"num_read_kb":26160,"num_write":246,"num_write_kb":3703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"106'235","reported_seq":2414,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.366888+0000","last_change":"2024-09-14T08:41:12.611692+0000","last_active":"2024-09-14T08:41:26.366888+0000","last_peered":"2024-09-14T08:41:26.366888+0000","last_clean":"2024-09-14T08:41:26.366888+0000","last_became_active":"2024-09-14T08:41:12.610726+0000","last_became_peered":"2024-09-14T08:41:12.610726+0000","last_unstale":"2024-09-14T08:41:26.366888+0000","last_undegraded":"2024-09-14T08:41:26.366888+0000","last_fullsized":"2024-09-14T08:41:26.366888+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:42.823421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018449409999999999,"stat_sum":{"num_bytes":46756449,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":19,"num_read":2854,"num_read_kb":15947,"num_write":231,"num_write_kb":5407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":4475074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"108'232","reported_seq":31418,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.993155+0000","last_change":"2024-09-14T08:40:40.495288+0000","last_active":"2024-09-14T08:41:25.993155+0000","last_peered":"2024-09-14T08:41:25.993155+0000","last_clean":"2024-09-14T08:41:25.993155+0000","last_became_active":"2024-09-14T08:40:40.411694+0000","last_became_peered":"2024-09-14T08:40:40.411694+0000","last_unstale":"2024-09-14T08:41:25.993155+0000","last_undegraded":"2024-09-14T08:41:25.993155+0000","last_fullsized":"2024-09-14T08:41:25.993155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:42:06.156101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014343330000000001,"stat_sum":{"num_bytes":37907700,"num_objects":31,"num_object_clones":3,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":11,"num_read":31118,"num_read_kb":34784,"num_write":246,"num_write_kb":1508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":222964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805384+0000","last_change":"2024-09-14T08:40:40.408528+0000","last_active":"2024-09-14T08:41:25.805384+0000","last_peered":"2024-09-14T08:41:25.805384+0000","last_clean":"2024-09-14T08:41:25.805384+0000","last_became_active":"2024-09-14T08:40:40.408122+0000","last_became_peered":"2024-09-14T08:40:40.408122+0000","last_unstale":"2024-09-14T08:41:25.805384+0000","last_undegraded":"2024-09-14T08:41:25.805384+0000","last_fullsized":"2024-09-14T08:41:25.805384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:43.290991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"105'1754","reported_seq":49623,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.004952+0000","last_change":"2024-09-14T08:41:13.633860+0000","last_active":"2024-09-14T08:41:26.004952+0000","last_peered":"2024-09-14T08:41:26.004952+0000","last_clean":"2024-09-14T08:41:26.004952+0000","last_became_active":"2024-09-14T08:41:13.630960+0000","last_became_peered":"2024-09-14T08:41:13.630960+0000","last_unstale":"2024-09-14T08:41:26.004952+0000","last_undegraded":"2024-09-14T08:41:26.004952+0000","last_fullsized":"2024-09-14T08:41:26.004952+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:10.739240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484614,"stat_sum":{"num_bytes":40925881,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":17,"num_read":56813,"num_read_kb":45101,"num_write":3080,"num_write_kb":6480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":796857,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831315+0000","last_change":"2024-09-14T08:40:40.418897+0000","last_active":"2024-09-14T08:41:25.831315+0000","last_peered":"2024-09-14T08:41:25.831315+0000","last_clean":"2024-09-14T08:41:25.831315+0000","last_became_active":"2024-09-14T08:40:40.418160+0000","last_became_peered":"2024-09-14T08:40:40.418160+0000","last_unstale":"2024-09-14T08:41:25.831315+0000","last_undegraded":"2024-09-14T08:41:25.831315+0000","last_fullsized":"2024-09-14T08:41:25.831315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:39.281258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"106'305","reported_seq":44672,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716582+0000","last_change":"2024-09-14T08:39:20.419181+0000","last_active":"2024-09-14T08:41:25.716582+0000","last_peered":"2024-09-14T08:41:25.716582+0000","last_clean":"2024-09-14T08:41:25.716582+0000","last_became_active":"2024-09-14T08:39:18.382867+0000","last_became_peered":"2024-09-14T08:39:18.382867+0000","last_unstale":"2024-09-14T08:41:25.716582+0000","last_undegraded":"2024-09-14T08:41:25.716582+0000","last_fullsized":"2024-09-14T08:41:25.716582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:05.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015322599999999999,"stat_sum":{"num_bytes":27953221,"num_objects":44,"num_object_clones":9,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":17,"num_read":44325,"num_read_kb":42097,"num_write":313,"num_write_kb":31867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805123+0000","last_change":"2024-09-14T08:41:10.634099+0000","last_active":"2024-09-14T08:41:25.805123+0000","last_peered":"2024-09-14T08:41:25.805123+0000","last_clean":"2024-09-14T08:41:25.805123+0000","last_became_active":"2024-09-14T08:41:10.633569+0000","last_became_peered":"2024-09-14T08:41:10.633569+0000","last_unstale":"2024-09-14T08:41:25.805123+0000","last_undegraded":"2024-09-14T08:41:25.805123+0000","last_fullsized":"2024-09-14T08:41:25.805123+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:19.076436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"107'401","reported_seq":4029,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831152+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:41:25.831152+0000","last_peered":"2024-09-14T08:41:25.831152+0000","last_clean":"2024-09-14T08:41:25.831152+0000","last_became_active":"2024-09-14T08:39:18.387737+0000","last_became_peered":"2024-09-14T08:39:18.387737+0000","last_unstale":"2024-09-14T08:41:25.831152+0000","last_undegraded":"2024-09-14T08:41:25.831152+0000","last_fullsized":"2024-09-14T08:41:25.831152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:50.419016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010096059999999999,"stat_sum":{"num_bytes":38804623,"num_objects":34,"num_object_clones":4,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":17,"num_read":4526,"num_read_kb":13566,"num_write":447,"num_write_kb":18803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831202+0000","last_change":"2024-09-14T08:41:09.599832+0000","last_active":"2024-09-14T08:41:25.831202+0000","last_peered":"2024-09-14T08:41:25.831202+0000","last_clean":"2024-09-14T08:41:25.831202+0000","last_became_active":"2024-09-14T08:41:09.599051+0000","last_became_peered":"2024-09-14T08:41:09.599051+0000","last_unstale":"2024-09-14T08:41:25.831202+0000","last_undegraded":"2024-09-14T08:41:25.831202+0000","last_fullsized":"2024-09-14T08:41:25.831202+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:04.825931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"107'592","reported_seq":4690,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716309+0000","last_change":"2024-09-14T08:40:16.717901+0000","last_active":"2024-09-14T08:41:25.716309+0000","last_peered":"2024-09-14T08:41:25.716309+0000","last_clean":"2024-09-14T08:41:25.716309+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:41:25.716309+0000","last_undegraded":"2024-09-14T08:41:25.716309+0000","last_fullsized":"2024-09-14T08:41:25.716309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:42.279977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032365710000000002,"stat_sum":{"num_bytes":21401320,"num_objects":44,"num_object_clones":8,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":19,"num_read":6026,"num_read_kb":22885,"num_write":812,"num_write_kb":4932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"107'838","reported_seq":18723,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804973+0000","last_change":"2024-09-14T08:41:12.620093+0000","last_active":"2024-09-14T08:41:25.804973+0000","last_peered":"2024-09-14T08:41:25.804973+0000","last_clean":"2024-09-14T08:41:25.804973+0000","last_became_active":"2024-09-14T08:41:12.618099+0000","last_became_peered":"2024-09-14T08:41:12.618099+0000","last_unstale":"2024-09-14T08:41:25.804973+0000","last_undegraded":"2024-09-14T08:41:25.804973+0000","last_fullsized":"2024-09-14T08:41:25.804973+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:10.557988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599846,"stat_sum":{"num_bytes":11734092,"num_objects":35,"num_object_clones":5,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":18,"num_read":21277,"num_read_kb":19699,"num_write":1417,"num_write_kb":2252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":129536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":131,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831148+0000","last_change":"2024-09-14T08:40:16.717703+0000","last_active":"2024-09-14T08:41:25.831148+0000","last_peered":"2024-09-14T08:41:25.831148+0000","last_clean":"2024-09-14T08:41:25.831148+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:41:25.831148+0000","last_undegraded":"2024-09-14T08:41:25.831148+0000","last_fullsized":"2024-09-14T08:41:25.831148+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:18.988966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"102'225","reported_seq":26367,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.830886+0000","last_change":"2024-09-14T08:39:20.385113+0000","last_active":"2024-09-14T08:41:25.830886+0000","last_peered":"2024-09-14T08:41:25.830886+0000","last_clean":"2024-09-14T08:41:25.830886+0000","last_became_active":"2024-09-14T08:39:18.387585+0000","last_became_peered":"2024-09-14T08:39:18.387585+0000","last_unstale":"2024-09-14T08:41:25.830886+0000","last_undegraded":"2024-09-14T08:41:25.830886+0000","last_fullsized":"2024-09-14T08:41:25.830886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:30.252998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058750299999999996,"stat_sum":{"num_bytes":15575102,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":26180,"num_read_kb":24302,"num_write":244,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716462+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:41:25.716462+0000","last_peered":"2024-09-14T08:41:25.716462+0000","last_clean":"2024-09-14T08:41:25.716462+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:41:25.716462+0000","last_undegraded":"2024-09-14T08:41:25.716462+0000","last_fullsized":"2024-09-14T08:41:25.716462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"107'246","reported_seq":5350,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.953290+0000","last_change":"2024-09-14T08:41:12.608255+0000","last_active":"2024-09-14T08:41:25.953290+0000","last_peered":"2024-09-14T08:41:25.953290+0000","last_clean":"2024-09-14T08:41:25.953290+0000","last_became_active":"2024-09-14T08:41:12.607243+0000","last_became_peered":"2024-09-14T08:41:12.607243+0000","last_unstale":"2024-09-14T08:41:25.953290+0000","last_undegraded":"2024-09-14T08:41:25.953290+0000","last_fullsized":"2024-09-14T08:41:25.953290+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:50.129225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047135900000000002,"stat_sum":{"num_bytes":41615397,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":10,"num_read":4843,"num_read_kb":8217,"num_write":241,"num_write_kb":2837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":264741,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831003+0000","last_change":"2024-09-14T08:41:10.604621+0000","last_active":"2024-09-14T08:41:25.831003+0000","last_peered":"2024-09-14T08:41:25.831003+0000","last_clean":"2024-09-14T08:41:25.831003+0000","last_became_active":"2024-09-14T08:41:10.603797+0000","last_became_peered":"2024-09-14T08:41:10.603797+0000","last_unstale":"2024-09-14T08:41:25.831003+0000","last_undegraded":"2024-09-14T08:41:25.831003+0000","last_fullsized":"2024-09-14T08:41:25.831003+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:14.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"108'322","reported_seq":16382,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.086018+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:41:26.086018+0000","last_peered":"2024-09-14T08:41:26.086018+0000","last_clean":"2024-09-14T08:41:26.086018+0000","last_became_active":"2024-09-14T08:39:18.387242+0000","last_became_peered":"2024-09-14T08:39:18.387242+0000","last_unstale":"2024-09-14T08:41:26.086018+0000","last_undegraded":"2024-09-14T08:41:26.086018+0000","last_fullsized":"2024-09-14T08:41:26.086018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:43.812916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332069,"stat_sum":{"num_bytes":33540340,"num_objects":35,"num_object_clones":6,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":12,"num_read":16614,"num_read_kb":53339,"num_write":424,"num_write_kb":5467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":116,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716347+0000","last_change":"2024-09-14T08:40:16.718478+0000","last_active":"2024-09-14T08:41:25.716347+0000","last_peered":"2024-09-14T08:41:25.716347+0000","last_clean":"2024-09-14T08:41:25.716347+0000","last_became_active":"2024-09-14T08:40:16.717575+0000","last_became_peered":"2024-09-14T08:40:16.717575+0000","last_unstale":"2024-09-14T08:41:25.716347+0000","last_undegraded":"2024-09-14T08:41:25.716347+0000","last_fullsized":"2024-09-14T08:41:25.716347+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:50.808473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.830815+0000","last_change":"2024-09-14T08:41:11.435115+0000","last_active":"2024-09-14T08:41:25.830815+0000","last_peered":"2024-09-14T08:41:25.830815+0000","last_clean":"2024-09-14T08:41:25.830815+0000","last_became_active":"2024-09-14T08:41:10.643080+0000","last_became_peered":"2024-09-14T08:41:10.643080+0000","last_unstale":"2024-09-14T08:41:25.830815+0000","last_undegraded":"2024-09-14T08:41:25.830815+0000","last_fullsized":"2024-09-14T08:41:25.830815+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:40:48.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"105'365","reported_seq":33155,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716448+0000","last_change":"2024-09-14T08:39:20.418935+0000","last_active":"2024-09-14T08:41:25.716448+0000","last_peered":"2024-09-14T08:41:25.716448+0000","last_clean":"2024-09-14T08:41:25.716448+0000","last_became_active":"2024-09-14T08:39:18.382844+0000","last_became_peered":"2024-09-14T08:39:18.382844+0000","last_unstale":"2024-09-14T08:41:25.716448+0000","last_undegraded":"2024-09-14T08:41:25.716448+0000","last_fullsized":"2024-09-14T08:41:25.716448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:13.664235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013334390000000001,"stat_sum":{"num_bytes":19813491,"num_objects":36,"num_object_clones":3,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":14,"num_read":31831,"num_read_kb":31155,"num_write":289,"num_write_kb":1209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"101'726","reported_seq":12105,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.804748+0000","last_change":"2024-09-14T08:41:11.611116+0000","last_active":"2024-09-14T08:41:25.804748+0000","last_peered":"2024-09-14T08:41:25.804748+0000","last_clean":"2024-09-14T08:41:25.804748+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:41:25.804748+0000","last_undegraded":"2024-09-14T08:41:25.804748+0000","last_fullsized":"2024-09-14T08:41:25.804748+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:10:52.089871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011980249999999999,"stat_sum":{"num_bytes":22313574,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":19,"num_read":11619,"num_read_kb":18466,"num_write":532,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"107'422","reported_seq":7991,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716306+0000","last_change":"2024-09-14T08:40:36.360897+0000","last_active":"2024-09-14T08:41:25.716306+0000","last_peered":"2024-09-14T08:41:25.716306+0000","last_clean":"2024-09-14T08:41:25.716306+0000","last_became_active":"2024-09-14T08:40:36.358876+0000","last_became_peered":"2024-09-14T08:40:36.358876+0000","last_unstale":"2024-09-14T08:41:25.716306+0000","last_undegraded":"2024-09-14T08:41:25.716306+0000","last_fullsized":"2024-09-14T08:41:25.716306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:33.739641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002911753,"stat_sum":{"num_bytes":44676673,"num_objects":30,"num_object_clones":5,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":9007,"num_read_kb":68313,"num_write":449,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":5746688,"num_keys_recovered":33,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"108'214","reported_seq":3749,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.993745+0000","last_change":"2024-09-14T08:41:12.615018+0000","last_active":"2024-09-14T08:41:25.993745+0000","last_peered":"2024-09-14T08:41:25.993745+0000","last_clean":"2024-09-14T08:41:25.993745+0000","last_became_active":"2024-09-14T08:41:12.612738+0000","last_became_peered":"2024-09-14T08:41:12.612738+0000","last_unstale":"2024-09-14T08:41:25.993745+0000","last_undegraded":"2024-09-14T08:41:25.993745+0000","last_fullsized":"2024-09-14T08:41:25.993745+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:39.985722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013500459999999999,"stat_sum":{"num_bytes":15667232,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":12,"num_read":3256,"num_read_kb":17137,"num_write":208,"num_write_kb":2667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1187360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"108'425","reported_seq":30061,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.988769+0000","last_change":"2024-09-14T08:41:13.635192+0000","last_active":"2024-09-14T08:41:25.988769+0000","last_peered":"2024-09-14T08:41:25.988769+0000","last_clean":"2024-09-14T08:41:25.988769+0000","last_became_active":"2024-09-14T08:41:13.633802+0000","last_became_peered":"2024-09-14T08:41:13.633802+0000","last_unstale":"2024-09-14T08:41:25.988769+0000","last_undegraded":"2024-09-14T08:41:25.988769+0000","last_fullsized":"2024-09-14T08:41:25.988769+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:30.965053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652499,"stat_sum":{"num_bytes":31342631,"num_objects":44,"num_object_clones":8,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":18,"num_read":32204,"num_read_kb":40814,"num_write":356,"num_write_kb":5107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":2725415,"num_keys_recovered":34,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"108'469","reported_seq":5575,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.993749+0000","last_change":"2024-09-14T08:40:43.437156+0000","last_active":"2024-09-14T08:41:25.993749+0000","last_peered":"2024-09-14T08:41:25.993749+0000","last_clean":"2024-09-14T08:41:25.993749+0000","last_became_active":"2024-09-14T08:40:43.436214+0000","last_became_peered":"2024-09-14T08:40:43.436214+0000","last_unstale":"2024-09-14T08:41:25.993749+0000","last_undegraded":"2024-09-14T08:41:25.993749+0000","last_fullsized":"2024-09-14T08:41:25.993749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:29.720933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024901429999999998,"stat_sum":{"num_bytes":18276352,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":7224,"num_read_kb":16295,"num_write":352,"num_write_kb":4951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":1135104,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"105'177","reported_seq":4482,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.805355+0000","last_change":"2024-09-14T08:40:16.728183+0000","last_active":"2024-09-14T08:41:25.805355+0000","last_peered":"2024-09-14T08:41:25.805355+0000","last_clean":"2024-09-14T08:41:25.805355+0000","last_became_active":"2024-09-14T08:40:16.727022+0000","last_became_peered":"2024-09-14T08:40:16.727022+0000","last_unstale":"2024-09-14T08:41:25.805355+0000","last_undegraded":"2024-09-14T08:41:25.805355+0000","last_fullsized":"2024-09-14T08:41:25.805355+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:54.999706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002389113,"stat_sum":{"num_bytes":22237696,"num_objects":29,"num_object_clones":3,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":12,"num_read":4164,"num_read_kb":15753,"num_write":175,"num_write_kb":1689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"106'330","reported_seq":4797,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.831300+0000","last_change":"2024-09-14T08:41:12.616269+0000","last_active":"2024-09-14T08:41:25.831300+0000","last_peered":"2024-09-14T08:41:25.831300+0000","last_clean":"2024-09-14T08:41:25.831300+0000","last_became_active":"2024-09-14T08:41:12.612680+0000","last_became_peered":"2024-09-14T08:41:12.612680+0000","last_unstale":"2024-09-14T08:41:25.831300+0000","last_undegraded":"2024-09-14T08:41:25.831300+0000","last_fullsized":"2024-09-14T08:41:25.831300+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:03.929265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023917970000000002,"stat_sum":{"num_bytes":47791120,"num_objects":54,"num_object_clones":13,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":22,"num_read":4369,"num_read_kb":29855,"num_write":311,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4367376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"107'270","reported_seq":3802,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716141+0000","last_change":"2024-09-14T08:41:12.610800+0000","last_active":"2024-09-14T08:41:25.716141+0000","last_peered":"2024-09-14T08:41:25.716141+0000","last_clean":"2024-09-14T08:41:25.716141+0000","last_became_active":"2024-09-14T08:41:12.608500+0000","last_became_peered":"2024-09-14T08:41:12.608500+0000","last_unstale":"2024-09-14T08:41:25.716141+0000","last_undegraded":"2024-09-14T08:41:25.716141+0000","last_fullsized":"2024-09-14T08:41:25.716141+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:50.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024547029999999999,"stat_sum":{"num_bytes":44448398,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":4940,"num_read_kb":25763,"num_write":265,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":461564,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"108'252","reported_seq":3715,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:26.105972+0000","last_change":"2024-09-14T08:41:13.629949+0000","last_active":"2024-09-14T08:41:26.105972+0000","last_peered":"2024-09-14T08:41:26.105972+0000","last_clean":"2024-09-14T08:41:26.105972+0000","last_became_active":"2024-09-14T08:41:13.628700+0000","last_became_peered":"2024-09-14T08:41:13.628700+0000","last_unstale":"2024-09-14T08:41:26.105972+0000","last_undegraded":"2024-09-14T08:41:26.105972+0000","last_fullsized":"2024-09-14T08:41:26.105972+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:01.135980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001362044,"stat_sum":{"num_bytes":11798095,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":20,"num_read":3899,"num_read_kb":11147,"num_write":213,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":841295,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"102'365","reported_seq":3913,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.830889+0000","last_change":"2024-09-14T08:41:12.619512+0000","last_active":"2024-09-14T08:41:25.830889+0000","last_peered":"2024-09-14T08:41:25.830889+0000","last_clean":"2024-09-14T08:41:25.830889+0000","last_became_active":"2024-09-14T08:41:12.616601+0000","last_became_peered":"2024-09-14T08:41:12.616601+0000","last_unstale":"2024-09-14T08:41:25.830889+0000","last_undegraded":"2024-09-14T08:41:25.830889+0000","last_fullsized":"2024-09-14T08:41:25.830889+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:51.614893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013117140000000001,"stat_sum":{"num_bytes":13324914,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":15,"num_read":3918,"num_read_kb":13891,"num_write":360,"num_write_kb":5180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":5260516,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"101'242","reported_seq":2045,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-14T08:41:25.716225+0000","last_change":"2024-09-14T08:40:41.553903+0000","last_active":"2024-09-14T08:41:25.716225+0000","last_peered":"2024-09-14T08:41:25.716225+0000","last_clean":"2024-09-14T08:41:25.716225+0000","last_became_active":"2024-09-14T08:40:41.420572+0000","last_became_peered":"2024-09-14T08:40:41.420572+0000","last_unstale":"2024-09-14T08:41:25.716225+0000","last_undegraded":"2024-09-14T08:41:25.716225+0000","last_fullsized":"2024-09-14T08:41:25.716225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:05.821148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018326740000000001,"stat_sum":{"num_bytes":13699204,"num_objects":39,"num_object_clones":5,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":18,"num_read":2236,"num_read_kb":8879,"num_write":252,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":515126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":819833989,"num_objects":1205,"num_object_clones":210,"num_object_copies":2410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1205,"num_whiteouts":497,"num_read":428739,"num_read_kb":825467,"num_write":14698,"num_write_kb":194683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1279,"num_bytes_recovered":33373813,"num_keys_recovered":219,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":176943104,"data_stored":206775098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8169,"internal_metadata":0},"log_size":12706,"ondisk_log_size":12706,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80276,"kb_used_data":31036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94291564,"statfs":{"total":96636764160,"available":96554561536,"internally_reserved":0,"allocated":31780864,"data_stored":37088235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574881,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66512,"kb_used_data":35324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94305328,"statfs":{"total":96636764160,"available":96568655872,"internally_reserved":0,"allocated":36171776,"data_stored":38506977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118804,"kb_used_data":43196,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94253036,"statfs":{"total":96636764160,"available":96515108864,"internally_reserved":0,"allocated":44232704,"data_stored":54423502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607585,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65244,"kb_used_data":38220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94306596,"statfs":{"total":96636764160,"available":96569954304,"internally_reserved":0,"allocated":39137280,"data_stored":46789311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":0,"seq":450971566082,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16867328,"data_stored":16742054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8169,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42373120,"data_stored":53309639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34304000,"data_stored":37388132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12910592,"data_stored":14407564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30507008,"data_stored":36559760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39981056,"data_stored":48367949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:41:29.290 INFO:tasks.thrashosds.thrasher:Setting 3.4 to [5, 1] 2024-09-14T08:41:29.290 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.4', '5', '1'] 2024-09-14T08:41:29.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.4 5 1 2024-09-14T08:41:29.322 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:29.322 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:29.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:29.322 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:29.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.322 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31801 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3317760~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.322 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397805606999995, 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072483031000000003, 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31801 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925626+0000", 2024-09-14T08:41:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925628+0000", 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2919999999999998e-06 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925635+0000", 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.567e-06 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925641+0000", 2024-09-14T08:41:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-14T08:41:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997773+0000", 2024-09-14T08:41:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072131561999999996 2024-09-14T08:41:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.997882+0000", 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109211 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998109+0000", 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022657100000000001 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.327 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31802 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3338240~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397783051000005, 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072824657000000001, 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31802 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925648+0000", 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925649+0000", 2024-09-14T08:41:29.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925651+0000", 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.119e-06 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925659+0000", 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999997e-06 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925667+0000", 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3010000000000007e-06 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998163+0000", 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072496182000000006 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998292+0000", 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128584 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998473+0000", 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018122900000000001 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31803 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3329024~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397715035999994, 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073188959999999997, 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31803 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925716+0000", 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925717+0000", 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1850000000000001e-06 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925722+0000", 2024-09-14T08:41:29.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1500000000000001e-06 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925735+0000", 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3010000000000001e-05 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925747+0000", 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2784e-05 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998540+0000", 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072792988000000003 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998649+0000", 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109014 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.998905+0000", 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025582900000000001 2024-09-14T08:41:29.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31804 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3340288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397665308000001, 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073540820000000007, 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31804 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925766+0000", 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925767+0000", 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925771+0000", 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8020000000000002e-06 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925788+0000", 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7717999999999999e-05 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925800+0000", 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1277999999999999e-05 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999033+0000", 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073233819000000006 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999130+0000", 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6645999999999996e-05 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999307+0000", 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176732 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31805 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3349504~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397614153000006, 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073994605000000005, 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31805 2024-09-14T08:41:29.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925817+0000", 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925818+0000", 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9999999999999997e-07 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925822+0000", 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5889999999999996e-06 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925836+0000", 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3716e-05 2024-09-14T08:41:29.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925853+0000", 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6714999999999998e-05 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999393+0000", 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073539915999999997 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999533+0000", 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013985700000000001 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999812+0000", 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027911199999999998 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31806 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3351552~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:29.346 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397562149999999, 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074285479000000001, 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31806 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:29.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925869+0000", 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925870+0000", 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925874+0000", 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1949999999999996e-06 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925888+0000", 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3618000000000001e-05 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925914+0000", 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5959e-05 2024-09-14T08:41:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999866+0000", 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073952041999999996 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.999951+0000", 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4855e-05 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000155+0000", 2024-09-14T08:41:29.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020395100000000001 2024-09-14T08:41:29.351 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.351 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.351 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.351 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31807 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3360768~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.351 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:29.351 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397499580000002, 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074558713999999998, 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31807 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:29.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925932+0000", 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925933+0000", 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6300000000000004e-07 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925937+0000", 2024-09-14T08:41:29.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-14T08:41:29.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925953+0000", 2024-09-14T08:41:29.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6166000000000001e-05 2024-09-14T08:41:29.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925968+0000", 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4742e-05 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000211+0000", 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074242359999999993 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000307+0000", 2024-09-14T08:41:29.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6243999999999995e-05 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000490+0000", 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000183575 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31808 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3372032~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.356 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397433002, 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074821628000000001, 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31808 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925998+0000", 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.925999+0000", 2024-09-14T08:41:29.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926028+0000", 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8994000000000001e-05 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926044+0000", 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6402e-05 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926056+0000", 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1421e-05 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000548+0000", 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074492339000000005 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000643+0000", 2024-09-14T08:41:29.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4888000000000004e-05 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000820+0000", 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017677400000000001 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31809 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3362816~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:29.361 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397355218000001, 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075069352000000006, 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31809 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926076+0000", 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926077+0000", 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926081+0000", 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0260000000000001e-06 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926102+0000", 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0594999999999998e-05 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926113+0000", 2024-09-14T08:41:29.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1243000000000001e-05 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000879+0000", 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074765679000000002 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.000971+0000", 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199000000000003e-05 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001145+0000", 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017465699999999999 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31810 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3383296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397302522999993, 2024-09-14T08:41:29.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075342934, 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31810 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926129+0000", 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926130+0000", 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4e-07 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926134+0000", 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2860000000000001e-06 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926150+0000", 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6441000000000001e-05 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926161+0000", 2024-09-14T08:41:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0108e-05 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001202+0000", 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075041666000000007 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001294+0000", 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2250999999999995e-05 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001472+0000", 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017724200000000001 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31811 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3374080~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397256870000007, 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075615824999999998, 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31811 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926174+0000", 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926175+0000", 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0999999999999997e-07 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926179+0000", 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7969999999999998e-06 2024-09-14T08:41:29.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926192+0000", 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3045e-05 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926205+0000", 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2483999999999999e-05 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001530+0000", 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075325005 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001621+0000", 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0983999999999995e-05 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001790+0000", 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001697 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.375 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31812 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3394560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397210399000002, 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075893086999999998, 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31812 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926221+0000", 2024-09-14T08:41:29.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926222+0000", 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7899999999999997e-07 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926225+0000", 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926240+0000", 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4718e-05 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926252+0000", 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1491000000000001e-05 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001847+0000", 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075595284999999998 2024-09-14T08:41:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.001937+0000", 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002114+0000", 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176482 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397164411000006, 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.381 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:41:29.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397136153000005, 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:41:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:41:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:41:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 92.397081374999999, 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:29.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:41:29.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.969310915999998, 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:41:29.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:41:29.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:29.399 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.976706849000003, 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:41:29.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:29.404 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.975868478000002, 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:29.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:29.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:41:29.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.410 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:25957 3.6 3:63e7fb75:::rbd_object_map.10f1b8e048d3:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 24.099414025000002, 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.072282491000000004, 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 25957 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224017+0000", 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224018+0000", 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023e-06 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224025+0000", 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4529999999999999e-06 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224045+0000", 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0115999999999998e-05 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224061+0000", 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5892999999999998e-05 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.291466+0000", 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067405667000000002 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.291546+0000", 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9741999999999996e-05 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.295946+0000", 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0043998860000000004 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.296085+0000", 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013912899999999999 2024-09-14T08:41:29.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.296300+0000", 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000214582 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5182.0:25958 3.6 3:63e7fb75:::rbd_object_map.10f1b8e048d3:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 24.099349070999999, 2024-09-14T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.073197778000000005, 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5182", 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2058288283", 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 25958 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224082+0000", 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224083+0000", 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1000000000000001e-06 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224090+0000", 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5570000000000001e-06 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224110+0000", 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9825000000000001e-05 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.224126+0000", 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5874000000000001e-05 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.293676+0000", 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069550314000000002 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.293764+0000", 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7631000000000002e-05 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297122+0000", 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033583250000000001 2024-09-14T08:41:29.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297194+0000", 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2593000000000001e-05 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:05.297280+0000", 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5558999999999999e-05 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.421 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.422 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:29.423 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:29.424 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:29.422+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:29.524 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:29.522+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:29.583 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:29.583 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:29.583 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:29.584 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:29.596 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:29.643 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:29.644+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:29.714 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:29.715 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:29.715 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:29.725 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:29.726+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:29.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:29.737 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:41:29.742 INFO:teuthology.orchestra.run.smithi089.stderr:set 3.4 pg_upmap mapping to [5,1] 2024-09-14T08:41:29.806 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:29.826 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:29.826+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 79.553146018999996, 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.858 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:29.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:29.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:29.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:29.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:29.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:29.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.291035839999999, 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.865 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:29.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:29.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:29.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.290888668999997, 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.870 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:29.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:29.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.290746869000003, 2024-09-14T08:41:29.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:29.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:662 3.5 3:a1d4b776:::rbd_data.10f12f878d5b.0000000000000009:1a [read 2322432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7590214060000005, 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074230409999999997, 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 662 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099683+0000", 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099686+0000", 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0900000000000001e-06 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099695+0000", 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9730000000000003e-06 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099701+0000", 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173763+0000", 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074061622999999993 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173817+0000", 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4020000000000001e-05 2024-09-14T08:41:29.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173912+0000", 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5290000000000004e-05 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:663 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:29.885 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7589928629999996, 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074329749000000001, 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 663 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:29.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099711+0000", 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.37e-07 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099723+0000", 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1566000000000001e-05 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099731+0000", 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7129999999999994e-06 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099738+0000", 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9829999999999999e-06 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173997+0000", 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074258324000000001 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174040+0000", 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3526000000000003e-05 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:664 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.889 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7589555399999997, 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074317628999999996, 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 664 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099751+0000", 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7669999999999999e-06 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099761+0000", 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9029999999999999e-06 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099768+0000", 2024-09-14T08:41:29.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9129999999999997e-06 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174059+0000", 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074290615000000004 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174065+0000", 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7379999999999997e-06 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:665 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7589262679999997, 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074368651999999993, 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 665 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.894 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099778+0000", 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099780+0000", 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7590000000000002e-06 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099789+0000", 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2940000000000006e-06 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099795+0000", 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6359999999999997e-06 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174121+0000", 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074325712000000002 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174146+0000", 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4576999999999999e-05 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.897 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:666 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7588990750000004, 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074362869999999998, 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.898 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 666 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099805+0000", 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6400000000000002e-07 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099808+0000", 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.943e-06 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099816+0000", 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1999999999999994e-06 2024-09-14T08:41:29.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099823+0000", 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9959999999999996e-06 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174161+0000", 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074338038999999995 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174167+0000", 2024-09-14T08:41:29.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0279999999999997e-06 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:667 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7588712419999997, 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074416247000000005, 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 667 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099833+0000", 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3600000000000003e-07 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099835+0000", 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099844+0000", 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3999999999999992e-06 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099850+0000", 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7569999999999998e-06 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174224+0000", 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074373854000000003 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174248+0000", 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3903000000000001e-05 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:668 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7588435889999996, 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074410031000000001, 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.906 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 668 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5600000000000005e-07 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099863+0000", 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.774e-06 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099872+0000", 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5420000000000005e-06 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099879+0000", 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.007e-06 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174264+0000", 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074385234999999994 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174270+0000", 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8170000000000004e-06 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.910 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:669 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7588136299999997, 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074470898999999993, 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 669 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099891+0000", 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4270000000000001e-06 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099896+0000", 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9699999999999998e-06 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099911+0000", 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4518999999999999e-05 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099922+0000", 2024-09-14T08:41:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1516e-05 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174321+0000", 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074399274000000001 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174361+0000", 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9193000000000002e-05 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.914 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:670 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.758732449, 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074410134000000003, 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 670 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.915 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099972+0000", 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.11e-06 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099977+0000", 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2569999999999998e-06 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099994+0000", 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7050000000000001e-05 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100008+0000", 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3298999999999999e-05 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174375+0000", 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074367528000000002 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174381+0000", 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:41:29.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:671 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7586745260000001, 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074430406000000005, 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 671 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100030+0000", 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1659999999999999e-06 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100035+0000", 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8770000000000001e-06 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100067+0000", 2024-09-14T08:41:29.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2091999999999997e-05 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100092+0000", 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5337000000000002e-05 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174436+0000", 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074343321000000004 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174459+0000", 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3612999999999999e-05 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:672 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.758591462, 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074365733000000003, 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 672 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100113+0000", 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.164e-06 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100118+0000", 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4500000000000003e-06 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100139+0000", 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0539000000000001e-05 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100152+0000", 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.308e-05 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174472+0000", 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074319978999999994 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174478+0000", 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5210000000000002e-06 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:673 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.758516567, 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074369967999999995, 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 673 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100188+0000", 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.24e-06 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100193+0000", 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.95e-06 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100224+0000", 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0769999999999998e-05 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100250+0000", 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6279e-05 2024-09-14T08:41:29.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174533+0000", 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074282772999999996 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174557+0000", 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3955999999999999e-05 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:674 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7584337779999997, 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074305948999999996, 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 674 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100271+0000", 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2100000000000001e-06 2024-09-14T08:41:29.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100276+0000", 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4659999999999998e-06 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100294+0000", 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7425999999999999e-05 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100307+0000", 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.325e-05 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174570+0000", 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074263037000000004 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174575+0000", 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5600000000000001e-06 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:675 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7583792630000001, 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074329609000000005, 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 675 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100325+0000", 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.043e-06 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100367+0000", 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1820000000000003e-05 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100388+0000", 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0951999999999999e-05 2024-09-14T08:41:29.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100461+0000", 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3641999999999997e-05 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174631+0000", 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074169152000000002 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174654+0000", 2024-09-14T08:41:29.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3e-05 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:676 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7582188099999998, 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074190246000000001, 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 676 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100486+0000", 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3599999999999999e-06 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100493+0000", 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8369999999999999e-06 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100510+0000", 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7473e-05 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100525+0000", 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4963000000000001e-05 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174669+0000", 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074144134 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174675+0000", 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4790000000000004e-06 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:677 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7581321650000001, 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074180142000000004, 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:29.944 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 677 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100572+0000", 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.167e-06 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100578+0000", 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100596+0000", 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7903000000000001e-05 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100609+0000", 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3576e-05 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174727+0000", 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074118013999999996 2024-09-14T08:41:29.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:29.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:29.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:29.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174751+0000", 2024-09-14T08:41:29.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3866000000000002e-05 2024-09-14T08:41:29.948 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.948 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.948 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.948 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:29.948 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:29.948 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:29.950 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:41:29.950 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:41:29.951 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:29.948+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:29.955 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:29.956 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:29.972 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:29.972 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:29.990 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:29.990 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:30.008 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:30.008 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:30.030 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:30.030 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:30.036 INFO:teuthology.orchestra.run.smithi188.stdout:3071 write 0xd770e00 thru 0xd7762ff (0x5500 bytes) 2024-09-14T08:41:30.058 INFO:teuthology.orchestra.run.smithi188.stdout:3073 trunc from 0xd776400 to 0x562b800 2024-09-14T08:41:30.089 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:30.089 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:30.091 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:30.092+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:30.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:30.151 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:30.150+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:30.225 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:30.225 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:30.238 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:30.281 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:30.282+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:30.353 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:30.352+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:30.404 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:30.405 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:30.419 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:30.469 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:30.470+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:30.543 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:30.543 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:30.555 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:30.554+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:30.558 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:30.656 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:30.654+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:30.727 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:30.727 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:30.741 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:30.785 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:30.786+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:30.857 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:30.858+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:30.911 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:30.911 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:30.925 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:30.958 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:30.956+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:31.043 INFO:teuthology.orchestra.run.smithi188.stdout:3074 trunc from 0x562b800 to 0xb03a800 2024-09-14T08:41:31.059 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:31.056+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:31.068 INFO:teuthology.orchestra.run.smithi188.stdout:3075 punch from 0x896200 to 0x89a400, (0x4200 bytes) 2024-09-14T08:41:31.096 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:31.096 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:31.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:31.160 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:31.160+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:31.234 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:31.234 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:31.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:31.293 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:31.294+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:31.362 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:31.362+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:31.371 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:31.371 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:31.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:41:31.463 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:31.464+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:31.512 INFO:teuthology.orchestra.run.smithi188.stdout:3076 write 0xec9f600 thru 0xecac925 (0xd326 bytes) 2024-09-14T08:41:31.513 INFO:teuthology.orchestra.run.smithi188.stdout:3077 write 0xd53ee00 thru 0xd53fabe (0xcbf bytes) 2024-09-14T08:41:31.522 INFO:teuthology.orchestra.run.smithi188.stdout:3078 trunc from 0xecaca00 to 0xaf78e00 2024-09-14T08:41:31.526 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:31.526 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:31.544 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:41:31.584 INFO:teuthology.orchestra.run.smithi188.stdout:3079 read 0x3e13200 thru 0x3e18c4f (0x5a50 bytes) 2024-09-14T08:41:31.591 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:31.592+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:31.592 INFO:teuthology.orchestra.run.smithi188.stdout:3082 read 0x4476400 thru 0x44844e7 (0xe0e8 bytes) 2024-09-14T08:41:31.611 INFO:teuthology.orchestra.run.smithi188.stdout:3083 write 0xb47b000 thru 0xb47e090 (0x3091 bytes) 2024-09-14T08:41:31.613 INFO:teuthology.orchestra.run.smithi188.stdout:3084 write 0x587d200 thru 0x58812ef (0x40f0 bytes) 2024-09-14T08:41:31.664 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:31.664+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:31.671 INFO:teuthology.orchestra.run.smithi188.stdout:3085 write 0xd411400 thru 0xd41854d (0x714e bytes) 2024-09-14T08:41:31.673 INFO:teuthology.orchestra.run.smithi188.stdout:3087 write 0x2a63400 thru 0x2a650f5 (0x1cf6 bytes) 2024-09-14T08:41:31.674 INFO:teuthology.orchestra.run.smithi188.stdout:3088 read 0xafdca00 thru 0xafeb881 (0xee82 bytes) 2024-09-14T08:41:31.675 INFO:teuthology.orchestra.run.smithi188.stdout:3098 write 0x4a8ac00 thru 0x4a96cf6 (0xc0f7 bytes) 2024-09-14T08:41:31.682 INFO:teuthology.orchestra.run.smithi188.stdout:3099 trunc from 0xd418600 to 0xb364400 2024-09-14T08:41:31.749 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:31.749 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:31.765 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:31.766+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:31.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:41:31.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:41:31.865 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:31.864+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:31.914 INFO:teuthology.orchestra.run.smithi188.stdout:3103 write 0xec3c000 thru 0xec44526 (0x8527 bytes) 2024-09-14T08:41:31.915 INFO:teuthology.orchestra.run.smithi188.stdout:3104 punch from 0x1ab6000 to 0x1ac2e00, (0xce00 bytes) 2024-09-14T08:41:31.969 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:31.966+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:31.977 INFO:teuthology.orchestra.run.smithi188.stdout:3105 trunc from 0xec44600 to 0xaf13a00 2024-09-14T08:41:31.977 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:31.977 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:31.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:32.047 INFO:teuthology.orchestra.run.smithi188.stdout:3107 read 0x724000 thru 0x730248 (0xc249 bytes) 2024-09-14T08:41:32.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:32.057 INFO:teuthology.orchestra.run.smithi188.stdout:3108 trunc from 0xaf13a00 to 0x8a78c00 2024-09-14T08:41:32.068 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:32.066+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:32.073 INFO:teuthology.orchestra.run.smithi188.stdout:3109 read 0x30ba200 thru 0x30c840f (0xe210 bytes) 2024-09-14T08:41:32.093 INFO:teuthology.orchestra.run.smithi188.stdout:3110 trunc from 0x8a78c00 to 0x5858200 2024-09-14T08:41:32.112 INFO:teuthology.orchestra.run.smithi188.stdout:3111 write 0x2b26200 thru 0x2b29430 (0x3231 bytes) 2024-09-14T08:41:32.116 INFO:teuthology.orchestra.run.smithi188.stdout:3112 read 0x4f16e00 thru 0x4f26286 (0xf487 bytes) 2024-09-14T08:41:32.145 INFO:teuthology.orchestra.run.smithi188.stdout:3119 write 0x6aa3400 thru 0x6aa4cdb (0x18dc bytes) 2024-09-14T08:41:32.149 INFO:teuthology.orchestra.run.smithi188.stdout:3120 trunc from 0x6aa4e00 to 0x5ff5a00 2024-09-14T08:41:32.169 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:32.166+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:32.177 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:32.177 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:32.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:32.209 INFO:teuthology.orchestra.run.smithi188.stdout:3123 trunc from 0x5ff5a00 to 0xeaa7400 2024-09-14T08:41:32.237 INFO:teuthology.orchestra.run.smithi188.stdout:3125 trunc from 0xeaa7400 to 0x7fe7400 2024-09-14T08:41:32.243 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:41:32.243 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:41:32.263 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:32.263 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:32.270 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:32.270+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:32.281 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:32.282 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:32.284 INFO:teuthology.orchestra.run.smithi188.stdout:3126 trunc from 0x7fe7400 to 0xb4c200 2024-09-14T08:41:32.314 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:32.338 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:32.339 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:32.344 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:32.345 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:32.351 INFO:teuthology.orchestra.run.smithi188.stdout:3128 punch from 0x4dda00 to 0x4ec600, (0xec00 bytes) 2024-09-14T08:41:32.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:32.375 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:32.375 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:32.376 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:32.376+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:32.471 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:32.470+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:32.476 INFO:teuthology.orchestra.run.smithi188.stdout:3129 read 0x998e00 thru 0x9a85d8 (0xf7d9 bytes) 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31813 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3385344~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 95.580989420999998, 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076201313000000007, 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.506 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31813 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926267+0000", 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926268+0000", 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926272+0000", 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2220000000000004e-06 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926281+0000", 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9309999999999997e-06 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926287+0000", 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002170+0000", 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075882622999999996 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002260+0000", 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0532000000000007e-05 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002468+0000", 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020804800000000001 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:32.510 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 95.580961162999998, 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:41:32.514 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 95.580906385000006, 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:32.515 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.153135926000004, 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:41:32.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:41:32.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.160531859000002, 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.523 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:32.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.159693488000002, 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.528 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:32.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:41:32.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33893 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1386496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366037+0000", 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.14121900800000001, 2024-09-14T08:41:32.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076224884000000007, 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33893 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366037+0000", 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366037+0000", 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366038+0000", 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7999999999999995e-07 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366040+0000", 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1959999999999998e-06 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366047+0000", 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5490000000000003e-06 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366052+0000", 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442026+0000", 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075974418000000002 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442072+0000", 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6063000000000003e-05 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442262+0000", 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019011200000000001 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.141185387, 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:41:32.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.14087117800000001, 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.541 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:41:32.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:41:32.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33900 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1472512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.367946+0000", 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.139309871, 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076240815000000003, 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.545 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33900 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367946+0000", 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367946+0000", 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367977+0000", 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0749e-05 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367981+0000", 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4460000000000001e-06 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368000+0000", 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9664999999999999e-05 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368010+0000", 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9259999999999995e-06 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.443972+0000", 2024-09-14T08:41:32.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075961905999999996 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444039+0000", 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7194999999999996e-05 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444187+0000", 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000147928 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.13923485199999999, 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:41:32.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.139016893, 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:32.558 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.138721491, 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:41:32.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:41:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.13845065600000001, 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:41:32.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33905 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1533952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.369112+0000", 2024-09-14T08:41:32.567 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.13814457999999999, 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076298569999999996, 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33905 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369112+0000", 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369112+0000", 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369919+0000", 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00080722699999999999 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369923+0000", 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2570000000000001e-06 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369935+0000", 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1888999999999999e-05 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369942+0000", 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0870000000000001e-06 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445235+0000", 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075293020000000002 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445278+0000", 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3069999999999999e-05 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445410+0000", 2024-09-14T08:41:32.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013202 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33908 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1570816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.370016+0000", 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.13724060699999999, 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076192722000000004, 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.572 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33908 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370016+0000", 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370016+0000", 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370194+0000", 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000178438 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370198+0000", 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.782e-06 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370207+0000", 2024-09-14T08:41:32.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5389999999999996e-06 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370214+0000", 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9229999999999996e-06 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445966+0000", 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075751570000000004 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446014+0000", 2024-09-14T08:41:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8223000000000002e-05 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446208+0000", 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019424700000000001 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33909 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1583104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.370232+0000", 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.137023964, 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076205474999999995, 2024-09-14T08:41:32.576 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33909 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370232+0000", 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370232+0000", 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370484+0000", 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025182500000000001 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370488+0000", 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9020000000000001e-06 2024-09-14T08:41:32.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370500+0000", 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1858999999999999e-05 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370508+0000", 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446226+0000", 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075718191000000004 2024-09-14T08:41:32.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446269+0000", 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3191e-05 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446438+0000", 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000168679 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.580 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33910 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1595392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.370520+0000", 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.13673635200000001, 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076152039000000005, 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33910 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370520+0000", 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370520+0000", 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370742+0000", 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022212600000000001 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370746+0000", 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7859999999999998e-06 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370757+0000", 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0910000000000001e-05 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370764+0000", 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2089999999999999e-06 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446470+0000", 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075706356000000002 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446518+0000", 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7372e-05 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446672+0000", 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015427999999999999 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33911 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1607680~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.370777+0000", 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.13647957499999999, 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076142804999999994, 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33911 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370777+0000", 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.370777+0000", 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.371116+0000", 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033936399999999999 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.371120+0000", 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8430000000000003e-06 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.371132+0000", 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1885000000000001e-05 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.371140+0000", 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6510000000000007e-06 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446689+0000", 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075548880999999998 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446734+0000", 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4394000000000002e-05 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.446920+0000", 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000185787 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33926 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1792000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.374720+0000", 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.13253590700000001, 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076136237999999995, 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33926 2024-09-14T08:41:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.374720+0000", 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.374720+0000", 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.374982+0000", 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000261847 2024-09-14T08:41:32.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.374985+0000", 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0400000000000001e-06 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.374996+0000", 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0305e-05 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.375002+0000", 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9290000000000003e-06 2024-09-14T08:41:32.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.450616+0000", 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075614349999999997 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.450664+0000", 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8049e-05 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.450857+0000", 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019271800000000001 2024-09-14T08:41:32.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.593 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:32.593 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:32.593 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:32.594 INFO:teuthology.orchestra.run.smithi188.stdout:3130 read 0x68b400 thru 0x692ac9 (0x76ca bytes) 2024-09-14T08:41:32.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:32.595 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:32.592+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:32.661 INFO:teuthology.orchestra.run.smithi188.stdout:3131 punch from 0x5c6400 to 0x5d4000, (0xdc00 bytes) 2024-09-14T08:41:32.689 INFO:teuthology.orchestra.run.smithi188.stdout:3132 trunc from 0xb4c200 to 0xc14a200 2024-09-14T08:41:32.695 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:32.694+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:32.750 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:32.750 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:32.750 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:32.750 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:32.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:32.777 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:41:32.843 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:32.844+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:32.885 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:32.885 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:32.885 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:32.885 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:32.885 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:32.897 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:32.898+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:32.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:32.992 INFO:teuthology.orchestra.run.smithi188.stdout:3136 write 0x8699c00 thru 0x86a079b (0x6b9c bytes) 2024-09-14T08:41:32.994 INFO:teuthology.orchestra.run.smithi188.stdout:3137 read 0x6a7a600 thru 0x6a7f479 (0x4e7a bytes) 2024-09-14T08:41:32.994 INFO:teuthology.orchestra.run.smithi188.stdout:3138 read 0x5e8be00 thru 0x5e904d8 (0x46d9 bytes) 2024-09-14T08:41:32.994 INFO:teuthology.orchestra.run.smithi188.stdout:3139 read 0xa488c00 thru 0xa4961fd (0xd5fe bytes) 2024-09-14T08:41:32.995 INFO:teuthology.orchestra.run.smithi188.stdout:3142 write 0x1742800 thru 0x174a1dd (0x79de bytes) 2024-09-14T08:41:32.998 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:32.998+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:33.054 INFO:teuthology.orchestra.run.smithi188.stdout:3143 write 0xeb73600 thru 0xeb83280 (0xfc81 bytes) 2024-09-14T08:41:33.056 INFO:teuthology.orchestra.run.smithi188.stdout:3144 punch from 0xe106600 to 0xe115200, (0xec00 bytes) 2024-09-14T08:41:33.057 INFO:teuthology.orchestra.run.smithi188.stdout:3147 punch from 0xa99be00 to 0xa9a9400, (0xd600 bytes) 2024-09-14T08:41:33.083 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:33.083 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.777647090000002, 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:33.084 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:33.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.515536910999998, 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.090 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.515389740000003, 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.095 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:33.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.515247940000002, 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:33.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:33.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:33.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:662 3.5 3:a1d4b776:::rbd_data.10f12f878d5b.0000000000000009:1a [read 2322432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9835224769999993, 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074230409999999997, 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.106 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 662 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:33.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099683+0000", 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099686+0000", 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0900000000000001e-06 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099695+0000", 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9730000000000003e-06 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099701+0000", 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173763+0000", 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074061622999999993 2024-09-14T08:41:33.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173817+0000", 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4020000000000001e-05 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173912+0000", 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5290000000000004e-05 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.110 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:663 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9834939340000002, 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074329749000000001, 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 663 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099711+0000", 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.37e-07 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099723+0000", 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1566000000000001e-05 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099731+0000", 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7129999999999994e-06 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099738+0000", 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9829999999999999e-06 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173997+0000", 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074258324000000001 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174040+0000", 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3526000000000003e-05 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.114 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:664 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9834566109999994, 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074317628999999996, 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.115 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 664 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099751+0000", 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7669999999999999e-06 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099761+0000", 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9029999999999999e-06 2024-09-14T08:41:33.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099768+0000", 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9129999999999997e-06 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174059+0000", 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074290615000000004 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174065+0000", 2024-09-14T08:41:33.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7379999999999997e-06 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:665 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9834273390000003, 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074368651999999993, 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 665 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:33.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099778+0000", 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099780+0000", 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7590000000000002e-06 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099789+0000", 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2940000000000006e-06 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099795+0000", 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6359999999999997e-06 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174121+0000", 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074325712000000002 2024-09-14T08:41:33.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174146+0000", 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4576999999999999e-05 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:666 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9834001459999993, 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074362869999999998, 2024-09-14T08:41:33.123 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 666 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099805+0000", 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6400000000000002e-07 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099808+0000", 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.943e-06 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099816+0000", 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1999999999999994e-06 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099823+0000", 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9959999999999996e-06 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174161+0000", 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074338038999999995 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174167+0000", 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0279999999999997e-06 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.127 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:667 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9833723130000003, 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074416247000000005, 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 667 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099833+0000", 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3600000000000003e-07 2024-09-14T08:41:33.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099835+0000", 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099844+0000", 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3999999999999992e-06 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099850+0000", 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7569999999999998e-06 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174224+0000", 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074373854000000003 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174248+0000", 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3903000000000001e-05 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:668 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9833446600000002, 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074410031000000001, 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 668 2024-09-14T08:41:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5600000000000005e-07 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099863+0000", 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.774e-06 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099872+0000", 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5420000000000005e-06 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099879+0000", 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.007e-06 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174264+0000", 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074385234999999994 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174270+0000", 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8170000000000004e-06 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:669 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9833147009999994, 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074470898999999993, 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 669 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099891+0000", 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4270000000000001e-06 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099896+0000", 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9699999999999998e-06 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099911+0000", 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4518999999999999e-05 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099922+0000", 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1516e-05 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174321+0000", 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074399274000000001 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174361+0000", 2024-09-14T08:41:33.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9193000000000002e-05 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:670 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9832335200000006, 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074410134000000003, 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 670 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:33.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099972+0000", 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.11e-06 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099977+0000", 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2569999999999998e-06 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099994+0000", 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7050000000000001e-05 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100008+0000", 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3298999999999999e-05 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174375+0000", 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074367528000000002 2024-09-14T08:41:33.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174381+0000", 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:671 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9831755970000007, 2024-09-14T08:41:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074430406000000005, 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 671 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100030+0000", 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1659999999999999e-06 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100035+0000", 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8770000000000001e-06 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100067+0000", 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2091999999999997e-05 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100092+0000", 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5337000000000002e-05 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174436+0000", 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074343321000000004 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174459+0000", 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3612999999999999e-05 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:672 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.149 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9830925330000007, 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074365733000000003, 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 672 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100113+0000", 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.164e-06 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100118+0000", 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4500000000000003e-06 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100139+0000", 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0539000000000001e-05 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100152+0000", 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.308e-05 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174472+0000", 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074319978999999994 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174478+0000", 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5210000000000002e-06 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:673 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9830176379999997, 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074369967999999995, 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 673 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100188+0000", 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.24e-06 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100193+0000", 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.95e-06 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100224+0000", 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0769999999999998e-05 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100250+0000", 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6279e-05 2024-09-14T08:41:33.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174533+0000", 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074282772999999996 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174557+0000", 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3955999999999999e-05 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:674 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9829348489999994, 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074305948999999996, 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 674 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.158 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100271+0000", 2024-09-14T08:41:33.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2100000000000001e-06 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100276+0000", 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4659999999999998e-06 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100294+0000", 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7425999999999999e-05 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100307+0000", 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.325e-05 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174570+0000", 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074263037000000004 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174575+0000", 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5600000000000001e-06 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.161 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:675 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9828803340000007, 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074329609000000005, 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.162 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 675 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100325+0000", 2024-09-14T08:41:33.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.043e-06 2024-09-14T08:41:33.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100367+0000", 2024-09-14T08:41:33.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1820000000000003e-05 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100388+0000", 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0951999999999999e-05 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100461+0000", 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3641999999999997e-05 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174631+0000", 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074169152000000002 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174654+0000", 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3e-05 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.166 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:676 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9827198809999995, 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074190246000000001, 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 676 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100486+0000", 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3599999999999999e-06 2024-09-14T08:41:33.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100493+0000", 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8369999999999999e-06 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100510+0000", 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7473e-05 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100525+0000", 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4963000000000001e-05 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174669+0000", 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074144134 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174675+0000", 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4790000000000004e-06 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.170 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:677 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9826332359999999, 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074180142000000004, 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.171 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 677 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100572+0000", 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.167e-06 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100578+0000", 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100596+0000", 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7903000000000001e-05 2024-09-14T08:41:33.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100609+0000", 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3576e-05 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174727+0000", 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074118013999999996 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174751+0000", 2024-09-14T08:41:33.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3866000000000002e-05 2024-09-14T08:41:33.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.175 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:33.175 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:33.175 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:33.176 INFO:teuthology.orchestra.run.smithi188.stdout:3149 trunc from 0xeb83400 to 0x29de200 2024-09-14T08:41:33.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:33.177 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:33.178+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:33.278 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:33.278+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:33.306 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:33.306 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:33.307 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:33.307 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:33.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:33.379 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:33.376+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:33.480 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:33.480+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:33.493 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:33.494 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:33.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:33.580 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:33.578+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:33.627 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379686895999995, 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379624883000005, 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379558552999995, 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:41:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379503092999997, 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:41:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:41:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379443472999995, 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:41:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379361932999998, 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:41:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:41:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379305604999999, 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379234109999999, 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379161238999998, 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:41:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379119027000002, 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:41:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379089196999999, 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:41:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379060899999999, 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:41:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.379019804999999, 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:41:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.378990775000005, 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:41:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:41:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:41:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.378962290999993, 2024-09-14T08:41:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:41:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.378934150999996, 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.378905454999995, 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:41:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.378876697999999, 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:41:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.708 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.378848650999998, 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:41:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.378818674000001, 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:41:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.718 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.718 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.718 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.718 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.718 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:33.719 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:33.720 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:33.718+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:33.820 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:33.820+0000 7fda6cb47640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36377) UID: 0 2024-09-14T08:41:33.872 INFO:teuthology.orchestra.run.smithi188.stdout:3150 punch from 0x1b35800 to 0x1b42200, (0xca00 bytes) 2024-09-14T08:41:33.874 INFO:teuthology.orchestra.run.smithi188.stdout:3151 read 0x18d4e00 thru 0x18e3362 (0xe563 bytes) 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.5631.0:35557 3.14 e115/77)", 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.901298+0000", 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00020270100000000001, 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023199700000000001, 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.901298+0000", 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.901298+0000", 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.901300+0000", 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-14T08:41:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.901311+0000", 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1063999999999999e-05 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.901341+0000", 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0001999999999998e-05 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.901366+0000", 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5205999999999999e-05 2024-09-14T08:41:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.901508+0000", 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142552 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.901530+0000", 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2053e-05 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35557 3.14 3:2911bd67:::rbd_data.10f1b915d14f.000000000000003b:head [set-alloc-hint object_size 524288 write_size 524288,write 34816~10240 in=10240b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.897559+0000", 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0039417779999999999, 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040734880000000001, 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35557 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.897559+0000", 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.897559+0000", 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.897560+0000", 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0559999999999999e-06 2024-09-14T08:41:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.897573+0000", 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2746e-05 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.897588+0000", 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5279000000000001e-05 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.897596+0000", 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2090000000000005e-06 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.897683+0000", 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7211000000000002e-05 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.897874+0000", 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000190781 2024-09-14T08:41:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.898107+0000", 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232864 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.899855+0000", 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017479800000000001 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.901549+0000", 2024-09-14T08:41:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001693897 2024-09-14T08:41:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:41:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 2 2024-09-14T08:41:33.908 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:33.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:33.919 INFO:teuthology.orchestra.run.smithi188.stdout:3152 write 0x3d76e00 thru 0x3d82239 (0xb43a bytes) 2024-09-14T08:41:33.957 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:33.958+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:33.976 INFO:teuthology.orchestra.run.smithi188.stdout:3155 write 0x7295600 thru 0x72990da (0x3adb bytes) 2024-09-14T08:41:33.989 INFO:teuthology.orchestra.run.smithi188.stdout:3156 trunc from 0x7299200 to 0xbd1b600 2024-09-14T08:41:34.021 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:34.022+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:34.035 INFO:teuthology.orchestra.run.smithi188.stdout:3157 write 0x1f5b800 thru 0x1f5c077 (0x878 bytes) 2024-09-14T08:41:34.038 INFO:teuthology.orchestra.run.smithi188.stdout:3159 trunc from 0xbd1b600 to 0xc724a00 2024-09-14T08:41:34.044 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:34.044 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:34.061 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:34.072 INFO:teuthology.orchestra.run.smithi188.stdout:3160 write 0x3f5f600 thru 0x3f64f93 (0x5994 bytes) 2024-09-14T08:41:34.097 INFO:teuthology.orchestra.run.smithi188.stdout:3161 trunc from 0xc724a00 to 0x1615a00 2024-09-14T08:41:34.149 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:34.150+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:34.191 INFO:teuthology.orchestra.run.smithi188.stdout:3162 trunc from 0x1615a00 to 0x42d5400 2024-09-14T08:41:34.210 INFO:teuthology.orchestra.run.smithi188.stdout:3164 punch from 0x456e00 to 0x463200, (0xc400 bytes) 2024-09-14T08:41:34.214 INFO:teuthology.orchestra.run.smithi188.stdout:3166 read 0x306ae00 thru 0x3070f5b (0x615c bytes) 2024-09-14T08:41:34.223 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:34.222+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:34.236 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:41:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 78.502905557000005, 2024-09-14T08:41:34.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:41:34.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:41:34.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.967151732000001, 2024-09-14T08:41:34.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:41:34.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.932486848, 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:34.249 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:41:34.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:34.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.253 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.932285876999998, 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:34.254 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:41:34.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0316104880000001, 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:41:34.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:41:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0315762729999998, 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.263 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.267 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0315347839999998, 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0314763019999997, 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.272 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:41:34.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:41:34.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0314466229999999, 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:41:34.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0314174139999999, 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.281 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:41:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:41:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0238111190000003, 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:41:34.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:41:34.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0237831289999999, 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.290 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:34.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:41:34.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:34.294 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0237547969999996, 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:34.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:41:34.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.298 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0237130380000004, 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:41:34.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0236841590000001, 2024-09-14T08:41:34.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:41:34.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0236503499999996, 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:41:34.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0236179910000001, 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:41:34.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0154901880000002, 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:41:34.316 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.320 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0154592029999998, 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.324 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.015430297, 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:34.325 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:41:34.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:34.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:34.329 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:34.330 INFO:teuthology.orchestra.run.smithi188.stdout:3167 write 0xc999a00 thru 0xc9a422d (0xa82e bytes) 2024-09-14T08:41:34.331 INFO:teuthology.orchestra.run.smithi188.stdout:3168 write 0xd25b200 thru 0xd26934e (0xe14f bytes) 2024-09-14T08:41:34.331 INFO:teuthology.orchestra.run.smithi188.stdout:3170 trunc from 0xd269400 to 0x8571600 2024-09-14T08:41:34.331 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:34.332 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:34.330+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:34.392 INFO:teuthology.orchestra.run.smithi188.stdout:3171 read 0x4538a00 thru 0x4544742 (0xbd43 bytes) 2024-09-14T08:41:34.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:34.407 INFO:teuthology.orchestra.run.smithi188.stdout:3177 trunc from 0x8571600 to 0x4239600 2024-09-14T08:41:34.425 INFO:teuthology.orchestra.run.smithi188.stdout:3178 punch from 0x250ae00 to 0x2519a00, (0xec00 bytes) 2024-09-14T08:41:34.426 INFO:teuthology.orchestra.run.smithi188.stdout:3180 punch from 0x3188000 to 0x318bc00, (0x3c00 bytes) 2024-09-14T08:41:34.426 INFO:teuthology.orchestra.run.smithi188.stdout:3181 read 0x2403a00 thru 0x240d86e (0x9e6f bytes) 2024-09-14T08:41:34.431 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:34.430+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:34.461 INFO:teuthology.orchestra.run.smithi188.stdout:3182 write 0xb4d3800 thru 0xb4db0f7 (0x78f8 bytes) 2024-09-14T08:41:34.463 INFO:teuthology.orchestra.run.smithi188.stdout:3187 clone 25 order 25 su 16777216 sc 4 2024-09-14T08:41:34.516 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:34.516 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:34.516 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:34.516 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:34.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:34.532 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:34.532+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:34.558 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:41:34.558 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:41:34.574 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:34.575 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:34.591 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:34.591 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:34.609 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:34.609 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:34.626 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:34.627 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:34.633 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:34.634+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:34.645 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:34.645 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:34.693 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:34.693 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:34.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:34.750 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:34.750+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:34.769 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5] out_osds: [3, 0] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:41:34.769 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:41:34.769 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [1, 2, 3, 4, 5, 0] 2024-09-14T08:41:34.770 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T08:41:34.770 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:41:34.795 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:41:34.834 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:34.834+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:34.847 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T08:41:34.847 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.0 2024-09-14T08:41:34.847 INFO:tasks.thrashosds.thrasher:remote for osd 0 is ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:41:34.847 DEBUG:teuthology.orchestra.run.smithi089:> type ceph-objectstore-tool 2024-09-14T08:41:34.851 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T08:41:34.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --op list-pgs 2024-09-14T08:41:34.880 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:34.880 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:34.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:34.939 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:34.940+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:34.953 INFO:teuthology.orchestra.run.smithi188.stdout:flattening image image_client.0-clone24 2024-09-14T08:41:35.017 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:35.017 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:35.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:35.036 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:35.034+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:35.137 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:35.134+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:35.198 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:35.199 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:35.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:35.238 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:35.238+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:35.338 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:35.338 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:35.338 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:35.338+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:35.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:35.439 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:35.438+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:35.479 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:35.479 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:35.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:35.543 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:35.544+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:35.593 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-14T08:41:35.615 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:35.615 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:35.630 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:35.641 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:35.642+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:35.742 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:35.740+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:41:35.803 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:35.803 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:35.821 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:35.843 INFO:tasks.thrashosds.thrasher:No PGs found for osd.0 2024-09-14T08:41:35.865 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:35.866+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:35.944 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:35.942+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:35.957 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:35.958 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:35.971 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:36.027 INFO:teuthology.orchestra.run.smithi188.stdout:3188 trunc from 0xb4db200 to 0x58ea200 2024-09-14T08:41:36.044 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:36.044+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:36.103 INFO:teuthology.orchestra.run.smithi188.stdout:3189 read 0x1d80400 thru 0x1d8dddf (0xd9e0 bytes) 2024-09-14T08:41:36.106 INFO:teuthology.orchestra.run.smithi188.stdout:3190 punch from 0x13f6400 to 0x13fd400, (0x7000 bytes) 2024-09-14T08:41:36.106 INFO:teuthology.orchestra.run.smithi188.stdout:3191 punch from 0x53c200 to 0x547400, (0xb200 bytes) 2024-09-14T08:41:36.113 INFO:teuthology.orchestra.run.smithi188.stdout:3194 write 0xb81c00 thru 0xb8d716 (0xbb17 bytes) 2024-09-14T08:41:36.118 INFO:teuthology.orchestra.run.smithi188.stdout:3195 write 0x3fbb200 thru 0x3fc442f (0x9230 bytes) 2024-09-14T08:41:36.145 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:36.142+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:36.145 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:36.145 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:36.159 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:36.246 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:36.246+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:36.257 INFO:teuthology.orchestra.run.smithi188.stdout:3196 write 0xb916200 thru 0xb921385 (0xb186 bytes) 2024-09-14T08:41:36.259 INFO:teuthology.orchestra.run.smithi188.stdout:3197 write 0x2cc2e00 thru 0x2cc76bd (0x48be bytes) 2024-09-14T08:41:36.259 INFO:teuthology.orchestra.run.smithi188.stdout:3198 read 0x3eb7400 thru 0x3ebf2d8 (0x7ed9 bytes) 2024-09-14T08:41:36.262 INFO:teuthology.orchestra.run.smithi188.stdout:3199 write 0x4d30600 thru 0x4d3caca (0xc4cb bytes) 2024-09-14T08:41:36.263 INFO:teuthology.orchestra.run.smithi188.stdout:3201 read 0x3c63c00 thru 0x3c66547 (0x2948 bytes) 2024-09-14T08:41:36.307 INFO:teuthology.orchestra.run.smithi188.stdout:3207 write 0xc56a200 thru 0xc57422f (0xa030 bytes) 2024-09-14T08:41:36.310 INFO:teuthology.orchestra.run.smithi188.stdout:3209 clone 26 order 18 su 2048 sc 9 2024-09-14T08:41:36.330 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:36.330 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:36.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:36.347 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:36.348+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:36.448 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:36.448+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:36.511 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:36.511 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:36.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:36.549 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:36.548+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:36.650 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:36.663 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:36.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:36.665 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:36.648+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:36.665 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:36.751 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:36.750+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:36.789 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:36.789 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:36.804 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:36.805 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:36.825 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:36.843 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:36.843 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:36.851 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:36.852+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:36.861 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:36.861 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:36.880 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:36.899 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:36.899 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:36.903 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:36.903 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:36.927 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone25 from 0xc574400 (overlap 0x58ea200) to 0x3559400 2024-09-14T08:41:36.952 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:36.952+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:36.974 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:36.974 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:36.974 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:36.974 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:36.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:37.053 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:37.054+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:37.125 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:37.125 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:37.125 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:37.125 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:37.125 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:37.139 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:37.181 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:37.182+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:37.255 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:37.256+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:37.302 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54091 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5666816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.225072664999999, 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097603048999999997, 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:37.303 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54091 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078807+0000", 2024-09-14T08:41:37.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078808+0000", 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0759999999999999e-06 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078814+0000", 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4230000000000002e-06 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078835+0000", 2024-09-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0525000000000001e-05 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078858+0000", 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3064000000000001e-05 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.175799+0000", 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096940984999999993 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176027+0000", 2024-09-14T08:41:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022775599999999999 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176410+0000", 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038321999999999998 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54092 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5755904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.224998968999998, 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098027422000000003, 2024-09-14T08:41:37.307 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54092 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078880+0000", 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078882+0000", 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.33e-06 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078888+0000", 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9719999999999997e-06 2024-09-14T08:41:37.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078905+0000", 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7668000000000001e-05 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078935+0000", 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9464000000000001e-05 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176514+0000", 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097579691999999996 2024-09-14T08:41:37.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176664+0000", 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149705 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.176908+0000", 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024359100000000001 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.311 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.224923497000006, 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.224866293000005, 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.316 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:41:37.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:41:37.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.320 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.321 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:37.321 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:37.321 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.224807408999993, 2024-09-14T08:41:37.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:41:37.321 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.321 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.321 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:37.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.322 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:41:37.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.322 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:37.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:41:37.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.224742483, 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.326 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:37.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:41:37.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:41:37.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.224681032000007, 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:41:37.330 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:41:37.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.334 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.224621498000005, 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:41:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:41:37.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.224562187999993, 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.339 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:41:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.224490156000002, 2024-09-14T08:41:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:41:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:41:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24684 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3098624~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.070011883999996, 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097544953000000004, 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24684 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233867+0000", 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233868+0000", 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2399999999999996e-07 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233871+0000", 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8459999999999999e-06 2024-09-14T08:41:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233880+0000", 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1290000000000002e-06 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233888+0000", 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1470000000000004e-06 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.330937+0000", 2024-09-14T08:41:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097049830000000004 2024-09-14T08:41:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331137+0000", 2024-09-14T08:41:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019942700000000001 2024-09-14T08:41:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331412+0000", 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027565000000000001 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24685 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3109888~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.069946181000006, 2024-09-14T08:41:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098003810999999996, 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24685 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233933+0000", 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233934+0000", 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0470000000000001e-06 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233938+0000", 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3160000000000001e-06 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233948+0000", 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0807e-05 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.233956+0000", 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6990000000000003e-06 2024-09-14T08:41:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331476+0000", 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097519736999999995 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331651+0000", 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175697 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.331937+0000", 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028550800000000002 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24686 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3121152~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.069824010000005, 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098429939999999994, 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24686 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234055+0000", 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234056+0000", 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.043e-06 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234060+0000", 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.777e-06 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234071+0000", 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0745e-05 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234078+0000", 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000001e-06 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332000+0000", 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097921706999999997 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332189+0000", 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000188655 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332485+0000", 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029641299999999998 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.069789779000004, 2024-09-14T08:41:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:41:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:41:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:41:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:41:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:41:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:41:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.069758354000001, 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:41:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.705894734000001, 2024-09-14T08:41:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:41:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:41:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:41:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:41:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:41:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:41:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:41:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:41:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:41:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:41:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:41:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:41:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:41:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:41:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:41:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:41:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:41:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:41:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.705835384, 2024-09-14T08:41:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:41:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:41:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.705795431999999, 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:41:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:41:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:41:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:41:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.2223724789999997, 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:41:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:41:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.215979913, 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:41:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:41:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:41:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:41:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:41:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:37.414 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:37.415 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:37.418+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:37.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-14T08:41:37.516 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:37.514+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:37.554 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:37.554 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:37.554 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:37.554 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:37.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:37.617 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:37.616+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:37.704 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:37.704 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:37.704 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:37.704 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:37.704 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:37.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:37.719 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:37.718+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:37.818 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:37.818+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:37.821 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:41:37.900 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:37.900 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 100.975533043, 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.901 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:37.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:41:37.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:41:37.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 100.97547826500001, 2024-09-14T08:41:37.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:41:37.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 87.547707806000005, 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.910 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:41:37.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:41:37.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.914 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 64.555103739000003, 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:37.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:37.916 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:41:37.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.916 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:37.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:41:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:41:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 64.554265368000003, 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.5357572670000001, 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.5354430580000002, 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.5338067320000004, 2024-09-14T08:41:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:41:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:41:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.533588773, 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.5332933710000001, 2024-09-14T08:41:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.5330225359999998, 2024-09-14T08:41:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:41:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:41:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3218318550000001, 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:41:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3218118209999998, 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:41:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:41:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3217907430000002, 2024-09-14T08:41:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3217711489999999, 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:41:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3217509950000004, 2024-09-14T08:41:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:41:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3217315989999996, 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:41:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3152017990000004, 2024-09-14T08:41:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:41:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.315181913, 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:41:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:41:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3151625390000001, 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:41:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:37.995 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:37.996 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:37.997 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:37.996+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:38.097 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:38.098+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:38.177 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:38.177 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:38.177 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:38.177 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:38.193 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:38.198 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:38.198+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:38.299 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:38.296+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:38.324 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:38.324 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:38.324 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:38.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:38.427 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:38.428+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:38.501 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:38.498+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:38.519 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.215541677000004, 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.953431498, 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.953284326999999, 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.953142526999997, 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:662 3.5 3:a1d4b776:::rbd_data.10f12f878d5b.0000000000000009:1a [read 2322432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.421417064, 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074230409999999997, 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 662 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099683+0000", 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099686+0000", 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0900000000000001e-06 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099695+0000", 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9730000000000003e-06 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099701+0000", 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173763+0000", 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074061622999999993 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173817+0000", 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4020000000000001e-05 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173912+0000", 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5290000000000004e-05 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:663 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.421388521000001, 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074329749000000001, 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 663 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099711+0000", 2024-09-14T08:41:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.37e-07 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099723+0000", 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1566000000000001e-05 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099731+0000", 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7129999999999994e-06 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099738+0000", 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9829999999999999e-06 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173997+0000", 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074258324000000001 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174040+0000", 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3526000000000003e-05 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:664 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.421351198, 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074317628999999996, 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 664 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:41:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099751+0000", 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7669999999999999e-06 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099761+0000", 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9029999999999999e-06 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099768+0000", 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9129999999999997e-06 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174059+0000", 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074290615000000004 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174065+0000", 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7379999999999997e-06 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:665 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.421321925999999, 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074368651999999993, 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 665 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099778+0000", 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099780+0000", 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7590000000000002e-06 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099789+0000", 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2940000000000006e-06 2024-09-14T08:41:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099795+0000", 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6359999999999997e-06 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174121+0000", 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074325712000000002 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174146+0000", 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4576999999999999e-05 2024-09-14T08:41:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:666 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.421294733, 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074362869999999998, 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 666 2024-09-14T08:41:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099805+0000", 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6400000000000002e-07 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099808+0000", 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.943e-06 2024-09-14T08:41:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099816+0000", 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1999999999999994e-06 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099823+0000", 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9959999999999996e-06 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174161+0000", 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074338038999999995 2024-09-14T08:41:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174167+0000", 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0279999999999997e-06 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:667 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.421266899999999, 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074416247000000005, 2024-09-14T08:41:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 667 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099833+0000", 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3600000000000003e-07 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099835+0000", 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:41:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099844+0000", 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3999999999999992e-06 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099850+0000", 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7569999999999998e-06 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174224+0000", 2024-09-14T08:41:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074373854000000003 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174248+0000", 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3903000000000001e-05 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:668 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.421239247000001, 2024-09-14T08:41:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074410031000000001, 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 668 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5600000000000005e-07 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099863+0000", 2024-09-14T08:41:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.774e-06 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099872+0000", 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5420000000000005e-06 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099879+0000", 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.007e-06 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174264+0000", 2024-09-14T08:41:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074385234999999994 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174270+0000", 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8170000000000004e-06 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:669 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.421209288, 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074470898999999993, 2024-09-14T08:41:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 669 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099891+0000", 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4270000000000001e-06 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099896+0000", 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9699999999999998e-06 2024-09-14T08:41:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099911+0000", 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4518999999999999e-05 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099922+0000", 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1516e-05 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174321+0000", 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074399274000000001 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174361+0000", 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9193000000000002e-05 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:670 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.421128106999999, 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074410134000000003, 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 670 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099972+0000", 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.11e-06 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099977+0000", 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2569999999999998e-06 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099994+0000", 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7050000000000001e-05 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100008+0000", 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3298999999999999e-05 2024-09-14T08:41:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174375+0000", 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074367528000000002 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174381+0000", 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:671 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.421070184, 2024-09-14T08:41:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074430406000000005, 2024-09-14T08:41:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 671 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100030+0000", 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1659999999999999e-06 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100035+0000", 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8770000000000001e-06 2024-09-14T08:41:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100067+0000", 2024-09-14T08:41:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2091999999999997e-05 2024-09-14T08:41:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100092+0000", 2024-09-14T08:41:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5337000000000002e-05 2024-09-14T08:41:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174436+0000", 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074343321000000004 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174459+0000", 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3612999999999999e-05 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:672 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.420987119999999, 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074365733000000003, 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 672 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100113+0000", 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.164e-06 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100118+0000", 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4500000000000003e-06 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100139+0000", 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0539000000000001e-05 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100152+0000", 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.308e-05 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174472+0000", 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074319978999999994 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174478+0000", 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5210000000000002e-06 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:673 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.420912225, 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074369967999999995, 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 673 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100188+0000", 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.24e-06 2024-09-14T08:41:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100193+0000", 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.95e-06 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100224+0000", 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0769999999999998e-05 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100250+0000", 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6279e-05 2024-09-14T08:41:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174533+0000", 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074282772999999996 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174557+0000", 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3955999999999999e-05 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:674 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.420829436, 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074305948999999996, 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 674 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100271+0000", 2024-09-14T08:41:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2100000000000001e-06 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100276+0000", 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4659999999999998e-06 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100294+0000", 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7425999999999999e-05 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100307+0000", 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.325e-05 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174570+0000", 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074263037000000004 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174575+0000", 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5600000000000001e-06 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:675 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.420774921, 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074329609000000005, 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 675 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100325+0000", 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.043e-06 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100367+0000", 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1820000000000003e-05 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100388+0000", 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0951999999999999e-05 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100461+0000", 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3641999999999997e-05 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174631+0000", 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074169152000000002 2024-09-14T08:41:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174654+0000", 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3e-05 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:676 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.420614468, 2024-09-14T08:41:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074190246000000001, 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 676 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100486+0000", 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3599999999999999e-06 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100493+0000", 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8369999999999999e-06 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100510+0000", 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7473e-05 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100525+0000", 2024-09-14T08:41:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4963000000000001e-05 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174669+0000", 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074144134 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174675+0000", 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4790000000000004e-06 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:677 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.420527823, 2024-09-14T08:41:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074180142000000004, 2024-09-14T08:41:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 677 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100572+0000", 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.167e-06 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100578+0000", 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100596+0000", 2024-09-14T08:41:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7903000000000001e-05 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100609+0000", 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3576e-05 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174727+0000", 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074118013999999996 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:38.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174751+0000", 2024-09-14T08:41:38.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3866000000000002e-05 2024-09-14T08:41:38.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.610 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:38.610 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:38.610 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:38.611 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:38.612 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:38.610+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:38.712 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:38.710+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:38.738 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:38.738 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:38.738 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:38.738 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:38.752 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:38.819 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:41:38.837 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:38.838+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:38.904 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:38.914 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:38.914 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:38.915 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:38.914+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:38.928 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:38.985 INFO:teuthology.orchestra.run.smithi188.stdout:3210 read 0xadb9200 thru 0xadba74b (0x154c bytes) 2024-09-14T08:41:39.010 INFO:teuthology.orchestra.run.smithi188.stdout:3214 write 0xcc34a00 thru 0xcc360ef (0x16f0 bytes) 2024-09-14T08:41:39.011 INFO:teuthology.orchestra.run.smithi188.stdout:3215 write 0x6280e00 thru 0x6287496 (0x6697 bytes) 2024-09-14T08:41:39.015 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:39.016+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:39.049 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:39.068 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:39.068 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:39.086 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:39.086 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:39.101 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:39.101 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.854876582, 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.102 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:41:39.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.854814569, 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:41:39.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:41:39.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.854748239, 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:41:39.111 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:41:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.854692779, 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.116 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:41:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.120 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.854633159, 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:41:39.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:39.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:41:39.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:41:39.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:41:39.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:39.125 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85455161900001, 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.130 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85449529100001, 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:41:39.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:41:39.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:41:39.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85442379600001, 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:41:39.135 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:41:39.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:41:39.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85435092500001, 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:41:39.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85430871299999, 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:41:39.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.149 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85427888300001, 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:41:39.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:41:39.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:39.154 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85425058600001, 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:39.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:39.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:41:39.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:41:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85420949100001, 2024-09-14T08:41:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.854180461, 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:41:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:41:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.854151977, 2024-09-14T08:41:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:41:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:41:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:41:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.854123837, 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:41:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.854095141, 2024-09-14T08:41:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:41:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:41:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:41:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:41:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85406638400001, 2024-09-14T08:41:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:41:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:41:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85403833700001, 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:41:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:41:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:41:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 100.85400835999999, 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:41:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:41:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:41:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:41:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:41:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:41:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:41:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:41:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:41:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:41:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:39.202 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:39.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:39.204 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:39.205 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:39.205 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:39.206 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:39.207 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:39.208 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:39.209 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:39.209 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:39.204+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:39.212 INFO:teuthology.orchestra.run.smithi188.stdout:3216 write 0xcf7e000 thru 0xcf8df95 (0xff96 bytes) 2024-09-14T08:41:39.212 INFO:teuthology.orchestra.run.smithi188.stdout:3219 read 0x7c0b600 thru 0x7c17c42 (0xc643 bytes) 2024-09-14T08:41:39.222 INFO:teuthology.orchestra.run.smithi188.stdout:3221 write 0x3b4a600 thru 0x3b4c00c (0x1a0d bytes) 2024-09-14T08:41:39.226 INFO:teuthology.orchestra.run.smithi188.stdout:3222 write 0xb417e00 thru 0xb423474 (0xb675 bytes) 2024-09-14T08:41:39.228 INFO:teuthology.orchestra.run.smithi188.stdout:3223 write 0x33e4800 thru 0x33e8f7a (0x477b bytes) 2024-09-14T08:41:39.228 INFO:teuthology.orchestra.run.smithi188.stdout:3224 read 0x74c9600 thru 0x74ca2f0 (0xcf1 bytes) 2024-09-14T08:41:39.231 INFO:teuthology.orchestra.run.smithi188.stdout:3226 write 0x4c50000 thru 0x4c5fdec (0xfded bytes) 2024-09-14T08:41:39.232 INFO:teuthology.orchestra.run.smithi188.stdout:3232 write 0x3c64200 thru 0x3c734e2 (0xf2e3 bytes) 2024-09-14T08:41:39.235 INFO:teuthology.orchestra.run.smithi188.stdout:3233 read 0xb610000 thru 0xb6172c4 (0x72c5 bytes) 2024-09-14T08:41:39.242 INFO:teuthology.orchestra.run.smithi188.stdout:3234 write 0x8a35000 thru 0x8a385a8 (0x35a9 bytes) 2024-09-14T08:41:39.243 INFO:teuthology.orchestra.run.smithi188.stdout:3235 punch from 0x1431000 to 0x143f600, (0xe600 bytes) 2024-09-14T08:41:39.304 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:39.302+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:39.352 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:39.353 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:39.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:39.409 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:39.409+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:39.506 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:39.505+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:39.556 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:39.556 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:39.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:39.617 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:39.617+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:39.708 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:39.708+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:39.767 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:39.767 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:39.782 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:39.808 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:39.808+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:39.909 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:39.908+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:39.943 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:39.943 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:39.962 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:40.010 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:40.009+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:40.111 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:40.111 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:40.111 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:40.109+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:40.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:40.181 INFO:teuthology.orchestra.run.smithi188.stdout:3237 write 0x4a28000 thru 0x4a2a83c (0x283d bytes) 2024-09-14T08:41:40.212 INFO:teuthology.orchestra.run.smithi188.stdout:3239 punch from 0x7612400 to 0x761fe00, (0xda00 bytes) 2024-09-14T08:41:40.213 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:40.213+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:40.313 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:40.312+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:40.335 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:40.335 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:40.349 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:40.409 INFO:teuthology.orchestra.run.smithi188.stdout:3242 write 0xb318a00 thru 0xb3208a6 (0x7ea7 bytes) 2024-09-14T08:41:40.414 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:40.412+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:40.493 INFO:teuthology.orchestra.run.smithi188.stdout:3243 read 0xb999a00 thru 0xb99cce7 (0x32e8 bytes) 2024-09-14T08:41:40.515 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:40.513+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:40.521 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:40.521 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:40.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout:3244 trunc from 0xcf8e000 to 0x5f88a00 2024-09-14T08:41:40.616 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:40.613+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:40.700 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:40.700 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:40.714 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:40.716 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:40.713+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:40.816 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:40.816+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:40.838 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:40.839 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:40.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:41:40.843 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5] out_osds: [3, 0] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:41:40.843 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:41:40.843 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T08:41:40.843 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.273468 2024-09-14T08:41:40.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0.273467551432822 2024-09-14T08:41:40.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:40.917 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:40.913+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:41.018 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:41.016+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:41.044 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:41.045 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:41.064 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:41.119 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:41.117+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:41.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:41.230 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:41.230 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:41.231 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:41.228+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:41.244 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:41.335 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:41.336+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:41.344 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:41.370 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:41.371 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:41.394 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:41.419 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:41.420 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:41.422 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:41.420+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:41.447 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:41.447 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:41.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:41.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:41.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.447 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:41.447 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:41.447 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.142501096000004, 2024-09-14T08:41:41.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:41.447 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:41.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:41.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:41.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:41.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:41.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:41.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:41.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:41.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:41.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:41.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:41.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:41.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:41.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:41.454 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.454 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.454 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 58.880390917, 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.455 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:41.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:41.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 58.880243745999998, 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:41.460 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:41.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:41.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:41.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:41.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:41.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 58.880101946000003, 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.466 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:41.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:662 3.5 3:a1d4b776:::rbd_data.10f12f878d5b.0000000000000009:1a [read 2322432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.348376482999999, 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074230409999999997, 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.471 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 662 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099682+0000", 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099683+0000", 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099686+0000", 2024-09-14T08:41:41.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0900000000000001e-06 2024-09-14T08:41:41.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099695+0000", 2024-09-14T08:41:41.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9730000000000003e-06 2024-09-14T08:41:41.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099701+0000", 2024-09-14T08:41:41.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7070000000000003e-06 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173763+0000", 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074061622999999993 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173817+0000", 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4020000000000001e-05 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173912+0000", 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5290000000000004e-05 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:663 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.34834794, 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074329749000000001, 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.476 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.477 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.477 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.477 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.477 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 663 2024-09-14T08:41:41.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.477 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:41.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099710+0000", 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099711+0000", 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.37e-07 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099723+0000", 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1566000000000001e-05 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099731+0000", 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7129999999999994e-06 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099738+0000", 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9829999999999999e-06 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.173997+0000", 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074258324000000001 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174040+0000", 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3526000000000003e-05 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:664 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.348310616999999, 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074317628999999996, 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 664 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099748+0000", 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9299999999999997e-07 2024-09-14T08:41:41.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099751+0000", 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7669999999999999e-06 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099761+0000", 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9029999999999999e-06 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099768+0000", 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9129999999999997e-06 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174059+0000", 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074290615000000004 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174065+0000", 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7379999999999997e-06 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:665 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.348281345, 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074368651999999993, 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.485 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 665 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099777+0000", 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099778+0000", 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099780+0000", 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7590000000000002e-06 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099789+0000", 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2940000000000006e-06 2024-09-14T08:41:41.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099795+0000", 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6359999999999997e-06 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174121+0000", 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074325712000000002 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174146+0000", 2024-09-14T08:41:41.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4576999999999999e-05 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:666 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.348254151999999, 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074362869999999998, 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.489 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 666 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099804+0000", 2024-09-14T08:41:41.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099805+0000", 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6400000000000002e-07 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099808+0000", 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.943e-06 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099816+0000", 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1999999999999994e-06 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099823+0000", 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9959999999999996e-06 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174161+0000", 2024-09-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074338038999999995 2024-09-14T08:41:41.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174167+0000", 2024-09-14T08:41:41.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0279999999999997e-06 2024-09-14T08:41:41.493 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.493 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.493 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:667 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.348226318999998, 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074416247000000005, 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.494 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 667 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099832+0000", 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099833+0000", 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3600000000000003e-07 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099835+0000", 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099844+0000", 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3999999999999992e-06 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099850+0000", 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7569999999999998e-06 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174224+0000", 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074373854000000003 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174248+0000", 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3903000000000001e-05 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:668 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.348198665999998, 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074410031000000001, 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.498 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 668 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099860+0000", 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5600000000000005e-07 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099863+0000", 2024-09-14T08:41:41.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.774e-06 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099872+0000", 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5420000000000005e-06 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099879+0000", 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.007e-06 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174264+0000", 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074385234999999994 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174270+0000", 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8170000000000004e-06 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.502 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:669 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.348168706999999, 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074470898999999993, 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 669 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099890+0000", 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099891+0000", 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4270000000000001e-06 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099896+0000", 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9699999999999998e-06 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099911+0000", 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4518999999999999e-05 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099922+0000", 2024-09-14T08:41:41.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1516e-05 2024-09-14T08:41:41.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174321+0000", 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074399274000000001 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174361+0000", 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9193000000000002e-05 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:670 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.509 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.348087526, 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074410134000000003, 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 670 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099971+0000", 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099972+0000", 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.11e-06 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099977+0000", 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2569999999999998e-06 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.099994+0000", 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7050000000000001e-05 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100008+0000", 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3298999999999999e-05 2024-09-14T08:41:41.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174375+0000", 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074367528000000002 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174381+0000", 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.513 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:671 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.348029603000001, 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074430406000000005, 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 671 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100029+0000", 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100030+0000", 2024-09-14T08:41:41.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1659999999999999e-06 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100035+0000", 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8770000000000001e-06 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100067+0000", 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2091999999999997e-05 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100092+0000", 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5337000000000002e-05 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174436+0000", 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074343321000000004 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174459+0000", 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3612999999999999e-05 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:672 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.347946538999999, 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074365733000000003, 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 672 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100112+0000", 2024-09-14T08:41:41.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100113+0000", 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.164e-06 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100118+0000", 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4500000000000003e-06 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100139+0000", 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0539000000000001e-05 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100152+0000", 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.308e-05 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174472+0000", 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074319978999999994 2024-09-14T08:41:41.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174478+0000", 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5210000000000002e-06 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:673 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.347871644000001, 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074369967999999995, 2024-09-14T08:41:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 673 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100187+0000", 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100188+0000", 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.24e-06 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100193+0000", 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.95e-06 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100224+0000", 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0769999999999998e-05 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100250+0000", 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6279e-05 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174533+0000", 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074282772999999996 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174557+0000", 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3955999999999999e-05 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:674 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.526 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.347788855000001, 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074305948999999996, 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 674 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100269+0000", 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100271+0000", 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2100000000000001e-06 2024-09-14T08:41:41.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100276+0000", 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4659999999999998e-06 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100294+0000", 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7425999999999999e-05 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100307+0000", 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.325e-05 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174570+0000", 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074263037000000004 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174575+0000", 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5600000000000001e-06 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.530 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:675 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.347734339999999, 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074329609000000005, 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 675 2024-09-14T08:41:41.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100324+0000", 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100325+0000", 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.043e-06 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100367+0000", 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1820000000000003e-05 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100388+0000", 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0951999999999999e-05 2024-09-14T08:41:41.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100461+0000", 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3641999999999997e-05 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174631+0000", 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074169152000000002 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174654+0000", 2024-09-14T08:41:41.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3e-05 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:676 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.347573886999999, 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074190246000000001, 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.535 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 676 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100484+0000", 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100486+0000", 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3599999999999999e-06 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100493+0000", 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8369999999999999e-06 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100510+0000", 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7473e-05 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100525+0000", 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4963000000000001e-05 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174669+0000", 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074144134 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174675+0000", 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4790000000000004e-06 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:677 3.5 3.6eed2b85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e106)", 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.347487242, 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074180142000000004, 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 677 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100571+0000", 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100572+0000", 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.167e-06 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100578+0000", 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:41:41.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100596+0000", 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7903000000000001e-05 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.100609+0000", 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3576e-05 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174727+0000", 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074118013999999996 2024-09-14T08:41:41.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:41.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:41.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:41.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:24.174751+0000", 2024-09-14T08:41:41.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3866000000000002e-05 2024-09-14T08:41:41.543 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.543 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.543 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.543 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:41.543 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:41.543 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:41.544 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:41.545 INFO:teuthology.orchestra.run.smithi188.stdout:3245 trunc from 0x5f88a00 to 0xb500200 2024-09-14T08:41:41.545 INFO:teuthology.orchestra.run.smithi188.stdout:3246 read 0x3207200 thru 0x3210924 (0x9725 bytes) 2024-09-14T08:41:41.545 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:41.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:41.546 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:41.547 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:41.547 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:41.547 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:41.548 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:41.544+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:41.553 INFO:teuthology.orchestra.run.smithi188.stdout:3247 read 0x7ae6800 thru 0x7aef06d (0x886e bytes) 2024-09-14T08:41:41.554 INFO:teuthology.orchestra.run.smithi188.stdout:3249 read 0xa044c00 thru 0xa049d82 (0x5183 bytes) 2024-09-14T08:41:41.554 INFO:teuthology.orchestra.run.smithi188.stdout:3250 read 0x586b400 thru 0x586b4db (0xdc bytes) 2024-09-14T08:41:41.555 INFO:teuthology.orchestra.run.smithi188.stdout:3252 write 0x7b08800 thru 0x7b13e2f (0xb630 bytes) 2024-09-14T08:41:41.608 INFO:teuthology.orchestra.run.smithi188.stdout:3253 trunc from 0xb500200 to 0x322e800 2024-09-14T08:41:41.646 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:41.645+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:41.700 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:41.700 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:41.716 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:41.761 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:41.761+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:41.831 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:41:41.833 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.5 primary-affinity to 0.273468 (8179212) 2024-09-14T08:41:41.848 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:41.848+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:41.904 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:41.904 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:41.904 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:41.905 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:41.905 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:41.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:41.969 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:41.969+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:42.042 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.79432117, 2024-09-14T08:41:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:41:42.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.046 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.794259157, 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.047 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:41:42.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:41:42.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.794192827, 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.051 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:42.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:41:42.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.055 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.794137367, 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:41:42.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.794077747, 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.060 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:42.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:41:42.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.79399620700001, 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:41:42.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.79393987900001, 2024-09-14T08:41:42.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:42.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.79386838400001, 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:42.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:41:42.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.79379551300001, 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:42.083 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.793753301, 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:42.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:41:42.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.79372347100001, 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.088 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:41:42.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.79369517400001, 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.093 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:41:42.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.79365407900001, 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:41:42.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:41:42.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.793625049, 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.102 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:41:42.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:41:42.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.793596565, 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:42.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:42.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:41:42.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:41:42.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:41:42.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:42.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.793568425, 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:41:42.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.118 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.793539729, 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.79351097200001, 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.123 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:41:42.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.79348292500001, 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:41:42.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:42.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 103.793452948, 2024-09-14T08:41:42.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:42.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:41:42.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:41:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:41:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.137 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:42.139 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:42.139 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:42.137+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:42.239 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:42.240+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:42.311 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:42.311 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:42.325 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:42.369 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:42.369+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:42.442 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:42.441+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:42.447 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:42.447 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:42.447 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:42.447 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:42.447 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:42.461 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:42.543 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:42.544+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:42.638 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:42.638 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:42.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:42.638 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:42.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.638 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:41:42.638 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:42.638 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.904549774000003, 2024-09-14T08:41:42.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:41:42.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:41:42.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.368795948999999, 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.645 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:42.650 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.334131065000001, 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:41:42.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:41:42.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:42.655 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.333930093999999, 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:41:42.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.660 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.433254705, 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:42.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.43322049, 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.665 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:41:42.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.433179000999999, 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.670 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:41:42.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:41:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:41:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:41:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.433120518999999, 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:41:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:41:42.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.43309084, 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:41:42.679 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:41:42.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.433061630999999, 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:41:42.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.688 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.425455336000001, 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:41:42.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:41:42.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.425427345999999, 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:42.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.697 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.698 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.698 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.425399014, 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:41:42.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:41:42.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.425357255, 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:41:42.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:41:42.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:42.707 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.425328376, 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:41:42.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:41:42.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.425294567, 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:41:42.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.716 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.425262207999999, 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:41:42.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:41:42.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:41:42.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:41:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.417134405000001, 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.41710342, 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.725 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:41:42.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.417074513999999, 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:41:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:42.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:42.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:42.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:41:42.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:41:42.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.734 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:42.734 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:42.734 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:42.736 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:42.736 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:42.736+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:42.837 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:42.836+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:42.871 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:42.871 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:42.871 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:42.871 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:42.886 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:42.886 INFO:teuthology.orchestra.run.smithi188.stdout:3256 punch from 0x2340c00 to 0x234dc00, (0xd000 bytes) 2024-09-14T08:41:42.938 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:42.936+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:42.985 INFO:teuthology.orchestra.run.smithi188.stdout:3257 trunc from 0x322e800 to 0xeb3e800 2024-09-14T08:41:43.009 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:43.009 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:43.009 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:43.009 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:43.009 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:43.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:43.069 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:43.069+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:43.140 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:43.140+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:43.151 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:43.151 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 102.071394179, 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:41:43.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:41:43.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 102.07133697499999, 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.156 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:43.160 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 102.071278091, 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:43.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 102.071213165, 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.165 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:41:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:41:43.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:41:43.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 102.071151714, 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 102.07109217999999, 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:41:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:41:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:41:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.177 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 102.07103287, 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:41:43.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 102.070960838, 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.182 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:41:43.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.916260460999993, 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:43.187 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:41:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:41:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:41:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:41:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.191 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.916229036000004, 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:41:43.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.552365416000001, 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:41:43.197 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:41:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:41:43.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:41:43.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.552306066, 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.203 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:41:43.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:41:43.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:43.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.552266113999998, 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.210 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:41:43.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:41:43.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:41:43.216 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.068843161, 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:41:43.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:41:43.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.062450595, 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:43.223 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:41:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.229 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.3028611749999999, 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:43.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:43.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.236 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.2621217730000001, 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:41:43.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:41:43.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.99455068899999999, 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:41:43.243 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:41:43.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:41:43.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:41:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.93074679500000002, 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.250 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:41:43.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:41:43.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:41:43.256 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.90327509699999997, 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:43.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:41:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:41:43.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:43.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:43.263 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:43.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:43.265 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:43.264+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:43.334 INFO:teuthology.orchestra.run.smithi188.stdout:3260 read 0xd6d600 thru 0xd79f3d (0xc93e bytes) 2024-09-14T08:41:43.348 INFO:teuthology.orchestra.run.smithi188.stdout:3261 read 0xeab0a00 thru 0xeab0bd9 (0x1da bytes) 2024-09-14T08:41:43.348 INFO:teuthology.orchestra.run.smithi188.stdout:3262 punch from 0x7bae000 to 0x7bb3000, (0x5000 bytes) 2024-09-14T08:41:43.357 INFO:teuthology.orchestra.run.smithi188.stdout:3263 trunc from 0xeb3e800 to 0xbb90a00 2024-09-14T08:41:43.365 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:43.364+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:43.402 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:43.402 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:43.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:43.426 INFO:teuthology.orchestra.run.smithi188.stdout:3264 read 0x678c200 thru 0x679598e (0x978f bytes) 2024-09-14T08:41:43.428 INFO:teuthology.orchestra.run.smithi188.stdout:3266 punch from 0xa907000 to 0xa910800, (0x9800 bytes) 2024-09-14T08:41:43.428 INFO:teuthology.orchestra.run.smithi188.stdout:3267 read 0x4ee8400 thru 0x4ee8a9a (0x69b bytes) 2024-09-14T08:41:43.466 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:43.465+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:43.485 INFO:teuthology.orchestra.run.smithi188.stdout:3268 write 0xcb2a400 thru 0xcb38b36 (0xe737 bytes) 2024-09-14T08:41:43.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:43.563 INFO:teuthology.orchestra.run.smithi188.stdout:3269 write 0xe24e000 thru 0xe251046 (0x3047 bytes) 2024-09-14T08:41:43.565 INFO:teuthology.orchestra.run.smithi188.stdout:3271 write 0x5c02200 thru 0x5c0225c (0x5d bytes) 2024-09-14T08:41:43.566 INFO:teuthology.orchestra.run.smithi188.stdout:3273 read 0x56400 thru 0x58231 (0x1e32 bytes) 2024-09-14T08:41:43.566 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:43.565+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:43.574 INFO:teuthology.orchestra.run.smithi188.stdout:3274 read 0x4de3e00 thru 0x4df2846 (0xea47 bytes) 2024-09-14T08:41:43.575 INFO:teuthology.orchestra.run.smithi188.stdout:3276 punch from 0xcc47e00 to 0xcc52800, (0xaa00 bytes) 2024-09-14T08:41:43.577 INFO:teuthology.orchestra.run.smithi188.stdout:3279 write 0x263200 thru 0x26a7e8 (0x75e9 bytes) 2024-09-14T08:41:43.595 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:43.595 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:43.595 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:43.595 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:43.595 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:43.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:43.619 INFO:teuthology.orchestra.run.smithi188.stdout:3284 trunc from 0xe251200 to 0x7b0da00 2024-09-14T08:41:43.680 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:43.680 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:43.680+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:43.698 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:43.698 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:43.715 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:43.738 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:43.738 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:43.758 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:43.758 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:43.767 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:43.768+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:43.774 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:43.774 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:43.779 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:43.779 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:43.783 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:43.783 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:43.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:43.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:41:43.868 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:43.865+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:43.949 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:43.949 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:43.964 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:43.969 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:43.969+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:44.070 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:44.068+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:44.093 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:44.093 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:44.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:44.195 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:44.196+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:44.269 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:44.269 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:44.271 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:44.272+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:44.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:44.373 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:44.372+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:44.439 INFO:teuthology.orchestra.run.smithi188.stdout:3285 trunc from 0x7b0da00 to 0x7790400 2024-09-14T08:41:44.440 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:44.440 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:44.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:44.490 INFO:teuthology.orchestra.run.smithi188.stdout:3286 write 0x31f0c00 thru 0x31fd1de (0xc5df bytes) 2024-09-14T08:41:44.493 INFO:teuthology.orchestra.run.smithi188.stdout:3288 punch from 0x64edc00 to 0x64f4200, (0x6600 bytes) 2024-09-14T08:41:44.495 INFO:teuthology.orchestra.run.smithi188.stdout:3289 write 0x34e5400 thru 0x34f3e5e (0xea5f bytes) 2024-09-14T08:41:44.495 INFO:teuthology.orchestra.run.smithi188.stdout:3290 punch from 0x5b08800 to 0x5b09800, (0x1000 bytes) 2024-09-14T08:41:44.505 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:44.505+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:44.505 INFO:teuthology.orchestra.run.smithi188.stdout:3291 trunc from 0x7790400 to 0x3496400 2024-09-14T08:41:44.575 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:44.573+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:44.599 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:44.599 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:44.615 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:44.701 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:44.701+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:44.772 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:44.772 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:44.776 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:44.773+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:44.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:44.826 INFO:teuthology.orchestra.run.smithi188.stdout:3294 write 0xc33c000 thru 0xc34a69d (0xe69e bytes) 2024-09-14T08:41:44.828 INFO:teuthology.orchestra.run.smithi188.stdout:3295 punch from 0x79b600 to 0x7a8800, (0xd200 bytes) 2024-09-14T08:41:44.846 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:41:44.877 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:44.877+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:44.978 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:44.976+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:44.986 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:44.986 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:45.008 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:45.093 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:45.093+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:45.110 INFO:teuthology.orchestra.run.smithi188.stdout:3296 write 0xcc2ba00 thru 0xcc3b449 (0xfa4a bytes) 2024-09-14T08:41:45.112 INFO:teuthology.orchestra.run.smithi188.stdout:3299 read 0x9ae4400 thru 0x9ae7874 (0x3475 bytes) 2024-09-14T08:41:45.112 INFO:teuthology.orchestra.run.smithi188.stdout:3300 punch from 0x2efc200 to 0x2f09800, (0xd600 bytes) 2024-09-14T08:41:45.170 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:45.170 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:45.179 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:45.176+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:45.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:45.280 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:45.280+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:45.347 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:45.347 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:45.362 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:45.409 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:45.409+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:45.482 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:45.481+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:45.487 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:45.487 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:45.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:45.582 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:45.580+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:45.638 INFO:teuthology.orchestra.run.smithi188.stdout:3302 write 0xec10c00 thru 0xec19451 (0x8852 bytes) 2024-09-14T08:41:45.641 INFO:teuthology.orchestra.run.smithi188.stdout:3303 write 0xc2ef000 thru 0xc2f3b51 (0x4b52 bytes) 2024-09-14T08:41:45.683 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:45.684 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:45.684 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:45.684+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:45.699 INFO:teuthology.orchestra.run.smithi188.stdout:3305 write 0xec77800 thru 0xec8591b (0xe11c bytes) 2024-09-14T08:41:45.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:45.701 INFO:teuthology.orchestra.run.smithi188.stdout:3311 punch from 0xcbb6e00 to 0xcbc1200, (0xa400 bytes) 2024-09-14T08:41:45.703 INFO:teuthology.orchestra.run.smithi188.stdout:3312 read 0x680f600 thru 0x6815589 (0x5f8a bytes) 2024-09-14T08:41:45.703 INFO:teuthology.orchestra.run.smithi188.stdout:3314 read 0x42b5200 thru 0x42c2042 (0xce43 bytes) 2024-09-14T08:41:45.703 INFO:teuthology.orchestra.run.smithi188.stdout:3315 write 0xcecd800 thru 0xced2aad (0x52ae bytes) 2024-09-14T08:41:45.716 INFO:teuthology.orchestra.run.smithi188.stdout:3316 trunc from 0xec85a00 to 0x8cdfa00 2024-09-14T08:41:45.783 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:45.784 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:45.781+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:45.841 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:45.841 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:45.856 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:45.885 INFO:teuthology.orchestra.run.smithi188.stdout:3317 trunc from 0x8cdfa00 to 0xc5f5000 2024-09-14T08:41:45.899 INFO:teuthology.orchestra.run.smithi188.stdout:3319 read 0x61c7400 thru 0x61d4787 (0xd388 bytes) 2024-09-14T08:41:45.902 INFO:teuthology.orchestra.run.smithi188.stdout:3322 punch from 0x37efe00 to 0x37ffc00, (0xfe00 bytes) 2024-09-14T08:41:45.903 INFO:teuthology.orchestra.run.smithi188.stdout:3325 read 0x19d9a00 thru 0x19db9c9 (0x1fca bytes) 2024-09-14T08:41:45.903 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:45.904+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:45.929 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:45.949 INFO:teuthology.orchestra.run.smithi188.stdout:3327 trunc from 0xc5f5000 to 0x1ad1600 2024-09-14T08:41:45.963 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:45.963 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:45.985 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:45.985 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:45.986 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:45.985+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:46.007 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:24146 3.b 3:d13f2e08:::rbd_data.10f18b35ff50.00000000000000dd:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:46.006021+0000", 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0040633379999999997, 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.004093874, 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.008 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24146 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006021+0000", 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006021+0000", 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006023+0000", 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.59e-06 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006030+0000", 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.126e-06 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006049+0000", 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8723e-05 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006060+0000", 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1433e-05 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006181+0000", 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120334 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006298+0000", 2024-09-14T08:41:46.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000117366 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 4", 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006492+0000", 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000194348 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.5479.0:24142 3.1a e122/21 3:5e1548a4:::rbd_data.10f18b35ff50.00000000000000db:head v 122'297, mlcod=122'295)", 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:46.006372+0000", 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0037129110000000002, 2024-09-14T08:41:46.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003840319, 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006372+0000", 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006372+0000", 2024-09-14T08:41:46.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006373+0000", 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0100000000000004e-07 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006382+0000", 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0080000000000008e-06 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006394+0000", 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2191999999999999e-05 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006401+0000", 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5310000000000004e-06 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006960+0000", 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00055847999999999998 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006987+0000", 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7129999999999999e-05 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.5479.0:24148 3.16 e122/120 3:683a8634:::rbd_data.10f18b35ff50.00000000000000de:head v 122'282, mlcod=122'280)", 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:46.006958+0000", 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0031270870000000002, 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033187659999999999, 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.016 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006958+0000", 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006958+0000", 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006959+0000", 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.569999999999999e-07 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006966+0000", 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.391e-06 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.006981+0000", 2024-09-14T08:41:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4568e-05 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.007007+0000", 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6010999999999999e-05 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.007080+0000", 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3706000000000002e-05 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.007101+0000", 2024-09-14T08:41:46.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0988999999999998e-05 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.5479.0:24154 3.1e e122/77 3:78170827:::rbd_data.10f18b35ff50.00000000000000df:head v 122'263, mlcod=121'260)", 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:46.008788+0000", 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0012970340000000001, 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015664019999999999, 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.008788+0000", 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.008788+0000", 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.008789+0000", 2024-09-14T08:41:46.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1399999999999996e-07 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.008795+0000", 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2600000000000002e-06 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.008810+0000", 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5028000000000001e-05 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.008818+0000", 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2130000000000008e-06 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.008880+0000", 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1595999999999998e-05 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.008909+0000", 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9675999999999998e-05 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.024 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.024 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:46.024 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 4 2024-09-14T08:41:46.024 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:46.024 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:46.024 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:46.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:46.039 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:46.040 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:46.065 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:46.065 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:46.069 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:46.069 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:46.087 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:46.085+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:46.165 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:46.165 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:46.165 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:46.165 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:46.165 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:46.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:46.187 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:46.185+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:46.267 INFO:teuthology.orchestra.run.smithi188.stdout:3328 read 0xcfaa00 thru 0xcfee35 (0x4436 bytes) 2024-09-14T08:41:46.279 INFO:teuthology.orchestra.run.smithi188.stdout:3329 read 0x17b800 thru 0x18565d (0x9e5e bytes) 2024-09-14T08:41:46.288 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:46.288+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:46.294 INFO:teuthology.orchestra.run.smithi188.stdout:3331 write 0x1308200 thru 0x1310c8f (0x8a90 bytes) 2024-09-14T08:41:46.302 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:46.302 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:46.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:46.302 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:46.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 109.377753836, 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:41:46.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:41:46.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.307 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 109.377699058, 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.308 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 95.949928599000003, 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:46.312 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:46.316 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.957324532000001, 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:46.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:41:46.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:41:46.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.956486161000001, 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:41:46.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.937978060000001, 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:41:46.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.937663851, 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:41:46.330 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.936027525, 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.935809566, 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.340 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:41:46.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:41:46.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.935514164000001, 2024-09-14T08:41:46.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.348 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.935243329, 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:41:46.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:46.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.724052648000001, 2024-09-14T08:41:46.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:41:46.353 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.353 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:46.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:41:46.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.724032614, 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.358 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:46.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:46.362 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.724011536000001, 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:41:46.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.366 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.723991942, 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.367 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:41:46.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.723971788, 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.723952391999999, 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.375 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:46.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:41:46.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:41:46.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.717422592, 2024-09-14T08:41:46.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:46.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:41:46.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:41:46.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.383 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.717402706, 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.384 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:41:46.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.717383332000001, 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:41:46.388 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:41:46.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.392 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:46.394 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:46.393+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:46.394 INFO:teuthology.orchestra.run.smithi188.stdout:3332 write 0x4d22c00 thru 0x4d25575 (0x2976 bytes) 2024-09-14T08:41:46.394 INFO:teuthology.orchestra.run.smithi188.stdout:3334 trunc from 0x4d25600 to 0x38e8600 2024-09-14T08:41:46.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:46.415 INFO:teuthology.orchestra.run.smithi188.stdout:3337 read 0x3591e00 thru 0x359d457 (0xb658 bytes) 2024-09-14T08:41:46.425 INFO:teuthology.orchestra.run.smithi188.stdout:3338 trunc from 0x38e8600 to 0x6aa7000 2024-09-14T08:41:46.468 INFO:teuthology.orchestra.run.smithi188.stdout:3339 read 0x490fc00 thru 0x4917bb7 (0x7fb8 bytes) 2024-09-14T08:41:46.470 INFO:teuthology.orchestra.run.smithi188.stdout:3340 read 0x4523200 thru 0x452fde0 (0xcbe1 bytes) 2024-09-14T08:41:46.470 INFO:teuthology.orchestra.run.smithi188.stdout:3341 read 0x2da4600 thru 0x2da7b5d (0x355e bytes) 2024-09-14T08:41:46.494 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:46.492+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:46.497 INFO:teuthology.orchestra.run.smithi188.stdout:3342 write 0xa05bc00 thru 0xa065a18 (0x9e19 bytes) 2024-09-14T08:41:46.498 INFO:teuthology.orchestra.run.smithi188.stdout:3344 punch from 0x2e44000 to 0x2e46800, (0x2800 bytes) 2024-09-14T08:41:46.500 INFO:teuthology.orchestra.run.smithi188.stdout:3345 read 0x7263a00 thru 0x7266532 (0x2b33 bytes) 2024-09-14T08:41:46.500 INFO:teuthology.orchestra.run.smithi188.stdout:3346 write 0x95cf200 thru 0x95d14f0 (0x22f1 bytes) 2024-09-14T08:41:46.500 INFO:teuthology.orchestra.run.smithi188.stdout:3347 read 0x16d5000 thru 0x16dd86c (0x886d bytes) 2024-09-14T08:41:46.506 INFO:teuthology.orchestra.run.smithi188.stdout:3348 read 0x6e56000 thru 0x6e657a2 (0xf7a3 bytes) 2024-09-14T08:41:46.507 INFO:teuthology.orchestra.run.smithi188.stdout:3352 write 0x8168600 thru 0x817764d (0xf04e bytes) 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:15045 3.7 3:e227773f:::rbd_header.10f18b35ff50:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:46.588351+0000", 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00016770700000000001, 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022051199999999999, 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 15045 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588351+0000", 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588351+0000", 2024-09-14T08:41:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588352+0000", 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.127e-06 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588357+0000", 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4940000000000003e-06 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588368+0000", 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1137e-05 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588374+0000", 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4e-06 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588416+0000", 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2002999999999997e-05 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588472+0000", 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6112000000000001e-05 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588586+0000", 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011451 2024-09-14T08:41:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:26318 3.7 3:e227773f:::rbd_header.10f18b35ff50:head [call rbd.get_size in=19b,call rbd.get_features in=24b,call rbd.get_flags in=20b,call rbd.get_snapcontext in=18b,call lock.get_info in=30b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:46.588577+0000", 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999418, 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021706699999999999, 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 26318 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588577+0000", 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588577+0000", 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588577+0000", 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.23e-07 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588581+0000", 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.473e-06 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588587+0000", 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:41:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588591+0000", 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0629999999999999e-06 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588663+0000", 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1758e-05 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:46.588803+0000", 2024-09-14T08:41:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000139808 2024-09-14T08:41:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:41:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 2 2024-09-14T08:41:46.595 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:46.596 INFO:teuthology.orchestra.run.smithi188.stdout:3355 write 0xa827c00 thru 0xa82a17c (0x257d bytes) 2024-09-14T08:41:46.596 INFO:teuthology.orchestra.run.smithi188.stdout:3357 punch from 0x68a8200 to 0x68ab800, (0x3600 bytes) 2024-09-14T08:41:46.596 INFO:teuthology.orchestra.run.smithi188.stdout:3358 read 0x58aa400 thru 0x58aa6a8 (0x2a9 bytes) 2024-09-14T08:41:46.596 INFO:teuthology.orchestra.run.smithi188.stdout:3359 write 0x5049400 thru 0x5055dc5 (0xc9c6 bytes) 2024-09-14T08:41:46.597 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:46.593+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:46.602 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:46.652 INFO:teuthology.orchestra.run.smithi188.stdout:3360 write 0xe4b6a00 thru 0xe4c442f (0xda30 bytes) 2024-09-14T08:41:46.653 INFO:teuthology.orchestra.run.smithi188.stdout:3363 write 0x1d83c00 thru 0x1d8d28e (0x968f bytes) 2024-09-14T08:41:46.654 INFO:teuthology.orchestra.run.smithi188.stdout:3367 read 0x3510a00 thru 0x3512c93 (0x2294 bytes) 2024-09-14T08:41:46.654 INFO:teuthology.orchestra.run.smithi188.stdout:3368 read 0xdd9d800 thru 0xdda82f4 (0xaaf5 bytes) 2024-09-14T08:41:46.654 INFO:teuthology.orchestra.run.smithi188.stdout:3371 read 0x376a400 thru 0x37707ab (0x63ac bytes) 2024-09-14T08:41:46.655 INFO:teuthology.orchestra.run.smithi188.stdout:3373 punch from 0xb0fc400 to 0xb0fd200, (0xe00 bytes) 2024-09-14T08:41:46.656 INFO:teuthology.orchestra.run.smithi188.stdout:3375 write 0xc6d2400 thru 0xc6d2f44 (0xb45 bytes) 2024-09-14T08:41:46.656 INFO:teuthology.orchestra.run.smithi188.stdout:3378 read 0x7876e00 thru 0x788151a (0xa71b bytes) 2024-09-14T08:41:46.656 INFO:teuthology.orchestra.run.smithi188.stdout:3379 read 0x8f84c00 thru 0x8f938c6 (0xecc7 bytes) 2024-09-14T08:41:46.657 INFO:teuthology.orchestra.run.smithi188.stdout:3381 write 0xddd7600 thru 0xdddcd51 (0x5752 bytes) 2024-09-14T08:41:46.657 INFO:teuthology.orchestra.run.smithi188.stdout:3382 clone 27 order 20 su 524288 sc 6 2024-09-14T08:41:46.697 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:46.697+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:46.774 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:46.774 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:46.774 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:46.775 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:46.775 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:46.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:46.835 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:46.835+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:46.859 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5] out_osds: [3, 0] dead_osds: [0] live_osds: [1, 2, 3, 4, 5] 2024-09-14T08:41:46.859 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:41:46.859 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-14T08:41:46.859 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T08:41:46.859 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T08:41:46.862 INFO:tasks.ceph.osd.0:Started 2024-09-14T08:41:46.862 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:41:46.872 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:41:46.911 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:46.911+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:46.924 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:46.924 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:46.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:46.924 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:46.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 96.619210594999998, 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.925 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:46.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 64.357100415999994, 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.931 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:46.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.935 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 64.356953245, 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:46.936 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 64.356811445000005, 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7935456780000001, 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:41:46.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:41:46.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7852543880000002, 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:41:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7852311470000002, 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:41:46.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:41:46.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7852118830000001, 2024-09-14T08:41:46.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:41:46.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:41:46.964 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7851926069999999, 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:41:46.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7849801539999999, 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:41:46.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:41:46.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:41:46.974 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.777767061, 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:41:46.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.777745849, 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:41:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:41:46.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.983 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7777264989999999, 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:41:46.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:41:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.77769946, 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.988 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:41:46.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:41:46.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.77768031, 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:41:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:41:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:41:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:41:46.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:46.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.997 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7776587259999999, 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:46.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:41:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:41:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:41:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:41:47.002 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7776393170000002, 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:47.003 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:47.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:41:47.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7776204409999998, 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:47.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:41:47.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:41:47.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:47.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7695896050000002, 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:47.012 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:41:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7695632090000002, 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:41:47.016 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:47.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:47.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:41:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:41:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:47.020 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:47.020 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:47.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:47.022 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:no valid command found; 10 closest matches: 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:0 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:1 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:2 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:abort 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:assert 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:config diff 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:config diff get 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:config get 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:config help [] 2024-09-14T08:41:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:config set ... 2024-09-14T08:41:47.024 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: invalid command 2024-09-14T08:41:47.024 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-14T08:41:47.024 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:47.019+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:47.036 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone26 from 0xe4c4600 (overlap 0x1ad1600) to 0x2ae800 2024-09-14T08:41:47.122 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:47.119+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:47.212 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:47.213 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:47.213 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:47.213 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:47.223 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:47.221+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:47.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:47.324 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:47.321+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:47.384 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:47.384 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:47.384 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:47.385 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:47.385 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:47.400 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:47.425 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:47.423+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:47.526 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:47.525+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:47.572 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.32490647, 2024-09-14T08:41:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:41:47.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324844457, 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.578 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:47.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:41:47.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324778127, 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.583 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.588 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324722667, 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:41:47.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:41:47.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:41:47.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324663047, 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:47.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:41:47.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:41:47.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:41:47.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:41:47.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:41:47.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:41:47.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324581507, 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:41:47.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:41:47.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:41:47.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:41:47.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:41:47.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:47.605 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.32452517900001, 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:41:47.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:41:47.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.32445368400001, 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.611 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:41:47.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324380813, 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:41:47.616 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:41:47.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:41:47.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:41:47.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:41:47.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:41:47.621 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.621 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.621 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.32433860099999, 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:41:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:41:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.32430877100001, 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:41:47.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.32428047400001, 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.632 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:41:47.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:47.637 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.32423937900001, 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:41:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:41:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:41:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324210349, 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:41:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324181865, 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:41:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:41:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:41:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:41:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:41:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324153725, 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:41:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:41:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:41:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324125029, 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:41:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:41:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:41:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:41:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.664 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.32409627200001, 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.665 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:41:47.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:41:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.324068225, 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.670 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:41:47.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:41:47.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.32403824799999, 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:47.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:41:47.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:47.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:41:47.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:41:47.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.680 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.680 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.680 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:47.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:47.682 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:47.681+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:47.782 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:47.781+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:47.867 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:41:47.878 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:47.878 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:47.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.878 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32901 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.878 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.832734+0000", 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023909710000000001, 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.023949693000000001, 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32901 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.879 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832734+0000", 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832734+0000", 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832735+0000", 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0200000000000001e-07 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832737+0000", 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3829999999999999e-06 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832744+0000", 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.063e-06 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832750+0000", 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6080000000000003e-06 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32933 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833789+0000", 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022854815000000001, 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.023048954999999999, 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.883 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32933 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833789+0000", 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833789+0000", 2024-09-14T08:41:47.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833789+0000", 2024-09-14T08:41:47.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3900000000000004e-07 2024-09-14T08:41:47.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833792+0000", 2024-09-14T08:41:47.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3429999999999998e-06 2024-09-14T08:41:47.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833800+0000", 2024-09-14T08:41:47.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2970000000000004e-06 2024-09-14T08:41:47.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833806+0000", 2024-09-14T08:41:47.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4489999999999998e-06 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32965 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834828+0000", 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021815300999999999, 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022129656000000001, 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.887 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32965 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834828+0000", 2024-09-14T08:41:47.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834828+0000", 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834829+0000", 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8800000000000002e-07 2024-09-14T08:41:47.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834832+0000", 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3069999999999998e-06 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834840+0000", 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0960000000000001e-06 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834847+0000", 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2219999999999999e-06 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32997 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835703+0000", 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020940573000000001, 2024-09-14T08:41:47.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021371788999999999, 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32997 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835703+0000", 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835703+0000", 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835703+0000", 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2800000000000002e-07 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835706+0000", 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2259999999999999e-06 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835715+0000", 2024-09-14T08:41:47.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6730000000000004e-06 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835721+0000", 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8069999999999996e-06 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.895 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33029 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836555+0000", 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020088897000000001, 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020649279, 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33029 2024-09-14T08:41:47.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836555+0000", 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836555+0000", 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836555+0000", 2024-09-14T08:41:47.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4200000000000002e-07 2024-09-14T08:41:47.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836557+0000", 2024-09-14T08:41:47.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.956e-06 2024-09-14T08:41:47.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836565+0000", 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6680000000000001e-06 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836570+0000", 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0900000000000004e-06 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.899 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33061 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844481+0000", 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.012162882999999999, 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012809958999999999, 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33061 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844481+0000", 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844481+0000", 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844481+0000", 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4600000000000004e-07 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844484+0000", 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5019999999999999e-06 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844491+0000", 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3209999999999999e-06 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844497+0000", 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5620000000000003e-06 2024-09-14T08:41:47.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33093 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852606+0000", 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.004037583, 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047413719999999998, 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.904 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.905 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.905 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.905 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.905 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33093 2024-09-14T08:41:47.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.905 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852606+0000", 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852606+0000", 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852607+0000", 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852615+0000", 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9400000000000002e-06 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852623+0000", 2024-09-14T08:41:47.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9049999999999997e-06 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852632+0000", 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7159999999999998e-06 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33125 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.908 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853576+0000", 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0030677769999999998, 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038266009999999998, 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33125 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853576+0000", 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853576+0000", 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853576+0000", 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853579+0000", 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.396e-06 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853585+0000", 2024-09-14T08:41:47.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5100000000000004e-06 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853591+0000", 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6049999999999997e-06 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32902 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.832770+0000", 2024-09-14T08:41:47.912 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023873413, 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024703058, 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32902 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832770+0000", 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832770+0000", 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832771+0000", 2024-09-14T08:41:47.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4000000000000001e-07 2024-09-14T08:41:47.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832774+0000", 2024-09-14T08:41:47.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6510000000000001e-06 2024-09-14T08:41:47.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832781+0000", 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7319999999999998e-06 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832787+0000", 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6890000000000001e-06 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32934 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833814+0000", 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022829553999999998, 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.023792719, 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.917 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32934 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833814+0000", 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833814+0000", 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833815+0000", 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7299999999999996e-07 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833817+0000", 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2479999999999999e-06 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833823+0000", 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.657e-06 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833830+0000", 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2870000000000001e-06 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32966 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834855+0000", 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021788700000000001, 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022869450999999999, 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32966 2024-09-14T08:41:47.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834855+0000", 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834855+0000", 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834855+0000", 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4199999999999996e-07 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834858+0000", 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4360000000000001e-06 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834867+0000", 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7430000000000008e-06 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834874+0000", 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.973e-06 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.924 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32998 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835729+0000", 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020914744999999998, 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022114049, 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.925 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32998 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835729+0000", 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835729+0000", 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835729+0000", 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4999999999999998e-07 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835736+0000", 2024-09-14T08:41:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2080000000000003e-06 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835744+0000", 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3270000000000003e-06 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835754+0000", 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0117e-05 2024-09-14T08:41:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33030 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836576+0000", 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020067635, 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021388954000000002, 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33030 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836576+0000", 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836576+0000", 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836576+0000", 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2899999999999999e-07 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836578+0000", 2024-09-14T08:41:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0030000000000001e-06 2024-09-14T08:41:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836586+0000", 2024-09-14T08:41:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:41:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836591+0000", 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0950000000000003e-06 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33062 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844505+0000", 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.012138272, 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013546054, 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33062 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844505+0000", 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844505+0000", 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844506+0000", 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7199999999999999e-07 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844508+0000", 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.351e-06 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844515+0000", 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0049999999999998e-06 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844521+0000", 2024-09-14T08:41:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6069999999999998e-06 2024-09-14T08:41:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33094 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852645+0000", 2024-09-14T08:41:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0039989439999999999, 2024-09-14T08:41:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054651480000000004, 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33094 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852645+0000", 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852645+0000", 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852645+0000", 2024-09-14T08:41:47.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6599999999999996e-07 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852648+0000", 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7970000000000001e-06 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852656+0000", 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0739999999999993e-06 2024-09-14T08:41:47.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852662+0000", 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2609999999999999e-06 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33126 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.941 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853599+0000", 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00304434, 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045659849999999998, 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33126 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853599+0000", 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853599+0000", 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853668+0000", 2024-09-14T08:41:47.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9028000000000004e-05 2024-09-14T08:41:47.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853671+0000", 2024-09-14T08:41:47.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2509999999999999e-06 2024-09-14T08:41:47.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853681+0000", 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5550000000000008e-06 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853689+0000", 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1669999999999999e-06 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32903 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.832796+0000", 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023847498000000002, 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025431414999999999, 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.946 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32903 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832796+0000", 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832796+0000", 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832797+0000", 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5799999999999999e-07 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832804+0000", 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5379999999999997e-06 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832812+0000", 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3749999999999997e-06 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832818+0000", 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.241e-06 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.949 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32935 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833850+0000", 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022793658000000001, 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024512551, 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32935 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.950 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833850+0000", 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833850+0000", 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833851+0000", 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3600000000000003e-07 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833853+0000", 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5110000000000002e-06 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833861+0000", 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7810000000000005e-06 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833867+0000", 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9730000000000002e-06 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32967 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834881+0000", 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021762169000000001, 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.023597554999999999, 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.954 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32967 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834881+0000", 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834881+0000", 2024-09-14T08:41:47.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834882+0000", 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.13e-07 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834884+0000", 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3479999999999998e-06 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834892+0000", 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2579999999999998e-06 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834897+0000", 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3260000000000003e-06 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.957 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32999 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835763+0000", 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.02088015, 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022831794999999998, 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.958 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32999 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835763+0000", 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835763+0000", 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835764+0000", 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5600000000000005e-07 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835767+0000", 2024-09-14T08:41:47.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835775+0000", 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9780000000000005e-06 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835780+0000", 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8250000000000001e-06 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.961 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33031 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836597+0000", 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020046538999999999, 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022112323999999999, 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.962 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33031 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836597+0000", 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836597+0000", 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836597+0000", 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8599999999999999e-07 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836599+0000", 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9309999999999998e-06 2024-09-14T08:41:47.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836610+0000", 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0869999999999999e-05 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836623+0000", 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2697999999999999e-05 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.965 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33063 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844529+0000", 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.012114975, 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014286124000000001, 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33063 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844529+0000", 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844529+0000", 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844529+0000", 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844531+0000", 2024-09-14T08:41:47.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.21e-06 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844537+0000", 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2160000000000003e-06 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844543+0000", 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4600000000000002e-06 2024-09-14T08:41:47.969 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.970 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.970 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.970 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33095 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.970 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852671+0000", 2024-09-14T08:41:47.970 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0039727740000000001, 2024-09-14T08:41:47.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062186159999999997, 2024-09-14T08:41:47.970 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.970 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33095 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852671+0000", 2024-09-14T08:41:47.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852671+0000", 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852671+0000", 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2300000000000001e-07 2024-09-14T08:41:47.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852674+0000", 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.548e-06 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852681+0000", 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0709999999999997e-06 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852688+0000", 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1659999999999997e-06 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32904 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.832827+0000", 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023816837, 2024-09-14T08:41:47.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026118491000000001, 2024-09-14T08:41:47.975 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.975 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.975 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.975 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32904 2024-09-14T08:41:47.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.975 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832827+0000", 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832827+0000", 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832827+0000", 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3499999999999995e-07 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832830+0000", 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3750000000000001e-06 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832837+0000", 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1169999999999998e-06 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832844+0000", 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6490000000000002e-06 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.978 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32936 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833893+0000", 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022750902, 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025160475000000002, 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32936 2024-09-14T08:41:47.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833893+0000", 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833893+0000", 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833893+0000", 2024-09-14T08:41:47.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6899999999999996e-07 2024-09-14T08:41:47.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833896+0000", 2024-09-14T08:41:47.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7219999999999999e-06 2024-09-14T08:41:47.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833904+0000", 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9119999999999998e-06 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833910+0000", 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0009999999999998e-06 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32968 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834904+0000", 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021739334999999999, 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024264514000000001, 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32968 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834904+0000", 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834904+0000", 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834905+0000", 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8699999999999995e-07 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834907+0000", 2024-09-14T08:41:47.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834916+0000", 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3790000000000006e-06 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834921+0000", 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.276e-06 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33000 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835788+0000", 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020855478, 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.023496293000000001, 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.987 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33000 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835788+0000", 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835788+0000", 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835789+0000", 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1200000000000003e-07 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835791+0000", 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3269999999999999e-06 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835798+0000", 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3710000000000002e-06 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835804+0000", 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1900000000000003e-06 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.990 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33032 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836643+0000", 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020000207999999998, 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022755627, 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.991 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33032 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836643+0000", 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836643+0000", 2024-09-14T08:41:47.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836644+0000", 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1699999999999997e-07 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836646+0000", 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4269999999999998e-06 2024-09-14T08:41:47.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836654+0000", 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5059999999999998e-06 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836660+0000", 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6849999999999998e-06 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.994 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33064 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844559+0000", 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.012084473, 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014957326999999999, 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:47.995 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33064 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844559+0000", 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:47.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844559+0000", 2024-09-14T08:41:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844560+0000", 2024-09-14T08:41:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2300000000000001e-07 2024-09-14T08:41:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844562+0000", 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6860000000000002e-06 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844570+0000", 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6860000000000006e-06 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844576+0000", 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7289999999999997e-06 2024-09-14T08:41:47.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33096 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852696+0000", 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0039474849999999997, 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0068951059999999998, 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:47.999 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33096 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852696+0000", 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852696+0000", 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852697+0000", 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.89e-07 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852699+0000", 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.367e-06 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852707+0000", 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8059999999999995e-06 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852712+0000", 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4439999999999999e-06 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32905 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.832866+0000", 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023777124, 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026781592999999999, 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.003 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32905 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832866+0000", 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832866+0000", 2024-09-14T08:41:48.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832867+0000", 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7000000000000004e-07 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832870+0000", 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7180000000000001e-06 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832879+0000", 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7239999999999998e-06 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832892+0000", 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3229e-05 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32937 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.007 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833919+0000", 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022724158000000001, 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025792478000000001, 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32937 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.008 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833919+0000", 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833919+0000", 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833920+0000", 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3900000000000004e-07 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833923+0000", 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833930+0000", 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0149999999999998e-06 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833935+0000", 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6420000000000004e-06 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.011 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32969 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834932+0000", 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021712041000000001, 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024907866000000001, 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32969 2024-09-14T08:41:48.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834932+0000", 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834932+0000", 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834932+0000", 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8100000000000003e-07 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834934+0000", 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2730000000000001e-06 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834941+0000", 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1010000000000003e-06 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834947+0000", 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5049999999999998e-06 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.015 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33001 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835811+0000", 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020832327000000001, 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024143878000000001, 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33001 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.016 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835811+0000", 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835811+0000", 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835812+0000", 2024-09-14T08:41:48.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6599999999999996e-07 2024-09-14T08:41:48.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835814+0000", 2024-09-14T08:41:48.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3209999999999999e-06 2024-09-14T08:41:48.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835821+0000", 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6200000000000001e-06 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835826+0000", 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.254e-06 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.019 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.020 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33033 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.020 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836667+0000", 2024-09-14T08:41:48.020 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019976199, 2024-09-14T08:41:48.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.023416632999999999, 2024-09-14T08:41:48.020 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.020 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.020 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.020 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33033 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836667+0000", 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836667+0000", 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836668+0000", 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5899999999999996e-07 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836670+0000", 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.176e-06 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836688+0000", 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8009999999999999e-05 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836696+0000", 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8380000000000002e-06 2024-09-14T08:41:48.023 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33065 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844584+0000", 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.012059607, 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015622394, 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.024 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33065 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844584+0000", 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844584+0000", 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844584+0000", 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7199999999999999e-07 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844587+0000", 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2560000000000001e-06 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844593+0000", 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4289999999999998e-06 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844599+0000", 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1040000000000003e-06 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33097 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852720+0000", 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0039236439999999996, 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0075869880000000002, 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.028 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33097 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852720+0000", 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852720+0000", 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852720+0000", 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1800000000000001e-07 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852723+0000", 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.396e-06 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852729+0000", 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5629999999999997e-06 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852735+0000", 2024-09-14T08:41:48.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9390000000000002e-06 2024-09-14T08:41:48.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.032 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.032 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32906 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.032 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.832917+0000", 2024-09-14T08:41:48.032 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023726196000000001, 2024-09-14T08:41:48.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027447885000000002, 2024-09-14T08:41:48.032 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32906 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832917+0000", 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832917+0000", 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832918+0000", 2024-09-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9899999999999999e-07 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832921+0000", 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832932+0000", 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0705e-05 2024-09-14T08:41:48.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832939+0000", 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8169999999999999e-06 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32938 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.036 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833944+0000", 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022699918999999999, 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026510394, 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32938 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833944+0000", 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833944+0000", 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833944+0000", 2024-09-14T08:41:48.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0100000000000004e-07 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833947+0000", 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.481e-06 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833953+0000", 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6039999999999998e-06 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833961+0000", 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4030000000000001e-06 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32970 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834955+0000", 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021688448999999999, 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025557956999999999, 2024-09-14T08:41:48.040 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32970 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834955+0000", 2024-09-14T08:41:48.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834955+0000", 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834956+0000", 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.82e-07 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834958+0000", 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2900000000000001e-06 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834968+0000", 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6809999999999993e-06 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834973+0000", 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5079999999999996e-06 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33002 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835846+0000", 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020797254000000001, 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024762875, 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.044 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33002 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835846+0000", 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835846+0000", 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835847+0000", 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5799999999999999e-07 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835849+0000", 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.508e-06 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835857+0000", 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3950000000000003e-06 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835862+0000", 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2220000000000001e-06 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33034 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836704+0000", 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019939591, 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024025739000000001, 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33034 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836704+0000", 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836704+0000", 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836704+0000", 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836719+0000", 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4064e-05 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836726+0000", 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3139999999999998e-06 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836732+0000", 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33066 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844638+0000", 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.012005795, 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016208601999999999, 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33066 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844638+0000", 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844638+0000", 2024-09-14T08:41:48.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844638+0000", 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0200000000000001e-07 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844641+0000", 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7089999999999998e-06 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844650+0000", 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3659999999999992e-06 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844656+0000", 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.976e-06 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33098 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852761+0000", 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0038825750000000001, 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0082122050000000002, 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.056 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33098 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852761+0000", 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852761+0000", 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852762+0000", 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5899999999999996e-07 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852764+0000", 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5189999999999999e-06 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852772+0000", 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.96e-06 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852797+0000", 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5049e-05 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32907 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.832960+0000", 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023683669000000001, 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028121882000000001, 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.060 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32907 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832960+0000", 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832960+0000", 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832961+0000", 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3600000000000002e-07 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832963+0000", 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6450000000000001e-06 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832971+0000", 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8849999999999999e-06 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832977+0000", 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7860000000000002e-06 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32939 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833971+0000", 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022672167999999999, 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027172861, 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32939 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833971+0000", 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833971+0000", 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833972+0000", 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2900000000000004e-07 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833988+0000", 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6560999999999999e-05 2024-09-14T08:41:48.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833999+0000", 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0339999999999999e-05 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834005+0000", 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1770000000000003e-06 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32971 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834981+0000", 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021662303000000001, 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026218749, 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32971 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834981+0000", 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834981+0000", 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834982+0000", 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8599999999999998e-07 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834984+0000", 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.334e-06 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834991+0000", 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6059999999999999e-06 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834996+0000", 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3329999999999996e-06 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33003 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835873+0000", 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020770186, 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025385095999999999, 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33003 2024-09-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835873+0000", 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835873+0000", 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835874+0000", 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2900000000000003e-07 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835876+0000", 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3080000000000002e-06 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835885+0000", 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9169999999999995e-06 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835891+0000", 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3650000000000003e-06 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33035 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836741+0000", 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019902527, 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024572704000000001, 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.076 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33035 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836741+0000", 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836741+0000", 2024-09-14T08:41:48.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836741+0000", 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836744+0000", 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836750+0000", 2024-09-14T08:41:48.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1890000000000004e-06 2024-09-14T08:41:48.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836755+0000", 2024-09-14T08:41:48.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.006e-06 2024-09-14T08:41:48.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.079 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33067 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844672+0000", 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011971285, 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016699535000000001, 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33067 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844672+0000", 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844672+0000", 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844673+0000", 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7999999999999995e-07 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844675+0000", 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4360000000000001e-06 2024-09-14T08:41:48.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844683+0000", 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4410000000000004e-06 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844688+0000", 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6119999999999998e-06 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33099 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852810+0000", 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003833412, 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0086162830000000006, 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33099 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852810+0000", 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852810+0000", 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852811+0000", 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2900000000000003e-07 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852813+0000", 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852821+0000", 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1420000000000004e-06 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852834+0000", 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3179999999999999e-05 2024-09-14T08:41:48.087 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32908 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.832986+0000", 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023657199, 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028500218000000001, 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.088 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32908 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832986+0000", 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832986+0000", 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832987+0000", 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832990+0000", 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4329999999999998e-06 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.832997+0000", 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0380000000000002e-06 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833002+0000", 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6570000000000002e-06 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.091 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32940 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834015+0000", 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022628624999999999, 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027560138000000001, 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32940 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834015+0000", 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834015+0000", 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834016+0000", 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8100000000000002e-07 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834018+0000", 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.469e-06 2024-09-14T08:41:48.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834027+0000", 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3610000000000001e-06 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834032+0000", 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6250000000000004e-06 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32972 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835004+0000", 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021639601000000001, 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026689899999999999, 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32972 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835004+0000", 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835004+0000", 2024-09-14T08:41:48.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835004+0000", 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7899999999999999e-07 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835007+0000", 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3319999999999999e-06 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835015+0000", 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4789999999999996e-06 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835021+0000", 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3759999999999999e-06 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33004 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835902+0000", 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020741899000000001, 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025908957, 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33004 2024-09-14T08:41:48.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835902+0000", 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835902+0000", 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835902+0000", 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7399999999999998e-07 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835905+0000", 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6280000000000001e-06 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835915+0000", 2024-09-14T08:41:48.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.027e-05 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835924+0000", 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.234e-06 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33036 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.103 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836761+0000", 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019882598000000001, 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025171171999999999, 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33036 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836761+0000", 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836761+0000", 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836761+0000", 2024-09-14T08:41:48.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9200000000000002e-07 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836763+0000", 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.962e-06 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836772+0000", 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5429999999999994e-06 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836778+0000", 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7960000000000001e-06 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33068 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844697+0000", 2024-09-14T08:41:48.107 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011946322000000001, 2024-09-14T08:41:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017347159000000001, 2024-09-14T08:41:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33068 2024-09-14T08:41:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844697+0000", 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844697+0000", 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844698+0000", 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9500000000000003e-07 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844700+0000", 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4310000000000001e-06 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844714+0000", 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4002000000000001e-05 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844720+0000", 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1009999999999997e-06 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33100 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852852+0000", 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0037919130000000001, 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092649550000000001, 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33100 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852852+0000", 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852852+0000", 2024-09-14T08:41:48.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852852+0000", 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852855+0000", 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7369999999999998e-06 2024-09-14T08:41:48.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852869+0000", 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.403e-05 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852877+0000", 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2519999999999999e-06 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.115 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32909 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833025+0000", 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023618395, 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029191742999999999, 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32909 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833025+0000", 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833025+0000", 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833026+0000", 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7499999999999999e-07 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833028+0000", 2024-09-14T08:41:48.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5550000000000001e-06 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833037+0000", 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6489999999999997e-06 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833043+0000", 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3450000000000002e-06 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.119 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32941 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834055+0000", 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022588605000000001, 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028219461000000001, 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32941 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834055+0000", 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834055+0000", 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834056+0000", 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9299999999999997e-07 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834059+0000", 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8059999999999999e-06 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834066+0000", 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9379999999999992e-06 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834072+0000", 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8680000000000004e-06 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32973 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835031+0000", 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021612218999999998, 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027303093000000001, 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.124 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32973 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835031+0000", 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835031+0000", 2024-09-14T08:41:48.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835032+0000", 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835035+0000", 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7410000000000001e-06 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835042+0000", 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7039999999999994e-06 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835049+0000", 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33005 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835933+0000", 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020710969999999999, 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026457703999999999, 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33005 2024-09-14T08:41:48.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835933+0000", 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835933+0000", 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835933+0000", 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4299999999999998e-07 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835935+0000", 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3159999999999999e-06 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835942+0000", 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5350000000000001e-06 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835948+0000", 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4479999999999999e-06 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33037 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836786+0000", 2024-09-14T08:41:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019857980000000001, 2024-09-14T08:41:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025663294999999999, 2024-09-14T08:41:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33037 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836786+0000", 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836786+0000", 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836786+0000", 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1699999999999999e-07 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836788+0000", 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9319999999999999e-06 2024-09-14T08:41:48.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836794+0000", 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8289999999999996e-06 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836798+0000", 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4970000000000003e-06 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.135 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33069 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844729+0000", 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011914996000000001, 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017784878, 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33069 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844729+0000", 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844729+0000", 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844729+0000", 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3000000000000001e-07 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844731+0000", 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3549999999999999e-06 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844739+0000", 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2239999999999998e-06 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844744+0000", 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0479999999999998e-06 2024-09-14T08:41:48.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33101 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852887+0000", 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0037568250000000001, 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0097405029999999993, 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33101 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852887+0000", 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852887+0000", 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852887+0000", 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8299999999999996e-07 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852890+0000", 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.418e-06 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852897+0000", 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3019999999999997e-06 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852904+0000", 2024-09-14T08:41:48.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.528e-06 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32910 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833056+0000", 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023587476, 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029689311999999999, 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.144 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32910 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833056+0000", 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833056+0000", 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833057+0000", 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.37e-07 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833059+0000", 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.497e-06 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833066+0000", 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2910000000000002e-06 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833072+0000", 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6849999999999998e-06 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.147 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32942 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834081+0000", 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022562678999999999, 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028785886, 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32942 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834081+0000", 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834081+0000", 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834082+0000", 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1999999999999998e-07 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834084+0000", 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.446e-06 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834092+0000", 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0409999999999998e-06 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834098+0000", 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5679999999999999e-06 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32974 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835057+0000", 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021586236000000002, 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027924832, 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32974 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835057+0000", 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835057+0000", 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835058+0000", 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7199999999999999e-07 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835065+0000", 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5240000000000003e-06 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835073+0000", 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.289e-06 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835078+0000", 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3199999999999999e-06 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33006 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835955+0000", 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020688246, 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027241894999999999, 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33006 2024-09-14T08:41:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835955+0000", 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835955+0000", 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835956+0000", 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835958+0000", 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2859999999999998e-06 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835965+0000", 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5100000000000004e-06 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835970+0000", 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1170000000000003e-06 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.159 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33038 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836806+0000", 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019837922000000001, 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026449568999999999, 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33038 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.160 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836806+0000", 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836806+0000", 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836806+0000", 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4400000000000001e-07 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836808+0000", 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3240000000000001e-06 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836817+0000", 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9539999999999993e-06 2024-09-14T08:41:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836823+0000", 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3859999999999998e-06 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33070 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844757+0000", 2024-09-14T08:41:48.163 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0118862, 2024-09-14T08:41:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018557068999999999, 2024-09-14T08:41:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33070 2024-09-14T08:41:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.164 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844757+0000", 2024-09-14T08:41:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844757+0000", 2024-09-14T08:41:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844758+0000", 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8100000000000003e-07 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844760+0000", 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.418e-06 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844768+0000", 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5750000000000003e-06 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844773+0000", 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4979999999999997e-06 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33102 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852912+0000", 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003731982, 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010458142, 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.168 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33102 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852912+0000", 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852912+0000", 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852912+0000", 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8999999999999996e-07 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852914+0000", 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1940000000000001e-06 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852924+0000", 2024-09-14T08:41:48.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3060000000000003e-06 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852930+0000", 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4969999999999998e-06 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32911 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.171 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833081+0000", 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0235626, 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.030349358, 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32911 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833081+0000", 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833081+0000", 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833082+0000", 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833084+0000", 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2800000000000002e-06 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833091+0000", 2024-09-14T08:41:48.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0110000000000003e-06 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833097+0000", 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6489999999999996e-06 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.175 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32943 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834106+0000", 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022537214999999999, 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029379265000000002, 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32943 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.176 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834106+0000", 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834106+0000", 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834107+0000", 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3099999999999997e-07 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834110+0000", 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4339999999999999e-06 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834117+0000", 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3819999999999998e-06 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834122+0000", 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2480000000000004e-06 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32975 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835089+0000", 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021554841000000002, 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028492956, 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.179 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32975 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835089+0000", 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835089+0000", 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835089+0000", 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7300000000000001e-07 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835092+0000", 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835098+0000", 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2859999999999996e-06 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835103+0000", 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1710000000000001e-06 2024-09-14T08:41:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33007 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835977+0000", 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020666757000000001, 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027725222000000001, 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33007 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835977+0000", 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835977+0000", 2024-09-14T08:41:48.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835977+0000", 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8599999999999998e-07 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835979+0000", 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.204e-06 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835986+0000", 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9129999999999997e-06 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835992+0000", 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.609e-06 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33039 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836833+0000", 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019810775999999999, 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026987114999999999, 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33039 2024-09-14T08:41:48.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836833+0000", 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836833+0000", 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836833+0000", 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836836+0000", 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4059999999999999e-06 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836842+0000", 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4130000000000003e-06 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836848+0000", 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0299999999999999e-06 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33071 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844781+0000", 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011862348999999999, 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019159480999999999, 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33071 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.191 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844781+0000", 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844781+0000", 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844782+0000", 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844784+0000", 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2479999999999999e-06 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844790+0000", 2024-09-14T08:41:48.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5889999999999999e-06 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844796+0000", 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2490000000000001e-06 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.194 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33103 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852938+0000", 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0037055270000000001, 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01110965, 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33103 2024-09-14T08:41:48.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852938+0000", 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852938+0000", 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852939+0000", 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-07 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852941+0000", 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2689999999999998e-06 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852948+0000", 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7580000000000003e-06 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852953+0000", 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4519999999999996e-06 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32912 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833106+0000", 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023537939000000001, 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031006789999999999, 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32912 2024-09-14T08:41:48.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833106+0000", 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833106+0000", 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833106+0000", 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000003e-07 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833109+0000", 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833116+0000", 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.046e-06 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833128+0000", 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2378000000000001e-05 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.202 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32944 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834148+0000", 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022495586000000001, 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.030020444, 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32944 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834148+0000", 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834148+0000", 2024-09-14T08:41:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834149+0000", 2024-09-14T08:41:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834151+0000", 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6989999999999999e-06 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834159+0000", 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0309999999999998e-06 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834167+0000", 2024-09-14T08:41:48.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8839999999999994e-06 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32976 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835120+0000", 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021523448000000001, 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029106614999999999, 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.207 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32976 2024-09-14T08:41:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835120+0000", 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835120+0000", 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835121+0000", 2024-09-14T08:41:48.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835123+0000", 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4499999999999998e-06 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835130+0000", 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.956e-06 2024-09-14T08:41:48.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835135+0000", 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33008 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835999+0000", 2024-09-14T08:41:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020644134000000001, 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028282721, 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33008 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835999+0000", 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835999+0000", 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836000+0000", 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.08e-07 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836002+0000", 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.052e-06 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836010+0000", 2024-09-14T08:41:48.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1189999999999997e-06 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836015+0000", 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4199999999999998e-06 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33040 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.215 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836856+0000", 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019787299000000001, 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027491824000000002, 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33040 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.216 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836856+0000", 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836856+0000", 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836857+0000", 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836859+0000", 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.402e-06 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836880+0000", 2024-09-14T08:41:48.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1015000000000001e-05 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836893+0000", 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2539e-05 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33072 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844809+0000", 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011834505, 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01961707, 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33072 2024-09-14T08:41:48.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844809+0000", 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844809+0000", 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844810+0000", 2024-09-14T08:41:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6899999999999998e-07 2024-09-14T08:41:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844812+0000", 2024-09-14T08:41:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-14T08:41:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844822+0000", 2024-09-14T08:41:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0237e-05 2024-09-14T08:41:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844828+0000", 2024-09-14T08:41:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33104 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852961+0000", 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003682201, 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011538292, 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.229 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33104 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852961+0000", 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852961+0000", 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852962+0000", 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852964+0000", 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3779999999999999e-06 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852971+0000", 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8719999999999996e-06 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852977+0000", 2024-09-14T08:41:48.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0209999999999996e-06 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32913 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833141+0000", 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023503025, 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031474288000000003, 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32913 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833141+0000", 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833141+0000", 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833141+0000", 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2300000000000001e-07 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833144+0000", 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.666e-06 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833151+0000", 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1720000000000001e-06 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833157+0000", 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8309999999999997e-06 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32945 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834188+0000", 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022455426000000001, 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.030548951000000001, 2024-09-14T08:41:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32945 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834188+0000", 2024-09-14T08:41:48.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834188+0000", 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834189+0000", 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7800000000000001e-07 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834192+0000", 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.632e-06 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834199+0000", 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8809999999999996e-06 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834205+0000", 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.665e-06 2024-09-14T08:41:48.240 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32977 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835143+0000", 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021500400999999999, 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029710637000000002, 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.241 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32977 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835143+0000", 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835143+0000", 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835144+0000", 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835146+0000", 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835156+0000", 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7389999999999994e-06 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835162+0000", 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1580000000000002e-06 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33009 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836022+0000", 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020621276000000001, 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028953067999999998, 2024-09-14T08:41:48.245 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33009 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836022+0000", 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836022+0000", 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836023+0000", 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8299999999999998e-07 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836025+0000", 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9929999999999998e-06 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836033+0000", 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0039999999999999e-06 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836038+0000", 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1240000000000004e-06 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33041 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836909+0000", 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019734122999999999, 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028142106, 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33041 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836909+0000", 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836909+0000", 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836910+0000", 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6300000000000005e-07 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836913+0000", 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7e-06 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836920+0000", 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3170000000000004e-06 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836926+0000", 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4829999999999999e-06 2024-09-14T08:41:48.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33073 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844835+0000", 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011808156, 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020273057000000001, 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33073 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844835+0000", 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844835+0000", 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844836+0000", 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9999999999999998e-07 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844838+0000", 2024-09-14T08:41:48.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4499999999999998e-06 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844845+0000", 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4540000000000004e-06 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844850+0000", 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1340000000000003e-06 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.256 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33105 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.852987+0000", 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0036566459999999999, 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012181200999999999, 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.257 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33105 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852987+0000", 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852987+0000", 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852987+0000", 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852995+0000", 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7069999999999992e-06 2024-09-14T08:41:48.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853003+0000", 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3299999999999999e-06 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853011+0000", 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3919999999999997e-06 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.260 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32914 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833167+0000", 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023476273999999998, 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.032057906999999997, 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.261 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32914 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833167+0000", 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833167+0000", 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833168+0000", 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3300000000000001e-07 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833171+0000", 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4540000000000001e-06 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833178+0000", 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1760000000000004e-06 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833183+0000", 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.643e-06 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32946 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834231+0000", 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022412898000000001, 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031053946999999998, 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32946 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834231+0000", 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834231+0000", 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834231+0000", 2024-09-14T08:41:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:41:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834234+0000", 2024-09-14T08:41:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.694e-06 2024-09-14T08:41:48.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834242+0000", 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6760000000000007e-06 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834249+0000", 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.114e-06 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.268 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32978 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835170+0000", 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021473560999999999, 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.030178097000000001, 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32978 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835170+0000", 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835170+0000", 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835171+0000", 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0299999999999999e-07 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835173+0000", 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3980000000000002e-06 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835182+0000", 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835188+0000", 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.519e-06 2024-09-14T08:41:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33010 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836046+0000", 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020597643999999998, 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029425506000000001, 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.273 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33010 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836046+0000", 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836046+0000", 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836046+0000", 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836064+0000", 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7249999999999999e-05 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836074+0000", 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0587999999999999e-05 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836080+0000", 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1800000000000001e-06 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33042 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836934+0000", 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019709072000000001, 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028652212, 2024-09-14T08:41:48.277 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33042 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836934+0000", 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836934+0000", 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836935+0000", 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836937+0000", 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2800000000000002e-06 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836944+0000", 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6760000000000001e-06 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836949+0000", 2024-09-14T08:41:48.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9740000000000001e-06 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33074 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844858+0000", 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011785491, 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020850266999999999, 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.281 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33074 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844858+0000", 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844858+0000", 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844859+0000", 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2099999999999996e-07 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844861+0000", 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5390000000000002e-06 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844869+0000", 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6399999999999997e-06 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844874+0000", 2024-09-14T08:41:48.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.113e-06 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33106 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853027+0000", 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003616462, 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012796711000000001, 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.285 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33106 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853027+0000", 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853027+0000", 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853028+0000", 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0699999999999997e-07 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853030+0000", 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4590000000000001e-06 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853038+0000", 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5299999999999999e-06 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853050+0000", 2024-09-14T08:41:48.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1834000000000001e-05 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32915 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833192+0000", 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023451713999999999, 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.03271392, 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.289 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32915 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833192+0000", 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833192+0000", 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833193+0000", 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0500000000000003e-07 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833199+0000", 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9430000000000003e-06 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833210+0000", 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-05 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833216+0000", 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1519999999999997e-06 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32947 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834269+0000", 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022374316000000002, 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031693183, 2024-09-14T08:41:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32947 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834269+0000", 2024-09-14T08:41:48.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834269+0000", 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834270+0000", 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999998e-07 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834273+0000", 2024-09-14T08:41:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6520000000000002e-06 2024-09-14T08:41:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834282+0000", 2024-09-14T08:41:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2620000000000004e-06 2024-09-14T08:41:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834288+0000", 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0560000000000001e-06 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32979 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835196+0000", 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021447712000000001, 2024-09-14T08:41:48.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.030824917, 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32979 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835196+0000", 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835196+0000", 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835196+0000", 2024-09-14T08:41:48.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0999999999999999e-07 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835199+0000", 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.322e-06 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835206+0000", 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8480000000000003e-06 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835211+0000", 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3229999999999997e-06 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33011 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836091+0000", 2024-09-14T08:41:48.301 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020552833999999999, 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029985349000000001, 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33011 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836091+0000", 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836091+0000", 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836091+0000", 2024-09-14T08:41:48.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1799999999999995e-07 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836094+0000", 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6369999999999999e-06 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836103+0000", 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4010000000000003e-06 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836109+0000", 2024-09-14T08:41:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2569999999999998e-06 2024-09-14T08:41:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33043 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.305 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836959+0000", 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019684378999999998, 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029191045999999998, 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33043 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836959+0000", 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836959+0000", 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836960+0000", 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0699999999999997e-07 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836962+0000", 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3929999999999998e-06 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836969+0000", 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0539999999999997e-06 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836974+0000", 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2510000000000002e-06 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.309 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33075 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844890+0000", 2024-09-14T08:41:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011753632, 2024-09-14T08:41:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02137298, 2024-09-14T08:41:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.310 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33075 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844890+0000", 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844890+0000", 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844890+0000", 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5799999999999999e-07 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844893+0000", 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.492e-06 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844900+0000", 2024-09-14T08:41:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3799999999999996e-06 2024-09-14T08:41:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844906+0000", 2024-09-14T08:41:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7039999999999999e-06 2024-09-14T08:41:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33107 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853058+0000", 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0035852369999999998, 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013327129, 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33107 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853058+0000", 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853058+0000", 2024-09-14T08:41:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853059+0000", 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5499999999999998e-07 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853061+0000", 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3750000000000001e-06 2024-09-14T08:41:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853075+0000", 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4018e-05 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853083+0000", 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0940000000000008e-06 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32916 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833226+0000", 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023417581, 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033282002999999998, 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32916 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833226+0000", 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833226+0000", 2024-09-14T08:41:48.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833227+0000", 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6899999999999997e-07 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833229+0000", 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6740000000000001e-06 2024-09-14T08:41:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833237+0000", 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9680000000000006e-06 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833243+0000", 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.395e-06 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32948 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834308+0000", 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022335994000000001, 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.032320604000000003, 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32948 2024-09-14T08:41:48.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834308+0000", 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834308+0000", 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834308+0000", 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.23e-07 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834311+0000", 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8499999999999998e-06 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834319+0000", 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.515e-06 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834325+0000", 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.545e-06 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.325 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32980 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835219+0000", 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021425000999999999, 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031477822000000003, 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32980 2024-09-14T08:41:48.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835219+0000", 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835219+0000", 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835219+0000", 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835221+0000", 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3819999999999998e-06 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835228+0000", 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4529999999999999e-06 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835233+0000", 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.215e-06 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.329 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33012 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836116+0000", 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020527688999999998, 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.030636182000000001, 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33012 2024-09-14T08:41:48.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836116+0000", 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836116+0000", 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836117+0000", 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7100000000000001e-07 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836119+0000", 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2419999999999999e-06 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836125+0000", 2024-09-14T08:41:48.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6850000000000004e-06 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836131+0000", 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3140000000000003e-06 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.333 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33044 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836982+0000", 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019661235999999999, 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029828707999999999, 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33044 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.334 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836982+0000", 2024-09-14T08:41:48.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836982+0000", 2024-09-14T08:41:48.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836983+0000", 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6800000000000001e-07 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836985+0000", 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2220000000000001e-06 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837001+0000", 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5979999999999999e-05 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837007+0000", 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8719999999999999e-06 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33076 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844914+0000", 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011729198, 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021951713000000001, 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.338 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33076 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844914+0000", 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844914+0000", 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844915+0000", 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7199999999999999e-07 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844917+0000", 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2809999999999998e-06 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844925+0000", 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2549999999999997e-06 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844931+0000", 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4049999999999999e-06 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.341 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33108 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853092+0000", 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003551326, 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013832666, 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33108 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.342 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853092+0000", 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853092+0000", 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853093+0000", 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0399999999999995e-07 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853095+0000", 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.435e-06 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853103+0000", 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6769999999999995e-06 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853108+0000", 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32917 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833251+0000", 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023392436999999999, 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033730927000000001, 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.346 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32917 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833251+0000", 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833251+0000", 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833252+0000", 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4600000000000004e-07 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833254+0000", 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3360000000000002e-06 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833261+0000", 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7630000000000003e-06 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833267+0000", 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6740000000000002e-06 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32949 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834348+0000", 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022295237999999998, 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.032710901000000001, 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.350 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32949 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834348+0000", 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834348+0000", 2024-09-14T08:41:48.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834349+0000", 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2900000000000003e-07 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834352+0000", 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6740000000000001e-06 2024-09-14T08:41:48.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834366+0000", 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3833e-05 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834374+0000", 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8210000000000008e-06 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32981 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835240+0000", 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021403272000000001, 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031904851999999997, 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.354 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32981 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835240+0000", 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835240+0000", 2024-09-14T08:41:48.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835241+0000", 2024-09-14T08:41:48.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6899999999999998e-07 2024-09-14T08:41:48.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835243+0000", 2024-09-14T08:41:48.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4669999999999998e-06 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835253+0000", 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5519999999999993e-06 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835258+0000", 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3979999999999998e-06 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.357 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33013 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836138+0000", 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020505392000000001, 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031125661999999998, 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33013 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836138+0000", 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836138+0000", 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836139+0000", 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6600000000000002e-07 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836141+0000", 2024-09-14T08:41:48.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1739999999999999e-06 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836148+0000", 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6989999999999997e-06 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836153+0000", 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3489999999999999e-06 2024-09-14T08:41:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33045 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837015+0000", 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019628178999999999, 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.030364764999999998, 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.362 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33045 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837015+0000", 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837015+0000", 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837016+0000", 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4199999999999996e-07 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837018+0000", 2024-09-14T08:41:48.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.525e-06 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837026+0000", 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1779999999999997e-06 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837031+0000", 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9119999999999997e-06 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33077 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844938+0000", 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011705116, 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022563672999999999, 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33077 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844938+0000", 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844938+0000", 2024-09-14T08:41:48.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844939+0000", 2024-09-14T08:41:48.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:41:48.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844941+0000", 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0789999999999999e-06 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844949+0000", 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.49e-06 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844955+0000", 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33109 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853115+0000", 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0035287000000000001, 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014500768000000001, 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.370 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33109 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853115+0000", 2024-09-14T08:41:48.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853115+0000", 2024-09-14T08:41:48.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853115+0000", 2024-09-14T08:41:48.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5000000000000003e-07 2024-09-14T08:41:48.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853117+0000", 2024-09-14T08:41:48.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0700000000000001e-06 2024-09-14T08:41:48.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853124+0000", 2024-09-14T08:41:48.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3609999999999997e-06 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853129+0000", 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8659999999999997e-06 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.374 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32918 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833277+0000", 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023366692000000001, 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.034406489999999998, 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32918 2024-09-14T08:41:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833277+0000", 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833277+0000", 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833278+0000", 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2099999999999996e-07 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833280+0000", 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833291+0000", 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0721e-05 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833297+0000", 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7989999999999999e-06 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32950 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834385+0000", 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022258994000000001, 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033354544999999999, 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.379 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32950 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834385+0000", 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834385+0000", 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834385+0000", 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9400000000000005e-07 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834388+0000", 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8679999999999999e-06 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834396+0000", 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4109999999999999e-06 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834401+0000", 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5029999999999997e-06 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32982 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835267+0000", 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021376592999999999, 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.032530326999999998, 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32982 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835267+0000", 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835267+0000", 2024-09-14T08:41:48.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835267+0000", 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835270+0000", 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6809999999999998e-06 2024-09-14T08:41:48.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835278+0000", 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0819999999999999e-06 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835285+0000", 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3690000000000003e-06 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.386 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33014 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836161+0000", 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020482646, 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031694200999999998, 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.387 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33014 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836161+0000", 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836161+0000", 2024-09-14T08:41:48.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836161+0000", 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8800000000000002e-07 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836164+0000", 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.34e-06 2024-09-14T08:41:48.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836173+0000", 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3430000000000002e-06 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836178+0000", 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2889999999999997e-06 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33046 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837038+0000", 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019605979999999999, 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.030923103, 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.392 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33046 2024-09-14T08:41:48.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.392 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837038+0000", 2024-09-14T08:41:48.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837038+0000", 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837038+0000", 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.84e-07 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837053+0000", 2024-09-14T08:41:48.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5389000000000001e-05 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837060+0000", 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.934e-06 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837065+0000", 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0370000000000002e-06 2024-09-14T08:41:48.394 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33078 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844962+0000", 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011681067999999999, 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.023102484999999999, 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.395 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33078 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844962+0000", 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844962+0000", 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844963+0000", 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844965+0000", 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844972+0000", 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7139999999999996e-06 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844978+0000", 2024-09-14T08:41:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.207e-06 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33110 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853135+0000", 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0035082059999999998, 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015043086000000001, 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.399 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33110 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853135+0000", 2024-09-14T08:41:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853135+0000", 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853136+0000", 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9999999999999998e-07 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853138+0000", 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2010000000000002e-06 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853145+0000", 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3799999999999996e-06 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853150+0000", 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.045e-06 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32919 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833306+0000", 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023337967000000001, 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035003792999999998, 2024-09-14T08:41:48.403 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32919 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833306+0000", 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833306+0000", 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833306+0000", 2024-09-14T08:41:48.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0400000000000005e-07 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833309+0000", 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4140000000000001e-06 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833316+0000", 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2250000000000003e-06 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833322+0000", 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8409999999999996e-06 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32951 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834424+0000", 2024-09-14T08:41:48.407 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022220050000000002, 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.034020388999999998, 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32951 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834424+0000", 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834424+0000", 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834424+0000", 2024-09-14T08:41:48.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2799999999999995e-07 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834427+0000", 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.022e-06 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834436+0000", 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1999999999999994e-06 2024-09-14T08:41:48.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834441+0000", 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8680000000000004e-06 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32983 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835295+0000", 2024-09-14T08:41:48.411 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021348137, 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033270208000000003, 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32983 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835295+0000", 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835295+0000", 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835296+0000", 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6400000000000003e-07 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835298+0000", 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5150000000000001e-06 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835307+0000", 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8200000000000003e-06 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835313+0000", 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7039999999999999e-06 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33015 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836186+0000", 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020458041, 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.032489843999999997, 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.416 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33015 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836186+0000", 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836186+0000", 2024-09-14T08:41:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836186+0000", 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836188+0000", 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0439999999999998e-06 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836195+0000", 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6359999999999997e-06 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836200+0000", 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2129999999999999e-06 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.419 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33047 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837074+0000", 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019569214000000001, 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.03170593, 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33047 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.420 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837074+0000", 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837074+0000", 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837075+0000", 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837077+0000", 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2029999999999999e-06 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837083+0000", 2024-09-14T08:41:48.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3999999999999997e-06 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837088+0000", 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9010000000000002e-06 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.423 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33079 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.424 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844986+0000", 2024-09-14T08:41:48.424 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011657107999999999, 2024-09-14T08:41:48.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.023900523, 2024-09-14T08:41:48.424 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.424 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.424 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.424 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.424 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.425 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.425 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33079 2024-09-14T08:41:48.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.425 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844986+0000", 2024-09-14T08:41:48.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844986+0000", 2024-09-14T08:41:48.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844987+0000", 2024-09-14T08:41:48.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6699999999999999e-07 2024-09-14T08:41:48.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844989+0000", 2024-09-14T08:41:48.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2000000000000001e-06 2024-09-14T08:41:48.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844997+0000", 2024-09-14T08:41:48.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8250000000000005e-06 2024-09-14T08:41:48.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845002+0000", 2024-09-14T08:41:48.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3800000000000002e-06 2024-09-14T08:41:48.428 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.428 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.429 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.429 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33111 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.429 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853157+0000", 2024-09-14T08:41:48.429 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0034862080000000002, 2024-09-14T08:41:48.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015848922000000001, 2024-09-14T08:41:48.429 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.429 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33111 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853157+0000", 2024-09-14T08:41:48.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853157+0000", 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853158+0000", 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1099999999999996e-07 2024-09-14T08:41:48.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853160+0000", 2024-09-14T08:41:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3649999999999998e-06 2024-09-14T08:41:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853169+0000", 2024-09-14T08:41:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2550000000000003e-06 2024-09-14T08:41:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853175+0000", 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.344e-06 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32920 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.433 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833330+0000", 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023313178, 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035795314000000002, 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32920 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833330+0000", 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833330+0000", 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833331+0000", 2024-09-14T08:41:48.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6700000000000003e-07 2024-09-14T08:41:48.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833333+0000", 2024-09-14T08:41:48.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3329999999999999e-06 2024-09-14T08:41:48.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833343+0000", 2024-09-14T08:41:48.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7259999999999997e-06 2024-09-14T08:41:48.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833349+0000", 2024-09-14T08:41:48.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.083e-06 2024-09-14T08:41:48.437 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.437 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.437 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32952 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834451+0000", 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022192841000000001, 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035096546999999999, 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32952 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834451+0000", 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834451+0000", 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834451+0000", 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834454+0000", 2024-09-14T08:41:48.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6280000000000001e-06 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834461+0000", 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6830000000000002e-06 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834467+0000", 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.441 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.442 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32984 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.442 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835335+0000", 2024-09-14T08:41:48.442 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021308113, 2024-09-14T08:41:48.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.034273413000000003, 2024-09-14T08:41:48.442 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32984 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835335+0000", 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835335+0000", 2024-09-14T08:41:48.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835336+0000", 2024-09-14T08:41:48.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:41:48.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835339+0000", 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6199999999999999e-06 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835348+0000", 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7410000000000004e-06 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835354+0000", 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9560000000000002e-06 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33016 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836208+0000", 2024-09-14T08:41:48.446 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020435651999999999, 2024-09-14T08:41:48.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033461235999999998, 2024-09-14T08:41:48.447 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.447 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.447 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.447 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33016 2024-09-14T08:41:48.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.447 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836208+0000", 2024-09-14T08:41:48.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836208+0000", 2024-09-14T08:41:48.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836208+0000", 2024-09-14T08:41:48.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3799999999999998e-07 2024-09-14T08:41:48.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836211+0000", 2024-09-14T08:41:48.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2520000000000002e-06 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836228+0000", 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7520000000000002e-05 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836234+0000", 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8860000000000001e-06 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.450 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33048 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837095+0000", 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019548085999999999, 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.032629586000000002, 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.451 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.452 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.452 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.452 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33048 2024-09-14T08:41:48.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.452 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837095+0000", 2024-09-14T08:41:48.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837095+0000", 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837096+0000", 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5000000000000001e-07 2024-09-14T08:41:48.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837099+0000", 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2539999999999999e-06 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837104+0000", 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8660000000000002e-06 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837110+0000", 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1900000000000003e-06 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33080 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845011+0000", 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011632180000000001, 2024-09-14T08:41:48.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024772341, 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33080 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845011+0000", 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845011+0000", 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845012+0000", 2024-09-14T08:41:48.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2399999999999999e-07 2024-09-14T08:41:48.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845014+0000", 2024-09-14T08:41:48.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2249999999999999e-06 2024-09-14T08:41:48.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845021+0000", 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5119999999999997e-06 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845026+0000", 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2120000000000002e-06 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33112 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853185+0000", 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0034583629999999999, 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016654584, 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.460 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33112 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853185+0000", 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853185+0000", 2024-09-14T08:41:48.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853186+0000", 2024-09-14T08:41:48.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5599999999999995e-07 2024-09-14T08:41:48.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853188+0000", 2024-09-14T08:41:48.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5450000000000002e-06 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853195+0000", 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9290000000000001e-06 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853201+0000", 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5060000000000003e-06 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32921 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833371+0000", 2024-09-14T08:41:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023272535, 2024-09-14T08:41:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036547154999999998, 2024-09-14T08:41:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32921 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833371+0000", 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833371+0000", 2024-09-14T08:41:48.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833372+0000", 2024-09-14T08:41:48.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:41:48.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833374+0000", 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6249999999999999e-06 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833382+0000", 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9270000000000005e-06 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833388+0000", 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8170000000000004e-06 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32953 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834475+0000", 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022168796000000001, 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035551405000000001, 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.468 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32953 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834475+0000", 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834475+0000", 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834475+0000", 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7999999999999996e-07 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834478+0000", 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6520000000000002e-06 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834485+0000", 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6340000000000003e-06 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834490+0000", 2024-09-14T08:41:48.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5199999999999997e-06 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32985 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835364+0000", 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021279860000000001, 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.034725592, 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.472 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32985 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835364+0000", 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835364+0000", 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835364+0000", 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835367+0000", 2024-09-14T08:41:48.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5239999999999999e-06 2024-09-14T08:41:48.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835374+0000", 2024-09-14T08:41:48.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0609999999999998e-06 2024-09-14T08:41:48.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835379+0000", 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4060000000000004e-06 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33017 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836241+0000", 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020402158, 2024-09-14T08:41:48.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033904113, 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33017 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836241+0000", 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836241+0000", 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836242+0000", 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9900000000000001e-07 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836244+0000", 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1780000000000002e-06 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836251+0000", 2024-09-14T08:41:48.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.562e-06 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836256+0000", 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0679999999999996e-06 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.480 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33049 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837129+0000", 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019514502, 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033073714999999997, 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33049 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.481 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837129+0000", 2024-09-14T08:41:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837129+0000", 2024-09-14T08:41:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837130+0000", 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837132+0000", 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.588e-06 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837139+0000", 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5899999999999996e-06 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837144+0000", 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0690000000000001e-06 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.485 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33081 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.485 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845034+0000", 2024-09-14T08:41:48.485 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011609695, 2024-09-14T08:41:48.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025227639, 2024-09-14T08:41:48.485 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.485 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.485 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33081 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845034+0000", 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845034+0000", 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845034+0000", 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1600000000000002e-07 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845051+0000", 2024-09-14T08:41:48.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7156e-05 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845061+0000", 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.781e-06 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845067+0000", 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.976e-06 2024-09-14T08:41:48.488 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33113 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853208+0000", 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0034357429999999998, 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017110177000000001, 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.489 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33113 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853208+0000", 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853208+0000", 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853208+0000", 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9999999999999998e-07 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853210+0000", 2024-09-14T08:41:48.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1909999999999999e-06 2024-09-14T08:41:48.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853220+0000", 2024-09-14T08:41:48.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5489999999999995e-06 2024-09-14T08:41:48.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853225+0000", 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4439999999999999e-06 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32922 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833399+0000", 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023244398999999999, 2024-09-14T08:41:48.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036990591000000003, 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32922 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833399+0000", 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833399+0000", 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833400+0000", 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6000000000000003e-07 2024-09-14T08:41:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833402+0000", 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3259999999999998e-06 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833410+0000", 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833415+0000", 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9139999999999996e-06 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32954 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834511+0000", 2024-09-14T08:41:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022132493, 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035972743000000001, 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32954 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834511+0000", 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834511+0000", 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834512+0000", 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8700000000000004e-07 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834515+0000", 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.711e-06 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834525+0000", 2024-09-14T08:41:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.045e-05 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834531+0000", 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8819999999999998e-06 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32986 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835387+0000", 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021256318, 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035162811000000002, 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32986 2024-09-14T08:41:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835387+0000", 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835387+0000", 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835388+0000", 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4300000000000003e-07 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835395+0000", 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1389999999999998e-06 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835402+0000", 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3379999999999999e-06 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835408+0000", 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8590000000000001e-06 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33018 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836262+0000", 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020381667999999999, 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.034343572000000003, 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33018 2024-09-14T08:41:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836262+0000", 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836262+0000", 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836262+0000", 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1300000000000001e-07 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836264+0000", 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0660000000000002e-06 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836271+0000", 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.28e-06 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836276+0000", 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8999999999999997e-06 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33050 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837151+0000", 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019492290999999998, 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033513793, 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33050 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837151+0000", 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837151+0000", 2024-09-14T08:41:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837152+0000", 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.13e-07 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837154+0000", 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9630000000000001e-06 2024-09-14T08:41:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837166+0000", 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2403e-05 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837171+0000", 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.006e-06 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33082 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845090+0000", 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011553505, 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02563472, 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33082 2024-09-14T08:41:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845090+0000", 2024-09-14T08:41:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845090+0000", 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845091+0000", 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999998e-07 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845093+0000", 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5770000000000001e-06 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845101+0000", 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7470000000000005e-06 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845107+0000", 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8719999999999999e-06 2024-09-14T08:41:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33114 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853233+0000", 2024-09-14T08:41:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0034106079999999999, 2024-09-14T08:41:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017550546, 2024-09-14T08:41:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33114 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853233+0000", 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853233+0000", 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853233+0000", 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3300000000000003e-07 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853236+0000", 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3599999999999999e-06 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853251+0000", 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5688e-05 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853259+0000", 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9519999999999994e-06 2024-09-14T08:41:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32923 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833424+0000", 2024-09-14T08:41:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023219834000000002, 2024-09-14T08:41:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.037428399000000001, 2024-09-14T08:41:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32923 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833424+0000", 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833424+0000", 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833424+0000", 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999998e-07 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833427+0000", 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.278e-06 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833434+0000", 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8719999999999996e-06 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833442+0000", 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2139999999999996e-06 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32955 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834556+0000", 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022087809, 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.03641113, 2024-09-14T08:41:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32955 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834556+0000", 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834556+0000", 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834556+0000", 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1500000000000004e-07 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834559+0000", 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7e-06 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834568+0000", 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4060000000000005e-06 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834576+0000", 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9440000000000005e-06 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32987 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835417+0000", 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021226667000000001, 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035626679000000001, 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32987 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835417+0000", 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835417+0000", 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835417+0000", 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7100000000000002e-07 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835420+0000", 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.368e-06 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835430+0000", 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0081000000000001e-05 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835435+0000", 2024-09-14T08:41:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6230000000000002e-06 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33019 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836282+0000", 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020361856000000001, 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.034824182000000002, 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33019 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836282+0000", 2024-09-14T08:41:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836282+0000", 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836282+0000", 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2e-07 2024-09-14T08:41:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836284+0000", 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.951e-06 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836292+0000", 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5920000000000003e-06 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836297+0000", 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1789999999999999e-06 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33051 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837179+0000", 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019464367, 2024-09-14T08:41:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.033982857999999998, 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33051 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837179+0000", 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837179+0000", 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837180+0000", 2024-09-14T08:41:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6899999999999998e-07 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837182+0000", 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4420000000000001e-06 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837190+0000", 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6029999999999999e-06 2024-09-14T08:41:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837202+0000", 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.234e-05 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33083 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845121+0000", 2024-09-14T08:41:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011522479, 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026096706000000001, 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33083 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845121+0000", 2024-09-14T08:41:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845121+0000", 2024-09-14T08:41:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845122+0000", 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6499999999999999e-07 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845124+0000", 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5780000000000001e-06 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845134+0000", 2024-09-14T08:41:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5580000000000006e-06 2024-09-14T08:41:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845140+0000", 2024-09-14T08:41:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0140000000000004e-06 2024-09-14T08:41:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33115 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853271+0000", 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0033729680000000001, 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018010470000000001, 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33115 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853271+0000", 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853271+0000", 2024-09-14T08:41:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853271+0000", 2024-09-14T08:41:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9599999999999999e-07 2024-09-14T08:41:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853274+0000", 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4449999999999999e-06 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853280+0000", 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8379999999999996e-06 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853286+0000", 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0730000000000001e-06 2024-09-14T08:41:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32924 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833451+0000", 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023192846999999999, 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.037898596999999999, 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32924 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833451+0000", 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833451+0000", 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833451+0000", 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.37e-07 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833454+0000", 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.289e-06 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833461+0000", 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1110000000000002e-06 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833466+0000", 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.536e-06 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32956 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834584+0000", 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022059644, 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036860632999999997, 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32956 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834584+0000", 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834584+0000", 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834585+0000", 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3399999999999998e-07 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834587+0000", 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.39e-06 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834593+0000", 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4010000000000002e-06 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834599+0000", 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.169e-06 2024-09-14T08:41:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32988 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835446+0000", 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.02119708, 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036055467000000001, 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32988 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835446+0000", 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835446+0000", 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835447+0000", 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3600000000000004e-07 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835449+0000", 2024-09-14T08:41:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.446e-06 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835466+0000", 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6901999999999998e-05 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835473+0000", 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3509999999999998e-06 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33020 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836306+0000", 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020337794999999999, 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035256031, 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33020 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836306+0000", 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836306+0000", 2024-09-14T08:41:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836306+0000", 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.01e-07 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836308+0000", 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0439999999999998e-06 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836317+0000", 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.721e-06 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836322+0000", 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8420000000000004e-06 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33052 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837211+0000", 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019432667000000001, 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.034406957000000002, 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33052 2024-09-14T08:41:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837211+0000", 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837211+0000", 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837211+0000", 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8299999999999997e-07 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837214+0000", 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.712e-06 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837221+0000", 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6170000000000003e-06 2024-09-14T08:41:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837226+0000", 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1830000000000002e-06 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33084 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845149+0000", 2024-09-14T08:41:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011494545, 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026527123, 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33084 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845149+0000", 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845149+0000", 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845150+0000", 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.06e-07 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845152+0000", 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4449999999999999e-06 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845161+0000", 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845167+0000", 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4650000000000002e-06 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33116 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853297+0000", 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0033464369999999998, 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018434763, 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33116 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853297+0000", 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853297+0000", 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853298+0000", 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.06e-07 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853300+0000", 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3470000000000001e-06 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853313+0000", 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3052e-05 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853319+0000", 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6840000000000001e-06 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32925 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833495+0000", 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023148775999999999, 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.038311109000000003, 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32925 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833495+0000", 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833495+0000", 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833495+0000", 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.06e-07 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833498+0000", 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5289999999999998e-06 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833509+0000", 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1052e-05 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833515+0000", 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.28e-06 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32957 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834606+0000", 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022037705000000001, 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.037282734999999997, 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32957 2024-09-14T08:41:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834606+0000", 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834606+0000", 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834606+0000", 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.82e-07 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834609+0000", 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3190000000000002e-06 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834615+0000", 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4649999999999999e-06 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834620+0000", 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8219999999999997e-06 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32989 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835482+0000", 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021161744, 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036469437, 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32989 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835482+0000", 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835482+0000", 2024-09-14T08:41:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835482+0000", 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6599999999999996e-07 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835485+0000", 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.542e-06 2024-09-14T08:41:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835499+0000", 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4493e-05 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835505+0000", 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.02e-06 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33021 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836328+0000", 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020315617000000001, 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035680522999999999, 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33021 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836328+0000", 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836328+0000", 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836328+0000", 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9099999999999999e-07 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836330+0000", 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0439999999999998e-06 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836338+0000", 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3019999999999997e-06 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836343+0000", 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0579999999999997e-06 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33053 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837233+0000", 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019410707999999999, 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.034836934, 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33053 2024-09-14T08:41:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837233+0000", 2024-09-14T08:41:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837233+0000", 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837233+0000", 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.08e-07 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837236+0000", 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4889999999999998e-06 2024-09-14T08:41:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837243+0000", 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4150000000000002e-06 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837251+0000", 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7190000000000001e-06 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33085 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845176+0000", 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011467122, 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026950505999999999, 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33085 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845176+0000", 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845176+0000", 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845177+0000", 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4300000000000003e-07 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845179+0000", 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3140000000000002e-06 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845186+0000", 2024-09-14T08:41:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9e-06 2024-09-14T08:41:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845191+0000", 2024-09-14T08:41:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2329999999999997e-06 2024-09-14T08:41:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33117 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853327+0000", 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0033168249999999998, 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018858686999999999, 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33117 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853327+0000", 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853327+0000", 2024-09-14T08:41:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853327+0000", 2024-09-14T08:41:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2199999999999999e-07 2024-09-14T08:41:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853344+0000", 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6761000000000001e-05 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853352+0000", 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2959999999999999e-06 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853357+0000", 2024-09-14T08:41:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2390000000000002e-06 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32926 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833539+0000", 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.02310481, 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.038716264, 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32926 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833539+0000", 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833539+0000", 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833540+0000", 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1900000000000001e-07 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833542+0000", 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6649999999999999e-06 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833551+0000", 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8070000000000006e-06 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833564+0000", 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2926e-05 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32958 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834627+0000", 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022016252, 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.037713343000000003, 2024-09-14T08:41:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32958 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834627+0000", 2024-09-14T08:41:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834627+0000", 2024-09-14T08:41:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834628+0000", 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1899999999999998e-07 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834630+0000", 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3e-06 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834637+0000", 2024-09-14T08:41:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6039999999999998e-06 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834642+0000", 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9339999999999997e-06 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32990 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835519+0000", 2024-09-14T08:41:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021124653, 2024-09-14T08:41:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036901477000000002, 2024-09-14T08:41:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32990 2024-09-14T08:41:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835519+0000", 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835519+0000", 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835519+0000", 2024-09-14T08:41:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6700000000000003e-07 2024-09-14T08:41:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835522+0000", 2024-09-14T08:41:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7039999999999999e-06 2024-09-14T08:41:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835532+0000", 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4739999999999994e-06 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835537+0000", 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5829999999999997e-06 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.619 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33022 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.619 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836350+0000", 2024-09-14T08:41:48.619 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020293499, 2024-09-14T08:41:48.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036126625000000002, 2024-09-14T08:41:48.619 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.619 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.619 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.619 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.619 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33022 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836350+0000", 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836350+0000", 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836351+0000", 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0999999999999998e-07 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836364+0000", 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3492999999999999e-05 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836386+0000", 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1352000000000002e-05 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836392+0000", 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.477e-06 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33054 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837259+0000", 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019384933, 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035277462000000002, 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33054 2024-09-14T08:41:48.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837259+0000", 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837259+0000", 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837259+0000", 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4099999999999999e-07 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837261+0000", 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2089999999999999e-06 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837270+0000", 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3210000000000005e-06 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837274+0000", 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8940000000000001e-06 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33086 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845200+0000", 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011443505, 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027392738, 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.627 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33086 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845200+0000", 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845200+0000", 2024-09-14T08:41:48.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845201+0000", 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0699999999999997e-07 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845203+0000", 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2589999999999999e-06 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845209+0000", 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5799999999999997e-06 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845215+0000", 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2469999999999999e-06 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.630 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33118 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853381+0000", 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003262137, 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019272758000000001, 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33118 2024-09-14T08:41:48.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853381+0000", 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853381+0000", 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853382+0000", 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1100000000000005e-07 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853385+0000", 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7460000000000001e-06 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853395+0000", 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5489999999999995e-06 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853400+0000", 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7180000000000001e-06 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32927 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833593+0000", 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023050985999999999, 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.039130122000000003, 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.635 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32927 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833593+0000", 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833593+0000", 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833593+0000", 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7100000000000001e-07 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833601+0000", 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1919999999999999e-06 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833609+0000", 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9649999999999997e-06 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833616+0000", 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.528e-06 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32959 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834649+0000", 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021995016999999999, 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.038160589000000002, 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.639 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32959 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834649+0000", 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834649+0000", 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834649+0000", 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.03e-07 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834651+0000", 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2730000000000001e-06 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834657+0000", 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9449999999999998e-06 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834662+0000", 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.967e-06 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.642 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32991 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835546+0000", 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021097635999999999, 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.037322511000000003, 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32991 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.643 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835546+0000", 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835546+0000", 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835546+0000", 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5000000000000003e-07 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835549+0000", 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5919999999999999e-06 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835556+0000", 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835561+0000", 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3580000000000002e-06 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33023 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836409+0000", 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020235027999999999, 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036518724000000002, 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.647 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33023 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836409+0000", 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836409+0000", 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836409+0000", 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3e-07 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836412+0000", 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0850000000000001e-06 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836421+0000", 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2530000000000004e-06 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836426+0000", 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5679999999999999e-06 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33055 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837281+0000", 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019362477999999999, 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.035701929, 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33055 2024-09-14T08:41:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837281+0000", 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837281+0000", 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837282+0000", 2024-09-14T08:41:48.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6899999999999998e-07 2024-09-14T08:41:48.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837284+0000", 2024-09-14T08:41:48.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0499999999999999e-06 2024-09-14T08:41:48.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837289+0000", 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7409999999999998e-06 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837295+0000", 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6699999999999999e-06 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.654 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33087 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845222+0000", 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011421358, 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027818836999999999, 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33087 2024-09-14T08:41:48.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845222+0000", 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845222+0000", 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845223+0000", 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7899999999999999e-07 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845225+0000", 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1270000000000001e-06 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845232+0000", 2024-09-14T08:41:48.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0140000000000001e-06 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845238+0000", 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2779999999999999e-06 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33119 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853409+0000", 2024-09-14T08:41:48.658 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0032346150000000001, 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019687177, 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33119 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853409+0000", 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853409+0000", 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853410+0000", 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0299999999999999e-07 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853412+0000", 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.548e-06 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853422+0000", 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8279999999999998e-06 2024-09-14T08:41:48.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853427+0000", 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5130000000000004e-06 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32928 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833638+0000", 2024-09-14T08:41:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.023005078000000002, 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.039529950000000001, 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32928 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833638+0000", 2024-09-14T08:41:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833638+0000", 2024-09-14T08:41:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833639+0000", 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8100000000000002e-07 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833642+0000", 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7489999999999999e-06 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833650+0000", 2024-09-14T08:41:48.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6639999999999998e-06 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833659+0000", 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0110000000000006e-06 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32960 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834670+0000", 2024-09-14T08:41:48.666 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021973381, 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.038582850000000002, 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32960 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834670+0000", 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834670+0000", 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834671+0000", 2024-09-14T08:41:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3699999999999999e-07 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834674+0000", 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8439999999999998e-06 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834680+0000", 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9070000000000004e-06 2024-09-14T08:41:48.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834685+0000", 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3079999999999998e-06 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32992 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835572+0000", 2024-09-14T08:41:48.670 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021071274000000001, 2024-09-14T08:41:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.037743653000000002, 2024-09-14T08:41:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32992 2024-09-14T08:41:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.671 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835572+0000", 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835572+0000", 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835573+0000", 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.82e-07 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835575+0000", 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3769999999999999e-06 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835583+0000", 2024-09-14T08:41:48.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1159999999999999e-06 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835589+0000", 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6350000000000003e-06 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33024 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836441+0000", 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020202749999999998, 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036930971999999999, 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33024 2024-09-14T08:41:48.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836441+0000", 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836441+0000", 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836441+0000", 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8599999999999998e-07 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836444+0000", 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5600000000000001e-06 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836457+0000", 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3591000000000001e-05 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836463+0000", 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33056 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837331+0000", 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019313048999999999, 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036096701000000002, 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33056 2024-09-14T08:41:48.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837331+0000", 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837331+0000", 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837331+0000", 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5000000000000002e-07 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837334+0000", 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9119999999999998e-06 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837342+0000", 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6899999999999992e-06 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837348+0000", 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8640000000000001e-06 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.682 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33088 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845250+0000", 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011393334999999999, 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028235429999999999, 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33088 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845250+0000", 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845250+0000", 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845251+0000", 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0299999999999999e-07 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845253+0000", 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2510000000000001e-06 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845260+0000", 2024-09-14T08:41:48.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0790000000000003e-06 2024-09-14T08:41:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845267+0000", 2024-09-14T08:41:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3799999999999996e-06 2024-09-14T08:41:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33120 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853435+0000", 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003208851, 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020106160000000001, 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33120 2024-09-14T08:41:48.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853435+0000", 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853435+0000", 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853435+0000", 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2799999999999996e-07 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853437+0000", 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2060000000000001e-06 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853444+0000", 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3040000000000001e-06 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853449+0000", 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.690 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32929 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833670+0000", 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022973304999999999, 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.039942774, 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32929 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.691 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833670+0000", 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833670+0000", 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833671+0000", 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9500000000000001e-07 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833674+0000", 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.492e-06 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833681+0000", 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1849999999999998e-06 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833686+0000", 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.609e-06 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.694 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32961 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834695+0000", 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021948257999999998, 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.039005546000000002, 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32961 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.695 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834695+0000", 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834695+0000", 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834696+0000", 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.68e-07 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834699+0000", 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.678e-06 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834706+0000", 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4080000000000001e-06 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834711+0000", 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2360000000000004e-06 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32993 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.698 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835597+0000", 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021046276999999999, 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.038214019000000002, 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32993 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835597+0000", 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835597+0000", 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835598+0000", 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0800000000000004e-07 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835600+0000", 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.334e-06 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835607+0000", 2024-09-14T08:41:48.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5869999999999998e-06 2024-09-14T08:41:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835612+0000", 2024-09-14T08:41:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3619999999999997e-06 2024-09-14T08:41:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33025 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836474+0000", 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020169899000000002, 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.037446632000000001, 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.703 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33025 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836474+0000", 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836474+0000", 2024-09-14T08:41:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836474+0000", 2024-09-14T08:41:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6199999999999998e-07 2024-09-14T08:41:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836476+0000", 2024-09-14T08:41:48.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2819999999999999e-06 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836483+0000", 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2639999999999997e-06 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836488+0000", 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9479999999999999e-06 2024-09-14T08:41:48.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33057 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837359+0000", 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019285014999999999, 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.036642972000000003, 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33057 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837359+0000", 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837359+0000", 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837359+0000", 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9699999999999996e-07 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837361+0000", 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3159999999999999e-06 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837368+0000", 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7179999999999999e-06 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837374+0000", 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4049999999999999e-06 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33089 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845290+0000", 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011353692, 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.028769251999999999, 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.711 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33089 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845290+0000", 2024-09-14T08:41:48.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845290+0000", 2024-09-14T08:41:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845290+0000", 2024-09-14T08:41:48.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8500000000000001e-07 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845293+0000", 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5749999999999999e-06 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845301+0000", 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5850000000000002e-06 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845306+0000", 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5650000000000001e-06 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33121 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853455+0000", 2024-09-14T08:41:48.715 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0031885529999999998, 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020663128999999999, 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33121 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853455+0000", 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853455+0000", 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853455+0000", 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9799999999999999e-07 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853457+0000", 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.978e-06 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853464+0000", 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9949999999999999e-06 2024-09-14T08:41:48.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853470+0000", 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7899999999999996e-06 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32930 3.11 3:8f35c9ca:::rbd_data.10f1d326df17.0000000000000000:1c [read 15118336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.833695+0000", 2024-09-14T08:41:48.719 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.022948356, 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.040503321000000002, 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32930 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833695+0000", 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833695+0000", 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833696+0000", 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6899999999999996e-07 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833698+0000", 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5110000000000002e-06 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833706+0000", 2024-09-14T08:41:48.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.833720+0000", 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4e-05 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.874117+0000", 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.040397149 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.874163+0000", 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6263000000000001e-05 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.874211+0000", 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8007000000000003e-05 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.724 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32962 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834720+0000", 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021923992, 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.039589238999999998, 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32962 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834720+0000", 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834720+0000", 2024-09-14T08:41:48.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834720+0000", 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0299999999999999e-07 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834737+0000", 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6592e-05 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834744+0000", 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4989999999999997e-06 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834752+0000", 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0330000000000008e-06 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32994 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835631+0000", 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021012646999999999, 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.038735448999999998, 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32994 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835631+0000", 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835631+0000", 2024-09-14T08:41:48.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835631+0000", 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6300000000000005e-07 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835634+0000", 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6029999999999999e-06 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835642+0000", 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7179999999999996e-06 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835647+0000", 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6080000000000003e-06 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33026 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836496+0000", 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020147399, 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.037930500999999998, 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33026 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836496+0000", 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836496+0000", 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836497+0000", 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6300000000000001e-07 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836498+0000", 2024-09-14T08:41:48.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9740000000000001e-06 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836505+0000", 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2299999999999996e-06 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836510+0000", 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:48.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33058 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837381+0000", 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019262080000000001, 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.037100547999999997, 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33058 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837381+0000", 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837381+0000", 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837382+0000", 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4999999999999998e-07 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837398+0000", 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6113999999999999e-05 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837406+0000", 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0830000000000004e-06 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837415+0000", 2024-09-14T08:41:48.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7839999999999992e-06 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33090 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845315+0000", 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011329038, 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029228271, 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.741 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33090 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845315+0000", 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845315+0000", 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845315+0000", 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7599999999999997e-07 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845317+0000", 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3530000000000002e-06 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845324+0000", 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5069999999999997e-06 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845329+0000", 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1039999999999998e-06 2024-09-14T08:41:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33122 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853477+0000", 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0031668080000000001, 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021122498999999999, 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33122 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853477+0000", 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853477+0000", 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853477+0000", 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8799999999999998e-07 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853479+0000", 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9929999999999998e-06 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853485+0000", 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8930000000000002e-06 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853490+0000", 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9099999999999996e-06 2024-09-14T08:41:48.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32963 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834765+0000", 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021879012, 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.039903954999999998, 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32963 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834765+0000", 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834765+0000", 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834765+0000", 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5300000000000004e-07 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834768+0000", 2024-09-14T08:41:48.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.57e-06 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834775+0000", 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0849999999999999e-06 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834780+0000", 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4360000000000001e-06 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.752 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32995 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835656+0000", 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020987254, 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.039097936, 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32995 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835656+0000", 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835656+0000", 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835657+0000", 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0100000000000005e-07 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835659+0000", 2024-09-14T08:41:48.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.294e-06 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835666+0000", 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7000000000000002e-06 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835672+0000", 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1630000000000001e-06 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.756 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33027 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836516+0000", 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020127703, 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.038304913000000003, 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.757 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33027 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836516+0000", 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836516+0000", 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836516+0000", 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.84e-07 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836518+0000", 2024-09-14T08:41:48.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.933e-06 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836524+0000", 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9229999999999999e-06 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836529+0000", 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.904e-06 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.760 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33059 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.837424+0000", 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.019219699999999999, 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.037453450999999999, 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.761 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33059 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837424+0000", 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.837424+0000", 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844390+0000", 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069658139999999999 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844395+0000", 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7740000000000001e-06 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844413+0000", 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7482e-05 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844422+0000", 2024-09-14T08:41:48.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1500000000000005e-06 2024-09-14T08:41:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33091 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845337+0000", 2024-09-14T08:41:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011306675, 2024-09-14T08:41:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029598939000000001, 2024-09-14T08:41:48.765 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33091 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845337+0000", 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845337+0000", 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845338+0000", 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7999999999999995e-07 2024-09-14T08:41:48.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845340+0000", 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3039999999999999e-06 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845348+0000", 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9880000000000004e-06 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845354+0000", 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7849999999999997e-06 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33123 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853497+0000", 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003146252, 2024-09-14T08:41:48.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021495752, 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33123 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853497+0000", 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853497+0000", 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853498+0000", 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.51e-07 2024-09-14T08:41:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853500+0000", 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2330000000000001e-06 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853511+0000", 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0984e-05 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853531+0000", 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32964 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.834788+0000", 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.021855357999999998, 2024-09-14T08:41:48.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.040273607000000003, 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32964 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834788+0000", 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834788+0000", 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834789+0000", 2024-09-14T08:41:48.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9500000000000003e-07 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834791+0000", 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5220000000000002e-06 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834800+0000", 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5609999999999999e-06 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.834818+0000", 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8312e-05 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:32996 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.835681+0000", 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020962966999999999, 2024-09-14T08:41:48.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.039464928000000003, 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32996 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835681+0000", 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835681+0000", 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835681+0000", 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4700000000000002e-07 2024-09-14T08:41:48.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835684+0000", 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5799999999999999e-06 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835690+0000", 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7610000000000002e-06 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.835695+0000", 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0579999999999997e-06 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33028 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.836535+0000", 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.020108562999999999, 2024-09-14T08:41:48.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.038667396999999999, 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33028 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836535+0000", 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836535+0000", 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836535+0000", 2024-09-14T08:41:48.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5100000000000001e-07 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836538+0000", 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1950000000000002e-06 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836544+0000", 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9769999999999997e-06 2024-09-14T08:41:48.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.836548+0000", 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9099999999999996e-06 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33060 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.844449+0000", 2024-09-14T08:41:48.785 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.012194818, 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.030812961999999999, 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33060 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844449+0000", 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844449+0000", 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844450+0000", 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.92e-07 2024-09-14T08:41:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844453+0000", 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6210000000000001e-06 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844464+0000", 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0916e-05 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.844471+0000", 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7000000000000002e-06 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33092 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.845369+0000", 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011274291000000001, 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.029947971, 2024-09-14T08:41:48.789 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33092 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845369+0000", 2024-09-14T08:41:48.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.845369+0000", 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852562+0000", 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071925330000000001 2024-09-14T08:41:48.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852567+0000", 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.558e-06 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852583+0000", 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5659999999999999e-05 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.852592+0000", 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5450000000000003e-06 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:33124 3.11 3.5393acf1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e123)", 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:47.853544+0000", 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0030994009999999999, 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021832199, 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 33124 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853544+0000", 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853544+0000", 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853545+0000", 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5899999999999996e-07 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853547+0000", 2024-09-14T08:41:48.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6809999999999998e-06 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853561+0000", 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3573e-05 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:47.853567+0000", 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2820000000000002e-06 2024-09-14T08:41:48.796 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.797 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:48.797 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.797 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:48.797 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:41:48.797 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 224 2024-09-14T08:41:48.797 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:48.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:48.798 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:48.221+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:48.799 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:48.283+0000 7f6d740a37c0 -1 Falling back to public interface 2024-09-14T08:41:48.800 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:48.800 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:48.800 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:48.801 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:48.801 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:48.801 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:48.801 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:48.802 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:48.802 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:48.802 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:48.803 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:48.803 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:48.803 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:48.804 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:48.799+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:48.900 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:48.899+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:48.937 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:48.938 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:48.952 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:49.001 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:48.997+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:49.069 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:49.069 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:49.083 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:49.125 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:49.125+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:49.203 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:49.201+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:49.249 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:49.249 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:49.264 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:49.305 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:49.305+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:49.404 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:49.401+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:49.430 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:49.430 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:49.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:49.537 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:49.537+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:49.606 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:49.605+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:49.622 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:49.622 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:49.637 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:49.706 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:49.705+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:49.774 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:49.774 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:49.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-14T08:41:49.807 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:49.805+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:49.908 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:49.907+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:49.908 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:49.908 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:49.922 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:50.009 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:50.007+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:50.088 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:50.088 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:50.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:50.110 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:50.109+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:50.210 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:50.207+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:50.227 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:41:50.261 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:50.262 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:50.276 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:50.322 INFO:teuthology.orchestra.run.smithi188.stdout:3383 trunc from 0xe4c4600 to 0xa9c0800 2024-09-14T08:41:50.323 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:50.323+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:3384 read 0x3393400 thru 0x33a243e (0xf03f bytes) 2024-09-14T08:41:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:3386 write 0x6e87000 thru 0x6e96832 (0xf833 bytes) 2024-09-14T08:41:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:3387 read 0x5e13e00 thru 0x5e21d09 (0xdf0a bytes) 2024-09-14T08:41:50.372 INFO:teuthology.orchestra.run.smithi188.stdout:3389 trunc from 0xa9c0800 to 0xee00c00 2024-09-14T08:41:50.396 INFO:teuthology.orchestra.run.smithi188.stdout:3391 read 0x1cefc00 thru 0x1cf11cd (0x15ce bytes) 2024-09-14T08:41:50.396 INFO:teuthology.orchestra.run.smithi188.stdout:3393 read 0x81bd000 thru 0x81cc46a (0xf46b bytes) 2024-09-14T08:41:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:3395 punch from 0x160c200 to 0x1616600, (0xa400 bytes) 2024-09-14T08:41:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:3397 punch from 0x20d6a00 to 0x20dbe00, (0x5400 bytes) 2024-09-14T08:41:50.404 INFO:teuthology.orchestra.run.smithi188.stdout:3399 punch from 0x1808000 to 0x1810400, (0x8400 bytes) 2024-09-14T08:41:50.409 INFO:teuthology.orchestra.run.smithi188.stdout:3400 clone 28 order 21 su 131072 sc 7 2024-09-14T08:41:50.411 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:50.409+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:50.455 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:50.455 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:50.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:50.515 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:50.515+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:50.586 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:50.599 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:50.645 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:50.645+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:50.713 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:50.713+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:50.735 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:50.735 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:50.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:50.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:50.837 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:50.837+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:50.913 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:50.913 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:50.914 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:50.911+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:50.927 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:50.953 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:50.970 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:50.992 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:51.009 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:51.017 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:51.017+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:51.027 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:51.030 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:51.030 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:51.097 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.851184636, 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:51.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.102 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.85112262299999, 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:51.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:41:51.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.851056293, 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.108 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:41:51.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.112 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.851000833, 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:41:51.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:41:51.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850941213, 2024-09-14T08:41:51.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:51.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:41:51.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850859673, 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.122 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:41:51.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:41:51.126 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850803345, 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:51.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.85073185, 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.132 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:41:51.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.136 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850658979, 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:41:51.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:41:51.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.85061676700001, 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:41:51.141 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:41:51.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850586937, 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:41:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.85055864, 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850517545, 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:41:51.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850488515, 2024-09-14T08:41:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:51.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:41:51.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850460031, 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.165 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:41:51.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.169 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850431891, 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.170 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:41:51.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.174 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850403195, 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.175 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:41:51.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:51.179 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850374438, 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:51.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:41:51.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.850346391, 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:41:51.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.85031641400001, 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:51.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:41:51.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.193 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:51.195 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:51.195 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:51.193+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:51.295 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:51.295+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:51.364 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:51.364 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:51.364 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:51.364 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:51.366 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:41:51.381 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:51.439 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:51.439+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:51.496 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:51.495+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:51.507 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:51.507 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:51.507 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:51.508 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:51.508 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:51.522 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:51.542 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone27 from 0xee00c00 (overlap 0xa9c0800) to 0x76d3800 2024-09-14T08:41:51.597 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:51.595+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:51.666 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:51.666 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:51.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:51.666 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:51.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.666 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:41:51.666 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:51.666 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.931899481000002, 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:41:51.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:41:51.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:41:51.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.396145656000002, 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:41:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:41:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:41:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.361480772, 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.678 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:41:51.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.361279801000002, 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.683 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:41:51.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.460604411999999, 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:41:51.688 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:41:51.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:41:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.460570196999999, 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:51.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:41:51.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.460528707999998, 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:41:51.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:41:51.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.460470225999998, 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:41:51.702 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:41:51.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:41:51.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.460440547000001, 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:41:51.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.711 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.712 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:51.712 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.460411338, 2024-09-14T08:41:51.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:41:51.712 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.712 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.712 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.712 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:41:51.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.716 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.452805043000001, 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.452777052999998, 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:51.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:41:51.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.452748720999999, 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:41:51.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:41:51.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:41:51.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:41:51.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:41:51.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.452706962000001, 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.731 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.452678082999999, 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.735 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.452644274000001, 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:41:51.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.452611914999999, 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.744 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:51.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.444484112000001, 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:41:51.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.753 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.444453126999999, 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:41:51.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:41:51.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.444424220999998, 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:51.758 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:51.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:51.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.762 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:51.763 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:51.763 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:51.764 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:51.765 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:51.761+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:51.865 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:51.865+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:51.932 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:51.932 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:51.932 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:51.932 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:51.946 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:51.989 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:51.989+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:52.024 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:41:52.066 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:52.065+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:52.113 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:52.113 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:52.113 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:52.113 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:52.113 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:52.128 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:no valid command found; 10 closest matches: 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:0 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:1 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:2 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:abort 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:assert 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:config diff 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:config diff get 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:config get 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:config help [] 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:config set ... 2024-09-14T08:41:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: invalid command 2024-09-14T08:41:52.154 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T08:41:52.154 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-14T08:41:52.167 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:52.163+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:52.268 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:52.265+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:52.297 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.218322379, 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.298 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:52.302 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.218265175, 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:41:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.218206291, 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:41:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:41:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.21814136499999, 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:41:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:41:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.218079914, 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:41:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.21802038, 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.21796107, 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:41:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.217889038, 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:41:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.063188660999998, 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:41:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:41:52.337 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.063157235999995, 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:52.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.699293615999999, 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:41:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:41:52.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.699234265999998, 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:52.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:41:52.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.699194314000003, 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:41:52.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:41:52.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:41:52.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.215771361000002, 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:41:52.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:41:52.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.364 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.209378794999999, 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.365 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:41:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:41:52.371 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.449789375, 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:41:52.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:41:52.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:41:52.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.409049973, 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:41:52.378 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:41:52.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.141478889, 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:52.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:41:52.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:41:52.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:41:52.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:41:52.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.077674995000001, 2024-09-14T08:41:52.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:41:52.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:41:52.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:41:52.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:52.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.050203296999999, 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.398 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:41:52.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:41:52.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:41:52.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:52.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:41:52.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:41:52.404 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.404 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.404 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.404 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:52.404 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:52.404 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:52.405 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-14T08:41:52.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:52.406 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:52.403+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:52.505 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:52.503+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:52.538 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:52.538 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:52.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:52.606 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:52.605+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:52.684 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:52.683+0000 7f6d740a37c0 -1 osd.0 115 log_to_monitors true 2024-09-14T08:41:52.707 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:52.705+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:52.721 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:52.722 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:52.735 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:52.808 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:52.805+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 115.930613589, 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.857 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:52.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:41:52.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 115.930558811, 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.862 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:41:52.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:41:52.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 102.502788352, 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:41:52.866 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:41:52.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:41:52.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 79.510184284999994, 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.871 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:41:52.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:52.875 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 79.509345913999994, 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:41:52.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.490837812999999, 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:41:52.880 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:41:52.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.490523604, 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.885 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.488887278, 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.889 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:52.893 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.488669319, 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:41:52.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:41:52.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.488373917000001, 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:52.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:41:52.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.488103081999999, 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.903 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:41:52.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:41:52.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:41:52.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.276912401000001, 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:52.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:41:52.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.276892366999999, 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:41:52.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:52.916 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.276871288999999, 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:52.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.920 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.276851695000001, 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:41:52.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:41:52.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:41:52.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:41:52.928 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.928 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.928 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.276831541, 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.929 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:41:52.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:41:52.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:41:52.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:41:52.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.276812145000001, 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:41:52.937 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.270282344999998, 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:41:52.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.942 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.270262459000001, 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:41:52.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.270243085000001, 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:52.947 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:52.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:41:52.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:52.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:52.951 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:52.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:52.953 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:52.951+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:53.027 INFO:teuthology.orchestra.run.smithi188.stdout:3402 write 0x2a98800 thru 0x2aa6ec5 (0xe6c6 bytes) 2024-09-14T08:41:53.029 INFO:teuthology.orchestra.run.smithi188.stdout:3403 trunc from 0xee00c00 to 0xed11e00 2024-09-14T08:41:53.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:53.054 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:53.053+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:53.097 INFO:teuthology.orchestra.run.smithi188.stdout:3410 write 0x3466c00 thru 0x346a8c9 (0x3cca bytes) 2024-09-14T08:41:53.101 INFO:teuthology.orchestra.run.smithi188.stdout:3411 write 0x879fa00 thru 0x87a9e64 (0xa465 bytes) 2024-09-14T08:41:53.133 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:53.133 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:53.134 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:53.134 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:53.149 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:53.167 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T08:41:53.167 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:53.167+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:53.173 INFO:teuthology.orchestra.run.smithi188.stdout:3412 trunc from 0xed11e00 to 0x9251a00 2024-09-14T08:41:53.187 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:53.187 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:53.204 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:53.227 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:53.227 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:53.249 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:53.249 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:53.255 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:53.253+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:53.273 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:53.273 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:53.276 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:41:53.277 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:41:53.281 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:53.282 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:53.301 INFO:teuthology.orchestra.run.smithi188.stdout:3417 write 0x28df600 thru 0x28e1be0 (0x25e1 bytes) 2024-09-14T08:41:53.303 INFO:teuthology.orchestra.run.smithi188.stdout:3418 read 0x2d9e200 thru 0x2da0c2f (0x2a30 bytes) 2024-09-14T08:41:53.306 INFO:teuthology.orchestra.run.smithi188.stdout:3419 read 0x4bab400 thru 0x4bb51cc (0x9dcd bytes) 2024-09-14T08:41:53.352 INFO:teuthology.orchestra.run.smithi188.stdout:3420 write 0x9b78400 thru 0x9b7e158 (0x5d59 bytes) 2024-09-14T08:41:53.354 INFO:teuthology.orchestra.run.smithi188.stdout:3423 punch from 0x6f48a00 to 0x6f52a00, (0xa000 bytes) 2024-09-14T08:41:53.356 INFO:teuthology.orchestra.run.smithi188.stdout:3425 read 0xbde600 thru 0xbdf52a (0xf2b bytes) 2024-09-14T08:41:53.359 INFO:teuthology.orchestra.run.smithi188.stdout:3427 write 0x7c5e600 thru 0x7c67cb6 (0x96b7 bytes) 2024-09-14T08:41:53.359 INFO:teuthology.orchestra.run.smithi188.stdout:3428 read 0x4aa600 thru 0x4abadf (0x14e0 bytes) 2024-09-14T08:41:53.366 INFO:teuthology.orchestra.run.smithi188.stdout:3429 punch from 0x6949a00 to 0x6951000, (0x7600 bytes) 2024-09-14T08:41:53.376 INFO:teuthology.orchestra.run.smithi188.stdout:3435 trunc from 0x9b7e200 to 0x8ae0400 2024-09-14T08:41:53.387 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:53.387+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:53.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:41:53.427 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:53.427+0000 7f6d67e7e640 -1 osd.0 126 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T08:41:53.456 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:53.455+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:53.470 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:53.470 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:53.485 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:53.495 INFO:teuthology.orchestra.run.smithi188.stdout:3436 punch from 0x1cba800 to 0x1cbb800, (0x1000 bytes) 2024-09-14T08:41:53.511 INFO:teuthology.orchestra.run.smithi188.stdout:3437 trunc from 0x8ae0400 to 0xe6b5c00 2024-09-14T08:41:53.547 INFO:teuthology.orchestra.run.smithi188.stdout:3439 read 0x537e400 thru 0x5387a10 (0x9611 bytes) 2024-09-14T08:41:53.557 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:53.557+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:53.608 INFO:teuthology.orchestra.run.smithi188.stdout:3441 trunc from 0xe6b5c00 to 0x54dec00 2024-09-14T08:41:53.618 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:53.618 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:53.637 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:53.681 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:53.681+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:53.689 INFO:teuthology.orchestra.run.smithi188.stdout:3442 write 0xa24d200 thru 0xa2550a6 (0x7ea7 bytes) 2024-09-14T08:41:53.691 INFO:teuthology.orchestra.run.smithi188.stdout:3444 read 0xf3ae00 thru 0xf46b85 (0xbd86 bytes) 2024-09-14T08:41:53.697 INFO:teuthology.orchestra.run.smithi188.stdout:3447 read 0x972de00 thru 0x9734799 (0x699a bytes) 2024-09-14T08:41:53.697 INFO:teuthology.orchestra.run.smithi188.stdout:3449 punch from 0x468b400 to 0x4690600, (0x5200 bytes) 2024-09-14T08:41:53.698 INFO:teuthology.orchestra.run.smithi188.stdout:3450 read 0x4c1b600 thru 0x4c26747 (0xb148 bytes) 2024-09-14T08:41:53.701 INFO:teuthology.orchestra.run.smithi188.stdout:3451 write 0x5e07c00 thru 0x5e1486a (0xcc6b bytes) 2024-09-14T08:41:53.701 INFO:teuthology.orchestra.run.smithi188.stdout:3452 punch from 0x7713e00 to 0x7716000, (0x2200 bytes) 2024-09-14T08:41:53.702 INFO:teuthology.orchestra.run.smithi188.stdout:3453 punch from 0x85cee00 to 0x85d6400, (0x7600 bytes) 2024-09-14T08:41:53.702 INFO:teuthology.orchestra.run.smithi188.stdout:3454 read 0x3e9fc00 thru 0x3eac278 (0xc679 bytes) 2024-09-14T08:41:53.703 INFO:teuthology.orchestra.run.smithi188.stdout:3455 write 0x96d4000 thru 0x96e25b4 (0xe5b5 bytes) 2024-09-14T08:41:53.703 INFO:teuthology.orchestra.run.smithi188.stdout:3456 read 0x8ddcc00 thru 0x8de214c (0x554d bytes) 2024-09-14T08:41:53.721 INFO:teuthology.orchestra.run.smithi188.stdout:3457 trunc from 0xa255200 to 0x4ec9400 2024-09-14T08:41:53.760 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:53.757+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:53.811 INFO:teuthology.orchestra.run.smithi188.stdout:3458 punch from 0x2ebbc00 to 0x2ebc800, (0xc00 bytes) 2024-09-14T08:41:53.815 INFO:teuthology.orchestra.run.smithi188.stdout:3461 read 0x1363200 thru 0x136bd3f (0x8b40 bytes) 2024-09-14T08:41:53.817 INFO:teuthology.orchestra.run.smithi188.stdout:3462 read 0x2c87e00 thru 0x2c93d00 (0xbf01 bytes) 2024-09-14T08:41:53.818 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:53.819 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:53.819 INFO:teuthology.orchestra.run.smithi188.stdout:3463 punch from 0x148ac00 to 0x148d200, (0x2600 bytes) 2024-09-14T08:41:53.821 INFO:teuthology.orchestra.run.smithi188.stdout:3465 read 0x511e00 thru 0x51de7a (0xc07b bytes) 2024-09-14T08:41:53.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:53.861 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:53.859+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:53.962 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:53.961+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:54.002 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:54.002 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:54.016 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:54.101 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:54.101+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:54.164 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:54.161+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:54.182 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:54.182 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:54.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:54.204 INFO:teuthology.orchestra.run.smithi188.stdout:3468 read 0x43f3600 thru 0x43fcd28 (0x9729 bytes) 2024-09-14T08:41:54.205 INFO:teuthology.orchestra.run.smithi188.stdout:3469 read 0x200400 thru 0x2021fe (0x1dff bytes) 2024-09-14T08:41:54.227 INFO:teuthology.orchestra.run.smithi188.stdout:3470 trunc from 0x4ec9400 to 0x9c9ca00 2024-09-14T08:41:54.248 INFO:teuthology.orchestra.run.smithi188.stdout:3471 punch from 0x1ef9400 to 0x1f07200, (0xde00 bytes) 2024-09-14T08:41:54.259 INFO:teuthology.orchestra.run.smithi188.stdout:3472 trunc from 0x9c9ca00 to 0x72e8400 2024-09-14T08:41:54.264 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:54.263+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:54.366 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:54.365+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:54.370 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:54.370 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:54.372 INFO:teuthology.orchestra.run.smithi188.stdout:3473 trunc from 0x72e8400 to 0x109e000 2024-09-14T08:41:54.385 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:41:54.473 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:54.473+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:54.554 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:54.554 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:54.567 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:54.563+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:54.568 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:54.667 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:54.667+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:54.737 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:54.737 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:54.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:54.801 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:54.801+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:54.869 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:54.867+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:54.879 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:54.879 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:54.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:54.981 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:54.981+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:55.059 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:55.059 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:55.070 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:55.067+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:55.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:55.173 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:55.171+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:55.215 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:55.215 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:55.230 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:55.273 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:55.273+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:55.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:55.288 INFO:teuthology.orchestra.run.smithi188.stdout:3476 read 0x4c8e00 thru 0x4cd313 (0x4514 bytes) 2024-09-14T08:41:55.298 INFO:teuthology.orchestra.run.smithi188.stdout:3477 read 0x365200 thru 0x368898 (0x3699 bytes) 2024-09-14T08:41:55.315 INFO:teuthology.orchestra.run.smithi188.stdout:3478 trunc from 0x109e000 to 0x6c7aa00 2024-09-14T08:41:55.370 INFO:teuthology.orchestra.run.smithi188.stdout:3484 write 0x8ee7400 thru 0x8ef02e1 (0x8ee2 bytes) 2024-09-14T08:41:55.373 INFO:teuthology.orchestra.run.smithi188.stdout:3486 punch from 0x531c600 to 0x5325600, (0x9000 bytes) 2024-09-14T08:41:55.374 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:55.371+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:55.380 INFO:teuthology.orchestra.run.smithi188.stdout:3487 trunc from 0x8ef0400 to 0xc9ba000 2024-09-14T08:41:55.398 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:55.398 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:55.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:55.438 INFO:teuthology.orchestra.run.smithi188.stdout:3488 punch from 0x3b67e00 to 0x3b74e00, (0xd000 bytes) 2024-09-14T08:41:55.443 INFO:teuthology.orchestra.run.smithi188.stdout:3489 trunc from 0xc9ba000 to 0xb605800 2024-09-14T08:41:55.455 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:41:55.455 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-14T08:41:55.467 INFO:teuthology.orchestra.run.smithi188.stdout:3491 read 0x22f7a00 thru 0x23029c3 (0xafc4 bytes) 2024-09-14T08:41:55.468 INFO:teuthology.orchestra.run.smithi188.stdout:3493 write 0x6a09600 thru 0x6a09fbf (0x9c0 bytes) 2024-09-14T08:41:55.469 INFO:teuthology.orchestra.run.smithi188.stdout:3494 trunc from 0xb605800 to 0xb1a0800 2024-09-14T08:41:55.473 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:55.474 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:55.474 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:55.471+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:55.491 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:55.491 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:55.512 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:55.512 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:55.513 INFO:teuthology.orchestra.run.smithi188.stdout:3495 read 0x590dc00 thru 0x591ce30 (0xf231 bytes) 2024-09-14T08:41:55.515 INFO:teuthology.orchestra.run.smithi188.stdout:3497 punch from 0x556fe00 to 0x557da00, (0xdc00 bytes) 2024-09-14T08:41:55.516 INFO:teuthology.orchestra.run.smithi188.stdout:3500 punch from 0x901bc00 to 0x9028800, (0xcc00 bytes) 2024-09-14T08:41:55.516 INFO:teuthology.orchestra.run.smithi188.stdout:3501 write 0xdfc200 thru 0xe0aff5 (0xedf6 bytes) 2024-09-14T08:41:55.530 INFO:teuthology.orchestra.run.smithi188.stdout:3502 punch from 0xa3dce00 to 0xa3dea00, (0x1c00 bytes) 2024-09-14T08:41:55.533 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:55.533 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:55.536 INFO:teuthology.orchestra.run.smithi188.stdout:3507 read 0x6a15a00 thru 0x6a23a6f (0xe070 bytes) 2024-09-14T08:41:55.555 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:55.556 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 118.652126516, 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.577 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:41:55.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.581 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 118.652071738, 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:41:55.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:41:55.586 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 105.224301279, 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:41:55.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.231697212, 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.591 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:41:55.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:41:55.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.230858841, 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.596 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:41:55.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.212350740000002, 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.601 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:41:55.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.212036530999999, 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.606 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:41:55.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.210400204999999, 2024-09-14T08:41:55.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:55.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:41:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.210182245999999, 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:41:55.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:41:55.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:41:55.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.209886844, 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:41:55.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:41:55.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:41:55.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:41:55.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:41:55.627 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.209616009000001, 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:41:55.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.632 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.998425328, 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:41:55.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:41:55.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.998405294000001, 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.637 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:41:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.998384216000002, 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.998364622, 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.647 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:41:55.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.998344467999999, 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:41:55.651 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:41:55.655 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.998325072, 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:41:55.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.660 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.991795272000001, 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:41:55.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:41:55.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.991775386, 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:41:55.669 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.991756012, 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:55.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:55.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.673 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:55.674 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:55.674 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:55.674 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:55.575+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:55.675 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:55.676 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:55.673+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:55.703 INFO:teuthology.orchestra.run.smithi188.stdout:3508 write 0xe645c00 thru 0xe65002a (0xa42b bytes) 2024-09-14T08:41:55.704 INFO:teuthology.orchestra.run.smithi188.stdout:3510 write 0xd514000 thru 0xd51aea7 (0x6ea8 bytes) 2024-09-14T08:41:55.704 INFO:teuthology.orchestra.run.smithi188.stdout:3512 read 0x60c4e00 thru 0x60cc496 (0x7697 bytes) 2024-09-14T08:41:55.705 INFO:teuthology.orchestra.run.smithi188.stdout:3515 read 0xc633400 thru 0xc638cee (0x58ef bytes) 2024-09-14T08:41:55.706 INFO:teuthology.orchestra.run.smithi188.stdout:3518 write 0x2a4ee00 thru 0x2a5b34e (0xc54f bytes) 2024-09-14T08:41:55.706 INFO:teuthology.orchestra.run.smithi188.stdout:3520 read 0xa619800 thru 0xa626ee9 (0xd6ea bytes) 2024-09-14T08:41:55.723 INFO:teuthology.orchestra.run.smithi188.stdout:3522 trunc from 0xe650200 to 0x50f7000 2024-09-14T08:41:55.777 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:55.775+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:55.819 INFO:teuthology.orchestra.run.smithi188.stdout:3526 punch from 0x27d2c00 to 0x27da200, (0x7600 bytes) 2024-09-14T08:41:55.835 INFO:teuthology.orchestra.run.smithi188.stdout:3528 trunc from 0x50f7000 to 0x9c74e00 2024-09-14T08:41:55.853 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:55.854 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:55.854 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:55.854 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:55.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:55.871 INFO:teuthology.orchestra.run.smithi188.stdout:3529 trunc from 0x9c74e00 to 0x4b04c00 2024-09-14T08:41:55.911 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:55.911+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:55.915 INFO:teuthology.orchestra.run.smithi188.stdout:3532 read 0x902600 thru 0x9118f1 (0xf2f2 bytes) 2024-09-14T08:41:55.925 INFO:teuthology.orchestra.run.smithi188.stdout:3533 read 0x192e800 thru 0x1937421 (0x8c22 bytes) 2024-09-14T08:41:55.925 INFO:teuthology.orchestra.run.smithi188.stdout:3536 punch from 0x30db600 to 0x30e6400, (0xae00 bytes) 2024-09-14T08:41:55.925 INFO:teuthology.orchestra.run.smithi188.stdout:3537 read 0x1e3ec00 thru 0x1e48cf2 (0xa0f3 bytes) 2024-09-14T08:41:55.926 INFO:teuthology.orchestra.run.smithi188.stdout:3538 read 0x2f35600 thru 0x2f3c69e (0x709f bytes) 2024-09-14T08:41:55.926 INFO:teuthology.orchestra.run.smithi188.stdout:3540 read 0x2c31a00 thru 0x2c3ae63 (0x9464 bytes) 2024-09-14T08:41:55.979 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:55.977+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:55.996 INFO:teuthology.orchestra.run.smithi188.stdout:3542 write 0x9794e00 thru 0x9798b89 (0x3d8a bytes) 2024-09-14T08:41:55.997 INFO:teuthology.orchestra.run.smithi188.stdout:3544 write 0x643a200 thru 0x644950b (0xf30c bytes) 2024-09-14T08:41:55.997 INFO:teuthology.orchestra.run.smithi188.stdout:3546 write 0x9646000 thru 0x964df1c (0x7f1d bytes) 2024-09-14T08:41:56.001 INFO:teuthology.orchestra.run.smithi188.stdout:3549 trunc from 0x9798c00 to 0xb297000 2024-09-14T08:41:56.038 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:56.039 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:56.039 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:41:56.039 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:41:56.039 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:56.051 INFO:teuthology.orchestra.run.smithi188.stdout:3552 punch from 0x39a0e00 to 0x39a8c00, (0x7e00 bytes) 2024-09-14T08:41:56.052 INFO:teuthology.orchestra.run.smithi188.stdout:3554 read 0xab87400 thru 0xab96866 (0xf467 bytes) 2024-09-14T08:41:56.053 INFO:teuthology.orchestra.run.smithi188.stdout:3556 write 0xab45800 thru 0xab467b8 (0xfb9 bytes) 2024-09-14T08:41:56.053 INFO:teuthology.orchestra.run.smithi188.stdout:3559 read 0x9924c00 thru 0x992cd83 (0x8184 bytes) 2024-09-14T08:41:56.054 INFO:teuthology.orchestra.run.smithi188.stdout:3560 write 0xa0f4000 thru 0xa0fbb89 (0x7b8a bytes) 2024-09-14T08:41:56.054 INFO:teuthology.orchestra.run.smithi188.stdout:3562 write 0x54bb600 thru 0x54c4cc9 (0x96ca bytes) 2024-09-14T08:41:56.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:56.059 INFO:teuthology.orchestra.run.smithi188.stdout:3563 trunc from 0xb297000 to 0x8a0e800 2024-09-14T08:41:56.080 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:56.077+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:56.125 INFO:teuthology.orchestra.run.smithi188.stdout:3566 read 0x5bd9c00 thru 0x5be09de (0x6ddf bytes) 2024-09-14T08:41:56.130 INFO:teuthology.orchestra.run.smithi188.stdout:3567 trunc from 0x8a0e800 to 0x9dbae00 2024-09-14T08:41:56.180 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:56.180 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:41:56.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:41:56.180 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:41:56.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.180 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:41:56.180 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:56.180 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 105.87558553300001, 2024-09-14T08:41:56.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:41:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:41:56.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:56.186 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.613475354000002, 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:41:56.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.191 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.613328182999993, 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:56.192 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:41:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:56.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.613186382999999, 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:41:56.197 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:41:56.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:41:56.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.202 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.049920616, 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:41:56.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.041629326000001, 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.207 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:41:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.041606085, 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:41:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:41:56.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.041586820999999, 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.217 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:41:56.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:41:56.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.041567544999999, 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:41:56.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.225 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.041355092, 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.226 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:41:56.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:41:56.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.230 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.034141998999999, 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.231 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:41:56.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:41:56.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.235 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.034120787000001, 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:41:56.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.034101437, 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.240 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:41:56.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.034074398, 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:41:56.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:41:56.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.034055248, 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:41:56.249 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:41:56.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.253 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.034033664000001, 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.254 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:41:56.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:41:56.258 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.034014255000001, 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:41:56.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:41:56.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.033995379, 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.263 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:41:56.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:41:56.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.025964543000001, 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.268 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:41:56.271 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.025938147, 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:41:56.272 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:41:56.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:41:56.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:41:56.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:41:56.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:41:56.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:41:56.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:41:56.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.276 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:41:56.276 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:41:56.276 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:56.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:56.279 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:56.275+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:56.279 INFO:teuthology.orchestra.run.smithi188.stdout:3569 write 0xa8cc800 thru 0xa8ce8df (0x20e0 bytes) 2024-09-14T08:41:56.279 INFO:teuthology.orchestra.run.smithi188.stdout:3571 punch from 0x179e400 to 0x17a3000, (0x4c00 bytes) 2024-09-14T08:41:56.279 INFO:teuthology.orchestra.run.smithi188.stdout:3574 trunc from 0xa8cea00 to 0xe44a200 2024-09-14T08:41:56.279 INFO:teuthology.orchestra.run.smithi188.stdout:3575 write 0x2a4de00 thru 0x2a5790b (0x9b0c bytes) 2024-09-14T08:41:56.279 INFO:teuthology.orchestra.run.smithi188.stdout:3576 write 0x19d9800 thru 0x19dfba4 (0x63a5 bytes) 2024-09-14T08:41:56.279 INFO:teuthology.orchestra.run.smithi188.stdout:3578 read 0x5472400 thru 0x5481b6b (0xf76c bytes) 2024-09-14T08:41:56.279 INFO:teuthology.orchestra.run.smithi188.stdout:3579 punch from 0x77cc000 to 0x77cf600, (0x3600 bytes) 2024-09-14T08:41:56.286 INFO:teuthology.orchestra.run.smithi188.stdout:3580 trunc from 0xe44a200 to 0x2847600 2024-09-14T08:41:56.379 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:56.379+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:56.403 INFO:teuthology.orchestra.run.smithi188.stdout:3581 trunc from 0x2847600 to 0x8a65600 2024-09-14T08:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:56.416 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:56.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:56.447 INFO:teuthology.orchestra.run.smithi188.stdout:3583 write 0x1a18a00 thru 0x1a1ef12 (0x6513 bytes) 2024-09-14T08:41:56.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:41:56.481 INFO:teuthology.orchestra.run.smithi188.stdout:3586 write 0x8e1dc00 thru 0x8e20f30 (0x3331 bytes) 2024-09-14T08:41:56.483 INFO:teuthology.orchestra.run.smithi188.stdout:3588 trunc from 0x8e21000 to 0x8b29000 2024-09-14T08:41:56.499 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:56.499+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:56.548 INFO:teuthology.orchestra.run.smithi188.stdout:3590 read 0x4316c00 thru 0x431b5ae (0x49af bytes) 2024-09-14T08:41:56.559 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:56.559 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:56.559 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:56.559 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:56.559 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:56.574 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:56.587 INFO:teuthology.orchestra.run.smithi188.stdout:3591 write 0xb89ca00 thru 0xb89f40c (0x2a0d bytes) 2024-09-14T08:41:56.593 INFO:teuthology.orchestra.run.smithi188.stdout:3594 trunc from 0xb89f600 to 0xa8f9600 2024-09-14T08:41:56.617 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:56.617+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:56.638 INFO:teuthology.orchestra.run.smithi188.stdout:3595 write 0x5b88400 thru 0x5b8d19e (0x4d9f bytes) 2024-09-14T08:41:56.639 INFO:teuthology.orchestra.run.smithi188.stdout:3598 punch from 0x244c800 to 0x2456800, (0xa000 bytes) 2024-09-14T08:41:56.640 INFO:teuthology.orchestra.run.smithi188.stdout:3599 punch from 0x21b1600 to 0x21baa00, (0x9400 bytes) 2024-09-14T08:41:56.640 INFO:teuthology.orchestra.run.smithi188.stdout:3600 write 0x94f3200 thru 0x94fcbc0 (0x99c1 bytes) 2024-09-14T08:41:56.641 INFO:teuthology.orchestra.run.smithi188.stdout:3604 write 0x299ee00 thru 0x29abf58 (0xd159 bytes) 2024-09-14T08:41:56.642 INFO:teuthology.orchestra.run.smithi188.stdout:3605 punch from 0x2a3c400 to 0x2a3d600, (0x1200 bytes) 2024-09-14T08:41:56.643 INFO:teuthology.orchestra.run.smithi188.stdout:3606 punch from 0x9744800 to 0x9751000, (0xc800 bytes) 2024-09-14T08:41:56.643 INFO:teuthology.orchestra.run.smithi188.stdout:3610 punch from 0x3af5000 to 0x3af9800, (0x4800 bytes) 2024-09-14T08:41:56.643 INFO:teuthology.orchestra.run.smithi188.stdout:3612 punch from 0xa838200 to 0xa838400, (0x200 bytes) 2024-09-14T08:41:56.643 INFO:teuthology.orchestra.run.smithi188.stdout:3615 punch from 0x9547200 to 0x954f400, (0x8200 bytes) 2024-09-14T08:41:56.643 INFO:teuthology.orchestra.run.smithi188.stdout:3619 read 0xa57400 thru 0xa5cdc3 (0x59c4 bytes) 2024-09-14T08:41:56.646 INFO:teuthology.orchestra.run.smithi188.stdout:3622 read 0x7f62400 thru 0x7f6482d (0x242e bytes) 2024-09-14T08:41:56.646 INFO:teuthology.orchestra.run.smithi188.stdout:3623 punch from 0x9567800 to 0x956a200, (0x2a00 bytes) 2024-09-14T08:41:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:3625 trunc from 0xa8f9600 to 0x5b2e600 2024-09-14T08:41:56.682 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:56.681+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:56.703 INFO:teuthology.orchestra.run.smithi188.stdout:3628 punch from 0xd4e00 to 0xdb800, (0x6a00 bytes) 2024-09-14T08:41:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:3630 punch from 0x4800600 to 0x4809e00, (0x9800 bytes) 2024-09-14T08:41:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:3632 punch from 0x54a9e00 to 0x54b9c00, (0xfe00 bytes) 2024-09-14T08:41:56.719 INFO:teuthology.orchestra.run.smithi188.stdout:3633 trunc from 0x5b2e600 to 0xc896000 2024-09-14T08:41:56.722 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.475544855, 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.47548284200001, 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:41:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.475416512, 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:41:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:41:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.475361052, 2024-09-14T08:41:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:41:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:41:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.47530143199999, 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:41:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.475219892, 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:41:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.475163564, 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:41:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.475092069, 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:41:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:41:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.475019198, 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:41:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.474976986, 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:41:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:41:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.474947156, 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.474918859, 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:41:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.474877764, 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:41:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.47484873400001, 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.47482024999999, 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:41:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:41:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.47479211, 2024-09-14T08:41:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:41:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:41:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.47476341399999, 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:41:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:41:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.474734657, 2024-09-14T08:41:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.47470661, 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:41:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.474676633, 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:56.812 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:56.814 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:56.815 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:56.813+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:3634 read 0x9fa9a00 thru 0x9fb2382 (0x8983 bytes) 2024-09-14T08:41:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:3636 read 0x1832600 thru 0x183720b (0x4c0c bytes) 2024-09-14T08:41:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:3639 read 0x3cb1400 thru 0x3cba68e (0x928f bytes) 2024-09-14T08:41:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:3642 read 0x51ad200 thru 0x51b15e0 (0x43e1 bytes) 2024-09-14T08:41:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:3643 read 0xc767e00 thru 0xc76f96a (0x7b6b bytes) 2024-09-14T08:41:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:3644 write 0x5283a00 thru 0x5292dc2 (0xf3c3 bytes) 2024-09-14T08:41:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:3645 read 0x4cc5800 thru 0x4cd469b (0xee9c bytes) 2024-09-14T08:41:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:3649 read 0x9313000 thru 0x931e2c3 (0xb2c4 bytes) 2024-09-14T08:41:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:3650 punch from 0x3e3b200 to 0x3e4ac00, (0xfa00 bytes) 2024-09-14T08:41:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:3651 write 0x7e3c800 thru 0x7e48da7 (0xc5a8 bytes) 2024-09-14T08:41:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:3653 punch from 0x1cac800 to 0x1cb0a00, (0x4200 bytes) 2024-09-14T08:41:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:3654 trunc from 0xc896000 to 0x2a74a00 2024-09-14T08:41:56.895 INFO:teuthology.orchestra.run.smithi188.stdout:3655 write 0xb666400 thru 0xb668fa3 (0x2ba4 bytes) 2024-09-14T08:41:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:3656 write 0x51ae800 thru 0x51b3357 (0x4b58 bytes) 2024-09-14T08:41:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:3657 read 0x92fca00 thru 0x9305fbd (0x95be bytes) 2024-09-14T08:41:56.914 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:56.913+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:3658 write 0xce8fc00 thru 0xce937a3 (0x3ba4 bytes) 2024-09-14T08:41:56.942 INFO:teuthology.orchestra.run.smithi188.stdout:3662 write 0x6874400 thru 0x687ffbb (0xbbbc bytes) 2024-09-14T08:41:56.943 INFO:teuthology.orchestra.run.smithi188.stdout:3663 read 0xc261200 thru 0xc2618ad (0x6ae bytes) 2024-09-14T08:41:56.960 INFO:teuthology.orchestra.run.smithi188.stdout:3664 trunc from 0xce93800 to 0x6bc8a00 2024-09-14T08:41:57.007 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:57.008 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:41:57.008 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:57.015 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:57.015+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:57.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:41:57.022 INFO:teuthology.orchestra.run.smithi188.stdout:3665 trunc from 0x6bc8a00 to 0x15aa200 2024-09-14T08:41:57.085 INFO:teuthology.orchestra.run.smithi188.stdout:3666 punch from 0x9be400 to 0x9c6e00, (0x8a00 bytes) 2024-09-14T08:41:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:3667 punch from 0x113a200 to 0x1141c00, (0x7a00 bytes) 2024-09-14T08:41:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:3669 read 0xbf2800 thru 0xbfa577 (0x7d78 bytes) 2024-09-14T08:41:57.129 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:57.127+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:57.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:41:57.163 INFO:teuthology.orchestra.run.smithi188.stdout:3671 read 0xb24a00 thru 0xb2c7dd (0x7dde bytes) 2024-09-14T08:41:57.199 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:57.199 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:41:57.199 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:41:57.199 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:41:57.199 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:57.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:41:57.216 INFO:teuthology.orchestra.run.smithi188.stdout:3673 punch from 0xd2a000 to 0xd38000, (0xe000 bytes) 2024-09-14T08:41:57.216 INFO:teuthology.orchestra.run.smithi188.stdout:3674 read 0x116b200 thru 0x1179d75 (0xeb76 bytes) 2024-09-14T08:41:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:3675 read 0x10ff000 thru 0x10ff149 (0x14a bytes) 2024-09-14T08:41:57.228 INFO:teuthology.orchestra.run.smithi188.stdout:3676 trunc from 0x15aa200 to 0x4b8c400 2024-09-14T08:41:57.229 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:57.227+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:57.257 INFO:teuthology.orchestra.run.smithi188.stdout:3677 write 0x25fe600 thru 0x260ca65 (0xe466 bytes) 2024-09-14T08:41:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:3679 write 0x3dc5c00 thru 0x3dd3918 (0xdd19 bytes) 2024-09-14T08:41:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:3681 punch from 0x3587200 to 0x3594200, (0xd000 bytes) 2024-09-14T08:41:57.260 INFO:teuthology.orchestra.run.smithi188.stdout:3682 punch from 0x4712200 to 0x4718c00, (0x6a00 bytes) 2024-09-14T08:41:57.269 INFO:teuthology.orchestra.run.smithi188.stdout:3684 trunc from 0x4b8c400 to 0xe51600 2024-09-14T08:41:57.296 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:41:57.296 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:41:57.297 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:41:57.297 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:41:57.323 INFO:teuthology.orchestra.run.smithi188.stdout:3687 read 0xb8000 thru 0xbb045 (0x3046 bytes) 2024-09-14T08:41:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:3689 read 0x76c200 thru 0x779ff0 (0xddf1 bytes) 2024-09-14T08:41:57.329 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:57.329+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:57.332 INFO:teuthology.orchestra.run.smithi188.stdout:3690 trunc from 0xe51600 to 0x1722c00 2024-09-14T08:41:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:3694 punch from 0x13aee00 to 0x13b6000, (0x7200 bytes) 2024-09-14T08:41:57.347 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:57.347 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:41:57.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 101.615446311, 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:41:57.348 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:41:57.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:41:57.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:57.354 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.079692485999999, 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:41:57.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.359 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.045027601999998, 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:41:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.044826630999999, 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:41:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:41:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.144151242, 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:41:57.369 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:41:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.144117027, 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.374 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:41:57.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.144075537999999, 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.378 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:41:57.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.144017055999999, 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:41:57.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.143987376999998, 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.387 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:41:57.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:41:57.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.143958168000001, 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:41:57.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:41:57.395 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.136351872999999, 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.396 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:41:57.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:41:57.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.136323882999999, 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:41:57.400 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:41:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.136295551, 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:41:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.136253792000002, 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:41:57.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:41:57.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.136224913, 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:41:57.413 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.414 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.414 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.414 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.414 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.414 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.414 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:41:57.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.414 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:57.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:41:57.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.419 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.136191104000002, 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:41:57.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.136158744999999, 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.424 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:41:57.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:41:57.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:41:57.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:41:57.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.128030941999999, 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.429 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:41:57.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.433 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.127999957, 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.434 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:41:57.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.127971050999999, 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:41:57.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.442 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:57.443 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:41:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:3696 trunc from 0x1722c00 to 0xb023200 2024-09-14T08:41:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:3697 write 0xaba2a00 thru 0xaba3032 (0x633 bytes) 2024-09-14T08:41:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:3701 punch from 0x6efae00 to 0x6eff400, (0x4600 bytes) 2024-09-14T08:41:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:3702 punch from 0x8925c00 to 0x892b400, (0x5800 bytes) 2024-09-14T08:41:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:3703 punch from 0x580ce00 to 0x5816400, (0x9600 bytes) 2024-09-14T08:41:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:3704 trunc from 0xb023200 to 0x5f52200 2024-09-14T08:41:57.445 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:41:57.446 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:57.441+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:57.453 INFO:teuthology.orchestra.run.smithi188.stdout:3706 punch from 0x9f8a00 to 0x9ffe00, (0x7400 bytes) 2024-09-14T08:41:57.487 INFO:teuthology.orchestra.run.smithi188.stdout:3707 trunc from 0x5f52200 to 0x91800 2024-09-14T08:41:57.544 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:57.543+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:57.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:41:57.614 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:41:57.614 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:41:57.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15202 3.16 3.a6a01136 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.615306+0000", 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00039723900000000002, 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041807600000000003, 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15202 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.615 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615306+0000", 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615306+0000", 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615314+0000", 2024-09-14T08:41:57.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5029999999999997e-06 2024-09-14T08:41:57.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615325+0000", 2024-09-14T08:41:57.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1178999999999999e-05 2024-09-14T08:41:57.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615362+0000", 2024-09-14T08:41:57.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7017000000000002e-05 2024-09-14T08:41:57.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615382+0000", 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9562e-05 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15203 3.16 3.a6a01136 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.615425+0000", 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00027738200000000001, 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036199799999999999, 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.621 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15203 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615425+0000", 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615425+0000", 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615427+0000", 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.488e-06 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615433+0000", 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9200000000000001e-06 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615451+0000", 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7856999999999999e-05 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615464+0000", 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3696000000000001e-05 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15209 3.4 3:22a6ee93:::rbd_data.10f18b35ff50.0000000000000025:1d [read 14336~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.615510+0000", 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00019323300000000001, 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033307500000000001, 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15209 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.625 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615510+0000", 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615510+0000", 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615511+0000", 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3680000000000001e-06 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615517+0000", 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4489999999999996e-06 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615536+0000", 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9065000000000001e-05 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615551+0000", 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4302e-05 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615666+0000", 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.5581.0:15178 3.a e128/73 3:50560e30:::rbd_data.10f1f0517cfe.0000000000000001:head v 128'474, mlcod=127'472)", 2024-09-14T08:41:57.628 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.615562+0000", 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00014115300000000001, 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000338921, 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615562+0000", 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615562+0000", 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615563+0000", 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.347e-06 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615573+0000", 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7350000000000008e-06 2024-09-14T08:41:57.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615594+0000", 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0931e-05 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615606+0000", 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2693e-05 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:41:57.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615696+0000", 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9343000000000002e-05 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615715+0000", 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8929000000000001e-05 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15212 3.16 3.7ba90556 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.615589+0000", 2024-09-14T08:41:57.632 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.000113578, 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036573399999999999, 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15212 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615589+0000", 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615589+0000", 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615590+0000", 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.108e-06 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615597+0000", 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.331e-06 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615663+0000", 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5797999999999996e-05 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615677+0000", 2024-09-14T08:41:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4671000000000001e-05 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15214 3.16 3.a6a01136 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.615712+0000", 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9999914, 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000295588, 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15214 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615712+0000", 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615712+0000", 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615713+0000", 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-06 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615719+0000", 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0569999999999998e-06 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615751+0000", 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1844999999999997e-05 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615764+0000", 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3343000000000001e-05 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15217 3.16 3.13cdce76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.615798+0000", 2024-09-14T08:41:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9999051, 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026882300000000001, 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15217 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615798+0000", 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615798+0000", 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615799+0000", 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.097e-06 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615805+0000", 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.874e-06 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615820+0000", 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5979000000000001e-05 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615833+0000", 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2626000000000001e-05 2024-09-14T08:41:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15221 3.4 3.e71e77c4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.615870+0000", 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9998331, 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000252451, 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15221 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615870+0000", 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615870+0000", 2024-09-14T08:41:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615871+0000", 2024-09-14T08:41:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.206e-06 2024-09-14T08:41:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615881+0000", 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0445000000000001e-05 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615899+0000", 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7510999999999999e-05 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615927+0000", 2024-09-14T08:41:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8252999999999999e-05 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15223 3.4 3.c9776544 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.615960+0000", 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.999743, 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000220621, 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15223 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615960+0000", 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615960+0000", 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615961+0000", 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1200000000000001e-06 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615967+0000", 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9030000000000001e-06 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615984+0000", 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7181999999999999e-05 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.615997+0000", 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.322e-05 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15227 3.16 3.7ba90556 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616016+0000", 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9996867, 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000222418, 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15227 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616016+0000", 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616016+0000", 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616017+0000", 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.077e-06 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616022+0000", 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7280000000000003e-06 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616038+0000", 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5460000000000001e-05 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616050+0000", 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2534000000000001e-05 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15229 3.4 3.b3621124 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616111+0000", 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9995914, 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018189200000000001, 2024-09-14T08:41:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15229 2024-09-14T08:41:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616111+0000", 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616111+0000", 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616113+0000", 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.237e-06 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616132+0000", 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9051000000000001e-05 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616151+0000", 2024-09-14T08:41:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9253999999999999e-05 2024-09-14T08:41:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616179+0000", 2024-09-14T08:41:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8279000000000001e-05 2024-09-14T08:41:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15231 3.13 3.2e6789b3 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616198+0000", 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9995046, 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015013099999999999, 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15231 2024-09-14T08:41:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616198+0000", 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616198+0000", 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616200+0000", 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.235e-06 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616205+0000", 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3079999999999998e-06 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616222+0000", 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6925000000000001e-05 2024-09-14T08:41:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616235+0000", 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3247999999999999e-05 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15238 3.4 3.c9776544 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616288+0000", 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9994149, 2024-09-14T08:41:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116978, 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15238 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616288+0000", 2024-09-14T08:41:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616288+0000", 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616289+0000", 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-06 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616300+0000", 2024-09-14T08:41:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0865e-05 2024-09-14T08:41:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616317+0000", 2024-09-14T08:41:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.738e-05 2024-09-14T08:41:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616330+0000", 2024-09-14T08:41:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2982e-05 2024-09-14T08:41:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15239 3.16 3.13cdce76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616350+0000", 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9993529, 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100197, 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15239 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616350+0000", 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616350+0000", 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616351+0000", 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1799999999999999e-06 2024-09-14T08:41:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616372+0000", 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0628e-05 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616404+0000", 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2107999999999998e-05 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616417+0000", 2024-09-14T08:41:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2811e-05 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15241 3.16 3.7ba90556 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616434+0000", 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.999269, 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7092000000000001e-05, 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15241 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616434+0000", 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616434+0000", 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616435+0000", 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.012e-06 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616440+0000", 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2800000000000003e-06 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616457+0000", 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6252999999999998e-05 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616469+0000", 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2237e-05 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15246 3.16 3.13cdce76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616486+0000", 2024-09-14T08:41:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9992166, 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7073e-05, 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15246 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616486+0000", 2024-09-14T08:41:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616486+0000", 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616487+0000", 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.02e-06 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616492+0000", 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6349999999999997e-06 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616507+0000", 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5299e-05 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616519+0000", 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1894e-05 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15248 3.4 3.e71e77c4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616536+0000", 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9991665, 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9431000000000007e-05, 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15248 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616536+0000", 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616536+0000", 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616537+0000", 2024-09-14T08:41:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1319999999999999e-06 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616542+0000", 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8620000000000002e-06 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616558+0000", 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.562e-05 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616570+0000", 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2522e-05 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15252 3.4 3.8e936e44 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616588+0000", 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9991155, 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3738000000000004e-05, 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15252 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616588+0000", 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616588+0000", 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616589+0000", 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.083e-06 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616593+0000", 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6999999999999999e-06 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616609+0000", 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5679999999999999e-05 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616621+0000", 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1928e-05 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15256 3.4 3.b3621124 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616638+0000", 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9990649, 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3942000000000005e-05, 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15256 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616638+0000", 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616638+0000", 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616639+0000", 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0219999999999999e-06 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616644+0000", 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.809e-06 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616659+0000", 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5217e-05 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616671+0000", 2024-09-14T08:41:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2522e-05 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5581.0:15257 3.13 3.2e6789b3 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:57.616710+0000", 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9989934, 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3389e-05, 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:41:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5581", 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/752470196", 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15257 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616710+0000", 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616710+0000", 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:41:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616711+0000", 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.097e-06 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616716+0000", 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.383e-06 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616733+0000", 2024-09-14T08:41:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756999999999999e-05 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:57.616746+0000", 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3125000000000001e-05 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 20 2024-09-14T08:41:57.690 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:41:57.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:41:57.692 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:57.689+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:57.728 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:41:57.728 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:41:57.744 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:41:57.745 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:41:57.761 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:41:57.761 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:41:57.779 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:41:57.779 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:41:57.792 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:57.789+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:57.796 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:41:57.796 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:41:57.813 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:41:57.813 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:41:57.851 INFO:teuthology.orchestra.run.smithi188.stdout:3708 trunc from 0x91800 to 0x9751200 2024-09-14T08:41:57.862 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:57.862 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:57.867 INFO:teuthology.orchestra.run.smithi188.stdout:3709 read 0x257a800 thru 0x2588b05 (0xe306 bytes) 2024-09-14T08:41:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:3712 punch from 0x101000 to 0x102e00, (0x1e00 bytes) 2024-09-14T08:41:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:3713 read 0x490ac00 thru 0x491910a (0xe50b bytes) 2024-09-14T08:41:57.875 INFO:teuthology.orchestra.run.smithi188.stdout:3714 trunc from 0x9751200 to 0xb92a600 2024-09-14T08:41:57.877 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:41:57.894 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:57.891+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:41:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:3715 punch from 0xa49f000 to 0xa4ab200, (0xc200 bytes) 2024-09-14T08:41:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:3716 punch from 0xb80000 to 0xb84200, (0x4200 bytes) 2024-09-14T08:41:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:3718 read 0x4c5aa00 thru 0x4c64567 (0x9b68 bytes) 2024-09-14T08:41:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:3719 write 0x5a13800 thru 0x5a1ce22 (0x9623 bytes) 2024-09-14T08:41:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:3720 read 0x59fa600 thru 0x5a037aa (0x91ab bytes) 2024-09-14T08:41:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:3724 punch from 0x9658000 to 0x965b200, (0x3200 bytes) 2024-09-14T08:41:57.898 INFO:teuthology.orchestra.run.smithi188.stdout:3731 read 0xe15200 thru 0xe1ac83 (0x5a84 bytes) 2024-09-14T08:41:57.905 INFO:teuthology.orchestra.run.smithi188.stdout:3732 trunc from 0xb92a600 to 0x83cd600 2024-09-14T08:41:57.935 INFO:teuthology.orchestra.run.smithi188.stdout:3733 punch from 0xa01e00 to 0xa04400, (0x2600 bytes) 2024-09-14T08:41:57.937 INFO:teuthology.orchestra.run.smithi188.stdout:3734 punch from 0x974a00 to 0x97f800, (0xae00 bytes) 2024-09-14T08:41:57.937 INFO:teuthology.orchestra.run.smithi188.stdout:3736 write 0x364d200 thru 0x3657d3f (0xab40 bytes) 2024-09-14T08:41:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:3737 trunc from 0x83cd600 to 0x5a5e800 2024-09-14T08:41:57.972 INFO:teuthology.orchestra.run.smithi188.stdout:3738 read 0x31cb600 thru 0x31cda36 (0x2437 bytes) 2024-09-14T08:41:57.988 INFO:teuthology.orchestra.run.smithi188.stdout:3740 trunc from 0x5a5e800 to 0x90000 2024-09-14T08:41:57.994 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:57.993+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:58.050 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:58.050 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:58.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:41:58.071 INFO:teuthology.orchestra.run.smithi188.stdout:3741 trunc from 0x90000 to 0xb782800 2024-09-14T08:41:58.100 INFO:teuthology.orchestra.run.smithi188.stdout:3742 trunc from 0xb782800 to 0x8034200 2024-09-14T08:41:58.111 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:58.111+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:41:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:3745 read 0x6b46600 thru 0x6b47046 (0xa47 bytes) 2024-09-14T08:41:58.118 INFO:teuthology.orchestra.run.smithi188.stdout:3746 write 0x3dfcc00 thru 0x3e0b03b (0xe43c bytes) 2024-09-14T08:41:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:3747 trunc from 0x8034200 to 0x2fa6c00 2024-09-14T08:41:58.179 INFO:teuthology.orchestra.run.smithi188.stdout:3752 read 0x29c9800 thru 0x29d83fb (0xebfc bytes) 2024-09-14T08:41:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:3753 read 0x1c03600 thru 0x1c10884 (0xd285 bytes) 2024-09-14T08:41:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:3755 read 0x102d200 thru 0x103aa6b (0xd86c bytes) 2024-09-14T08:41:58.196 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:58.195+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:41:58.202 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:58.202 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:58.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:41:58.219 INFO:teuthology.orchestra.run.smithi188.stdout:3757 write 0x8ef3800 thru 0x8f003b1 (0xcbb2 bytes) 2024-09-14T08:41:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:3758 write 0x3007800 thru 0x3016d4d (0xf54e bytes) 2024-09-14T08:41:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:3760 read 0x7dea200 thru 0x7df789c (0xd69d bytes) 2024-09-14T08:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout:3762 trunc from 0x8f00400 to 0x6289000 2024-09-14T08:41:58.278 INFO:teuthology.orchestra.run.smithi188.stdout:3764 punch from 0x5592600 to 0x559e200, (0xbc00 bytes) 2024-09-14T08:41:58.298 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:58.297+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:58.315 INFO:teuthology.orchestra.run.smithi188.stdout:3766 write 0xca3d200 thru 0xca40488 (0x3289 bytes) 2024-09-14T08:41:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:3767 read 0x8f6f600 thru 0x8f736f0 (0x40f1 bytes) 2024-09-14T08:41:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:3768 trunc from 0xca40600 to 0x8796c00 2024-09-14T08:41:58.377 INFO:teuthology.orchestra.run.smithi188.stdout:3770 read 0x436ce00 thru 0x437bf8a (0xf18b bytes) 2024-09-14T08:41:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:3771 read 0x311a00 thru 0x31820c (0x680d bytes) 2024-09-14T08:41:58.383 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:58.383 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:58.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:41:58.398 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:58.395+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:58.413 INFO:teuthology.orchestra.run.smithi188.stdout:3772 write 0xd6a3800 thru 0xd6b0765 (0xcf66 bytes) 2024-09-14T08:41:58.414 INFO:teuthology.orchestra.run.smithi188.stdout:3773 punch from 0x6570200 to 0x6572800, (0x2600 bytes) 2024-09-14T08:41:58.415 INFO:teuthology.orchestra.run.smithi188.stdout:3774 read 0x2aa9200 thru 0x2ab3031 (0x9e32 bytes) 2024-09-14T08:41:58.434 INFO:teuthology.orchestra.run.smithi188.stdout:3775 trunc from 0xd6b0800 to 0x1b34e00 2024-09-14T08:41:58.470 INFO:teuthology.orchestra.run.smithi188.stdout:3777 read 0xac0a00 thru 0xac7e04 (0x7405 bytes) 2024-09-14T08:41:58.498 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:58.497+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:58.509 INFO:teuthology.orchestra.run.smithi188.stdout:3778 write 0x6ce8c00 thru 0x6ce93e5 (0x7e6 bytes) 2024-09-14T08:41:58.511 INFO:teuthology.orchestra.run.smithi188.stdout:3782 write 0x3ff1a00 thru 0x3ff3dea (0x23eb bytes) 2024-09-14T08:41:58.511 INFO:teuthology.orchestra.run.smithi188.stdout:3783 read 0x6905c00 thru 0x690eae1 (0x8ee2 bytes) 2024-09-14T08:41:58.562 INFO:teuthology.orchestra.run.smithi188.stdout:3786 write 0xe94e800 thru 0xe94fef5 (0x16f6 bytes) 2024-09-14T08:41:58.564 INFO:teuthology.orchestra.run.smithi188.stdout:3788 write 0x4662a00 thru 0x466b4be (0x8abf bytes) 2024-09-14T08:41:58.564 INFO:teuthology.orchestra.run.smithi188.stdout:3790 read 0x803e600 thru 0x8043e02 (0x5803 bytes) 2024-09-14T08:41:58.565 INFO:teuthology.orchestra.run.smithi188.stdout:3792 read 0x754b000 thru 0x75577ba (0xc7bb bytes) 2024-09-14T08:41:58.565 INFO:teuthology.orchestra.run.smithi188.stdout:3793 punch from 0x337ca00 to 0x3383c00, (0x7200 bytes) 2024-09-14T08:41:58.565 INFO:teuthology.orchestra.run.smithi188.stdout:3797 read 0xa40f600 thru 0xa41e18a (0xeb8b bytes) 2024-09-14T08:41:58.566 INFO:teuthology.orchestra.run.smithi188.stdout:3798 read 0xd9c0e00 thru 0xd9c96ed (0x88ee bytes) 2024-09-14T08:41:58.567 INFO:teuthology.orchestra.run.smithi188.stdout:3800 trunc from 0xe950000 to 0xe1bd000 2024-09-14T08:41:58.570 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:58.570 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:58.585 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:41:58.599 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:58.597+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:3802 trunc from 0xe1bd000 to 0xa241400 2024-09-14T08:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout:3803 trunc from 0xa241400 to 0xcd48800 2024-09-14T08:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout:3804 trunc from 0xcd48800 to 0xb93b200 2024-09-14T08:41:58.699 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:58.697+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout:3811 write 0x848d200 thru 0x848ece1 (0x1ae2 bytes) 2024-09-14T08:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout:3812 write 0x4402800 thru 0x4407bb5 (0x53b6 bytes) 2024-09-14T08:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout:3818 read 0x682de00 thru 0x683cbc4 (0xedc5 bytes) 2024-09-14T08:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout:3819 trunc from 0xb93b200 to 0xb968e00 2024-09-14T08:41:58.711 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:58.711 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:58.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:41:58.734 INFO:teuthology.orchestra.run.smithi188.stdout:3820 read 0x3419200 thru 0x3423b7c (0xa97d bytes) 2024-09-14T08:41:58.755 INFO:teuthology.orchestra.run.smithi188.stdout:3821 trunc from 0xb968e00 to 0x350ea00 2024-09-14T08:41:58.799 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:58.797+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:3824 write 0x94e0000 thru 0x94e437f (0x4380 bytes) 2024-09-14T08:41:58.840 INFO:teuthology.orchestra.run.smithi188.stdout:3827 trunc from 0x94e4400 to 0x3aebc00 2024-09-14T08:41:58.855 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:58.855 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:58.870 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:41:58.900 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:58.897+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:58.993 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:58.993 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:59.001 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:41:59.001+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:41:59.007 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:41:59.102 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:59.101+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:59.125 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:59.125 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:59.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:41:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:3828 write 0xab76200 thru 0xab7bf94 (0x5d95 bytes) 2024-09-14T08:41:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:3832 punch from 0x6119400 to 0x611d000, (0x3c00 bytes) 2024-09-14T08:41:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:3834 read 0x936dc00 thru 0x9379bbd (0xbfbe bytes) 2024-09-14T08:41:59.175 INFO:teuthology.orchestra.run.smithi188.stdout:3835 punch from 0x1da7c00 to 0x1dadc00, (0x6000 bytes) 2024-09-14T08:41:59.175 INFO:teuthology.orchestra.run.smithi188.stdout:3836 read 0x3516a00 thru 0x35228d1 (0xbed2 bytes) 2024-09-14T08:41:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:3839 write 0x1276a00 thru 0x1285faa (0xf5ab bytes) 2024-09-14T08:41:59.177 INFO:teuthology.orchestra.run.smithi188.stdout:3840 write 0x2460c00 thru 0x246bb20 (0xaf21 bytes) 2024-09-14T08:41:59.177 INFO:teuthology.orchestra.run.smithi188.stdout:3844 write 0x5b89800 thru 0x5b8dcfb (0x44fc bytes) 2024-09-14T08:41:59.177 INFO:teuthology.orchestra.run.smithi188.stdout:3845 punch from 0x76cdc00 to 0x76d8000, (0xa400 bytes) 2024-09-14T08:41:59.178 INFO:teuthology.orchestra.run.smithi188.stdout:3849 punch from 0x818a400 to 0x8198200, (0xde00 bytes) 2024-09-14T08:41:59.178 INFO:teuthology.orchestra.run.smithi188.stdout:3853 punch from 0x8ba1600 to 0x8ba1c00, (0x600 bytes) 2024-09-14T08:41:59.178 INFO:teuthology.orchestra.run.smithi188.stdout:3856 write 0x321ea00 thru 0x3221850 (0x2e51 bytes) 2024-09-14T08:41:59.189 INFO:teuthology.orchestra.run.smithi188.stdout:3858 trunc from 0xab7c000 to 0x4803600 2024-09-14T08:41:59.203 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:59.201+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:59.248 INFO:teuthology.orchestra.run.smithi188.stdout:3859 read 0xceb200 thru 0xcefdcd (0x4bce bytes) 2024-09-14T08:41:59.251 INFO:teuthology.orchestra.run.smithi188.stdout:3861 read 0x2c42c00 thru 0x2c4a766 (0x7b67 bytes) 2024-09-14T08:41:59.261 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:59.261 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:59.276 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:41:59.288 INFO:teuthology.orchestra.run.smithi188.stdout:3862 write 0x9fe4e00 thru 0x9ff36ab (0xe8ac bytes) 2024-09-14T08:41:59.289 INFO:teuthology.orchestra.run.smithi188.stdout:3865 read 0x37b7200 thru 0x37c6288 (0xf089 bytes) 2024-09-14T08:41:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:3867 read 0x3ea5000 thru 0x3eab3dc (0x63dd bytes) 2024-09-14T08:41:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:3868 punch from 0x16d2a00 to 0x16d5a00, (0x3000 bytes) 2024-09-14T08:41:59.291 INFO:teuthology.orchestra.run.smithi188.stdout:3869 write 0x1e68400 thru 0x1e71526 (0x9127 bytes) 2024-09-14T08:41:59.300 INFO:teuthology.orchestra.run.smithi188.stdout:3870 trunc from 0x9ff3800 to 0x6980e00 2024-09-14T08:41:59.303 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:59.301+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:59.348 INFO:teuthology.orchestra.run.smithi188.stdout:3871 trunc from 0x6980e00 to 0x2f35600 2024-09-14T08:41:59.378 INFO:teuthology.orchestra.run.smithi188.stdout:3872 read 0x2920c00 thru 0x29272e1 (0x66e2 bytes) 2024-09-14T08:41:59.380 INFO:teuthology.orchestra.run.smithi188.stdout:3874 punch from 0x1402200 to 0x1408000, (0x5e00 bytes) 2024-09-14T08:41:59.380 INFO:teuthology.orchestra.run.smithi188.stdout:3876 write 0x23e4c00 thru 0x23f2bee (0xdfef bytes) 2024-09-14T08:41:59.381 INFO:teuthology.orchestra.run.smithi188.stdout:3877 punch from 0xc54200 to 0xc5c000, (0x7e00 bytes) 2024-09-14T08:41:59.381 INFO:teuthology.orchestra.run.smithi188.stdout:3879 read 0xa7ee00 thru 0xa8e28a (0xf48b bytes) 2024-09-14T08:41:59.404 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:41:59.403+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:41:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:3880 write 0x5ea2200 thru 0x5ea2feb (0xdec bytes) 2024-09-14T08:41:59.415 INFO:teuthology.orchestra.run.smithi188.stdout:3881 trunc from 0x5ea3000 to 0x58dd000 2024-09-14T08:41:59.415 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:59.416 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:59.430 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:41:59.455 INFO:teuthology.orchestra.run.smithi188.stdout:3882 trunc from 0x58dd000 to 0x798a800 2024-09-14T08:41:59.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:41:59.475 INFO:teuthology.orchestra.run.smithi188.stdout:3883 punch from 0x1a38e00 to 0x1a3e800, (0x5a00 bytes) 2024-09-14T08:41:59.478 INFO:teuthology.orchestra.run.smithi188.stdout:3885 read 0xbea000 thru 0xbf060b (0x660c bytes) 2024-09-14T08:41:59.496 INFO:teuthology.orchestra.run.smithi188.stdout:3887 trunc from 0x798a800 to 0x216400 2024-09-14T08:41:59.519 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:41:59.519+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:41:59.531 INFO:teuthology.orchestra.run.smithi188.stdout:3889 read 0x10cc00 thru 0x119157 (0xc558 bytes) 2024-09-14T08:41:59.554 INFO:teuthology.orchestra.run.smithi188.stdout:3891 trunc from 0x216400 to 0x88d0400 2024-09-14T08:41:59.574 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:59.574 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:59.575 INFO:teuthology.orchestra.run.smithi188.stdout:3892 read 0x476c200 thru 0x477320c (0x700d bytes) 2024-09-14T08:41:59.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:41:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:3894 write 0xa560a00 thru 0xa569df9 (0x93fa bytes) 2024-09-14T08:41:59.606 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:59.603+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:59.622 INFO:teuthology.orchestra.run.smithi188.stdout:3896 write 0xc03e800 thru 0xc042ed8 (0x46d9 bytes) 2024-09-14T08:41:59.624 INFO:teuthology.orchestra.run.smithi188.stdout:3897 read 0xbcc9600 thru 0xbccb817 (0x2218 bytes) 2024-09-14T08:41:59.644 INFO:teuthology.orchestra.run.smithi188.stdout:3902 write 0xcadc400 thru 0xcade27b (0x1e7c bytes) 2024-09-14T08:41:59.644 INFO:teuthology.orchestra.run.smithi188.stdout:3905 punch from 0x8f74000 to 0x8f7c000, (0x8000 bytes) 2024-09-14T08:41:59.644 INFO:teuthology.orchestra.run.smithi188.stdout:3908 read 0x6089200 thru 0x608dba8 (0x49a9 bytes) 2024-09-14T08:41:59.664 INFO:teuthology.orchestra.run.smithi188.stdout:3910 write 0xed97600 thru 0xed9f09a (0x7a9b bytes) 2024-09-14T08:41:59.666 INFO:teuthology.orchestra.run.smithi188.stdout:3911 write 0xcfa0400 thru 0xcfaa91b (0xa51c bytes) 2024-09-14T08:41:59.666 INFO:teuthology.orchestra.run.smithi188.stdout:3915 read 0x22eaa00 thru 0x22ecde8 (0x23e9 bytes) 2024-09-14T08:41:59.695 INFO:teuthology.orchestra.run.smithi188.stdout:3916 trunc from 0xed9f200 to 0x1109200 2024-09-14T08:41:59.707 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:41:59.705+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:41:59.721 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:59.721 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:59.736 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout:3921 read 0x4ee000 thru 0x4f63f8 (0x83f9 bytes) 2024-09-14T08:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:3923 write 0x12ae400 thru 0x12bc97c (0xe57d bytes) 2024-09-14T08:41:59.808 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:41:59.807+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout:3924 write 0xaa5b400 thru 0xaa63c98 (0x8899 bytes) 2024-09-14T08:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout:3925 write 0x9ee6400 thru 0x9eedbcd (0x77ce bytes) 2024-09-14T08:41:59.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:41:59.846 INFO:teuthology.orchestra.run.smithi188.stdout:3926 write 0xc391e00 thru 0xc39b8d1 (0x9ad2 bytes) 2024-09-14T08:41:59.857 INFO:teuthology.orchestra.run.smithi188.stdout:3927 trunc from 0xc39ba00 to 0x88b9a00 2024-09-14T08:41:59.870 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:41:59.898 INFO:teuthology.orchestra.run.smithi188.stdout:3929 write 0x3e36400 thru 0x3e3b7cc (0x53cd bytes) 2024-09-14T08:41:59.909 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:41:59.909+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:41:59.914 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:41:59.914 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:41:59.918 INFO:teuthology.orchestra.run.smithi188.stdout:3934 write 0x89b5000 thru 0x89c410b (0xf10c bytes) 2024-09-14T08:41:59.919 INFO:teuthology.orchestra.run.smithi188.stdout:3936 punch from 0x750e600 to 0x751a600, (0xc000 bytes) 2024-09-14T08:41:59.920 INFO:teuthology.orchestra.run.smithi188.stdout:3940 read 0x697de00 thru 0x6988e31 (0xb032 bytes) 2024-09-14T08:41:59.920 INFO:teuthology.orchestra.run.smithi188.stdout:3942 read 0x5534800 thru 0x553b047 (0x6848 bytes) 2024-09-14T08:41:59.923 INFO:teuthology.orchestra.run.smithi188.stdout:3943 trunc from 0x89c4200 to 0x7cba600 2024-09-14T08:41:59.930 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:41:59.965 INFO:teuthology.orchestra.run.smithi188.stdout:3945 write 0x8991000 thru 0x89989ea (0x79eb bytes) 2024-09-14T08:41:59.967 INFO:teuthology.orchestra.run.smithi188.stdout:3946 write 0x5797e00 thru 0x57a00e0 (0x82e1 bytes) 2024-09-14T08:41:59.983 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:41:59.983 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:41:59.990 INFO:teuthology.orchestra.run.smithi188.stdout:3948 write 0xaa0a800 thru 0xaa1319e (0x899f bytes) 2024-09-14T08:41:59.991 INFO:teuthology.orchestra.run.smithi188.stdout:3950 write 0xa852600 thru 0xa85700d (0x4a0e bytes) 2024-09-14T08:41:59.992 INFO:teuthology.orchestra.run.smithi188.stdout:3954 read 0x96ba400 thru 0x96bd9a6 (0x35a7 bytes) 2024-09-14T08:41:59.992 INFO:teuthology.orchestra.run.smithi188.stdout:3956 write 0x4258e00 thru 0x4263d53 (0xaf54 bytes) 2024-09-14T08:41:59.992 INFO:teuthology.orchestra.run.smithi188.stdout:3957 punch from 0x3abe800 to 0x3ac8e00, (0xa600 bytes) 2024-09-14T08:41:59.993 INFO:teuthology.orchestra.run.smithi188.stdout:3959 write 0x23a5200 thru 0x23aa00b (0x4e0c bytes) 2024-09-14T08:41:59.993 INFO:teuthology.orchestra.run.smithi188.stdout:3960 punch from 0x2fdea00 to 0x2fe4800, (0x5e00 bytes) 2024-09-14T08:41:59.994 INFO:teuthology.orchestra.run.smithi188.stdout:3963 read 0x5e71600 thru 0x5e75d50 (0x4751 bytes) 2024-09-14T08:41:59.994 INFO:teuthology.orchestra.run.smithi188.stdout:3965 read 0x6477a00 thru 0x648377d (0xbd7e bytes) 2024-09-14T08:41:59.994 INFO:teuthology.orchestra.run.smithi188.stdout:3969 punch from 0x59d4c00 to 0x59e0600, (0xba00 bytes) 2024-09-14T08:41:59.994 INFO:teuthology.orchestra.run.smithi188.stdout:3971 read 0x8280e00 thru 0x82909d6 (0xfbd7 bytes) 2024-09-14T08:41:59.995 INFO:teuthology.orchestra.run.smithi188.stdout:3974 write 0x625bc00 thru 0x625d56c (0x196d bytes) 2024-09-14T08:41:59.995 INFO:teuthology.orchestra.run.smithi188.stdout:3976 write 0x4f9e000 thru 0x4fa60df (0x80e0 bytes) 2024-09-14T08:41:59.995 INFO:teuthology.orchestra.run.smithi188.stdout:3978 read 0x2f2e800 thru 0x2f3bce1 (0xd4e2 bytes) 2024-09-14T08:41:59.996 INFO:teuthology.orchestra.run.smithi188.stdout:3979 read 0x788a800 thru 0x78952b1 (0xaab2 bytes) 2024-09-14T08:41:59.996 INFO:teuthology.orchestra.run.smithi188.stdout:3981 trunc from 0xaa13200 to 0xac24800 2024-09-14T08:42:00.001 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:00.002 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:00.010 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:00.007+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:00.021 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:00.021 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:00.030 INFO:teuthology.orchestra.run.smithi188.stdout:3984 read 0x9de0000 thru 0x9dea65c (0xa65d bytes) 2024-09-14T08:42:00.031 INFO:teuthology.orchestra.run.smithi188.stdout:3986 read 0x8ecbc00 thru 0x8ed575e (0x9b5f bytes) 2024-09-14T08:42:00.039 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:00.039 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:00.049 INFO:teuthology.orchestra.run.smithi188.stdout:3988 write 0xc87c400 thru 0xc87c88c (0x48d bytes) 2024-09-14T08:42:00.049 INFO:teuthology.orchestra.run.smithi188.stdout:3991 write 0x4ad2e00 thru 0x4ad4c07 (0x1e08 bytes) 2024-09-14T08:42:00.049 INFO:teuthology.orchestra.run.smithi188.stdout:3993 write 0xdc6e00 thru 0xdd1157 (0xa358 bytes) 2024-09-14T08:42:00.050 INFO:teuthology.orchestra.run.smithi188.stdout:3994 read 0x35b0800 thru 0x35bf79f (0xefa0 bytes) 2024-09-14T08:42:00.050 INFO:teuthology.orchestra.run.smithi188.stdout:3995 read 0x9c56a00 thru 0x9c5b3a1 (0x49a2 bytes) 2024-09-14T08:42:00.050 INFO:teuthology.orchestra.run.smithi188.stdout:3997 read 0x24e600 thru 0x254813 (0x6214 bytes) 2024-09-14T08:42:00.051 INFO:teuthology.orchestra.run.smithi188.stdout:3999 write 0x28dec00 thru 0x28e3ba7 (0x4fa8 bytes) 2024-09-14T08:42:00.052 INFO:teuthology.orchestra.run.smithi188.stdout:4000 read 0x8adcc00 thru 0x8aeb34a (0xe74b bytes) 2024-09-14T08:42:00.052 INFO:teuthology.orchestra.run.smithi188.stdout:4004 read 0x1327800 thru 0x1329cda (0x24db bytes) 2024-09-14T08:42:00.052 INFO:teuthology.orchestra.run.smithi188.stdout:4006 read 0x6c85800 thru 0x6c85fb2 (0x7b3 bytes) 2024-09-14T08:42:00.052 INFO:teuthology.orchestra.run.smithi188.stdout:4007 read 0xa33cc00 thru 0xa34ae81 (0xe282 bytes) 2024-09-14T08:42:00.052 INFO:teuthology.orchestra.run.smithi188.stdout:4009 write 0xa896e00 thru 0xa89bd86 (0x4f87 bytes) 2024-09-14T08:42:00.053 INFO:teuthology.orchestra.run.smithi188.stdout:4012 punch from 0x41a0800 to 0x41afe00, (0xf600 bytes) 2024-09-14T08:42:00.054 INFO:teuthology.orchestra.run.smithi188.stdout:4014 punch from 0x6e84800 to 0x6e87c00, (0x3400 bytes) 2024-09-14T08:42:00.054 INFO:teuthology.orchestra.run.smithi188.stdout:4018 write 0x639e600 thru 0x63a6337 (0x7d38 bytes) 2024-09-14T08:42:00.054 INFO:teuthology.orchestra.run.smithi188.stdout:4020 read 0x6c90400 thru 0x6c9cba5 (0xc7a6 bytes) 2024-09-14T08:42:00.054 INFO:teuthology.orchestra.run.smithi188.stdout:4029 write 0x7c14c00 thru 0x7c2333a (0xe73b bytes) 2024-09-14T08:42:00.054 INFO:teuthology.orchestra.run.smithi188.stdout:4031 read 0x99ca800 thru 0x99d4cc7 (0xa4c8 bytes) 2024-09-14T08:42:00.055 INFO:teuthology.orchestra.run.smithi188.stdout:4032 read 0xb83a000 thru 0xb83c7bb (0x27bc bytes) 2024-09-14T08:42:00.055 INFO:teuthology.orchestra.run.smithi188.stdout:4033 punch from 0x4851200 to 0x4852600, (0x1400 bytes) 2024-09-14T08:42:00.056 INFO:teuthology.orchestra.run.smithi188.stdout:4034 write 0x1b7ec00 thru 0x1b87a92 (0x8e93 bytes) 2024-09-14T08:42:00.056 INFO:teuthology.orchestra.run.smithi188.stdout:4035 punch from 0x9a3dc00 to 0x9a3f400, (0x1800 bytes) 2024-09-14T08:42:00.056 INFO:teuthology.orchestra.run.smithi188.stdout:4037 write 0x1922a00 thru 0x192ff52 (0xd553 bytes) 2024-09-14T08:42:00.056 INFO:teuthology.orchestra.run.smithi188.stdout:4039 punch from 0x8fe8600 to 0x8ff5800, (0xd200 bytes) 2024-09-14T08:42:00.056 INFO:teuthology.orchestra.run.smithi188.stdout:4040 read 0x776fe00 thru 0x7778d74 (0x8f75 bytes) 2024-09-14T08:42:00.056 INFO:teuthology.orchestra.run.smithi188.stdout:4041 write 0x1908000 thru 0x1909d28 (0x1d29 bytes) 2024-09-14T08:42:00.056 INFO:teuthology.orchestra.run.smithi188.stdout:4042 punch from 0x670c00 to 0x677800, (0x6c00 bytes) 2024-09-14T08:42:00.056 INFO:teuthology.orchestra.run.smithi188.stdout:4043 punch from 0x3952e00 to 0x3959600, (0x6800 bytes) 2024-09-14T08:42:00.060 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:00.061 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:00.063 INFO:teuthology.orchestra.run.smithi188.stdout:4045 trunc from 0xc87ca00 to 0x8281800 2024-09-14T08:42:00.080 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:00.081 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:00.105 INFO:teuthology.orchestra.run.smithi188.stdout:4048 write 0x5ad0200 thru 0x5adbec8 (0xbcc9 bytes) 2024-09-14T08:42:00.111 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:00.109+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:00.118 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:00.118 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:00.118 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:00.118 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:00.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:00.140 INFO:teuthology.orchestra.run.smithi188.stdout:4049 write 0xeb1d000 thru 0xeb24686 (0x7687 bytes) 2024-09-14T08:42:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:4050 write 0x8249600 thru 0x8251ed9 (0x88da bytes) 2024-09-14T08:42:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:4053 write 0xd4f6400 thru 0xd4f769c (0x129d bytes) 2024-09-14T08:42:00.164 INFO:teuthology.orchestra.run.smithi188.stdout:4057 trunc from 0xeb24800 to 0x2f64000 2024-09-14T08:42:00.212 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:00.211+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:00.229 INFO:teuthology.orchestra.run.smithi188.stdout:4059 trunc from 0x2f64000 to 0x7a42e00 2024-09-14T08:42:00.246 INFO:teuthology.orchestra.run.smithi188.stdout:4061 write 0xfd9c00 thru 0xfe58be (0xbcbf bytes) 2024-09-14T08:42:00.247 INFO:teuthology.orchestra.run.smithi188.stdout:4062 write 0x5818200 thru 0x5821f68 (0x9d69 bytes) 2024-09-14T08:42:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:4065 punch from 0x3a62200 to 0x3a67a00, (0x5800 bytes) 2024-09-14T08:42:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:4067 write 0x3baa000 thru 0x3bb3067 (0x9068 bytes) 2024-09-14T08:42:00.284 INFO:teuthology.orchestra.run.smithi188.stdout:4069 write 0x911f800 thru 0x91212b4 (0x1ab5 bytes) 2024-09-14T08:42:00.285 INFO:teuthology.orchestra.run.smithi188.stdout:4071 read 0x123b200 thru 0x123dbed (0x29ee bytes) 2024-09-14T08:42:00.286 INFO:teuthology.orchestra.run.smithi188.stdout:4073 read 0x6aaf400 thru 0x6abc427 (0xd028 bytes) 2024-09-14T08:42:00.286 INFO:teuthology.orchestra.run.smithi188.stdout:4077 read 0x6115200 thru 0x611e2f3 (0x90f4 bytes) 2024-09-14T08:42:00.286 INFO:teuthology.orchestra.run.smithi188.stdout:4078 read 0x120da00 thru 0x1211766 (0x3d67 bytes) 2024-09-14T08:42:00.287 INFO:teuthology.orchestra.run.smithi188.stdout:4079 write 0x21c7600 thru 0x21d4b47 (0xd548 bytes) 2024-09-14T08:42:00.288 INFO:teuthology.orchestra.run.smithi188.stdout:4080 read 0x86bec00 thru 0x86c9006 (0xa407 bytes) 2024-09-14T08:42:00.292 INFO:teuthology.orchestra.run.smithi188.stdout:4081 trunc from 0x9121400 to 0xa263800 2024-09-14T08:42:00.313 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:00.313+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:00.314 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:00.315 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:00.315 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:00.315 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:00.315 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:00.316 INFO:teuthology.orchestra.run.smithi188.stdout:4082 read 0x88e3e00 thru 0x88e67e6 (0x29e7 bytes) 2024-09-14T08:42:00.317 INFO:teuthology.orchestra.run.smithi188.stdout:4083 punch from 0x8e49a00 to 0x8e4a000, (0x600 bytes) 2024-09-14T08:42:00.317 INFO:teuthology.orchestra.run.smithi188.stdout:4084 clone 29 order 21 su 1048576 sc 4 2024-09-14T08:42:00.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:00.414 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:00.411+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:00.502 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:00.502 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:00.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:00.502 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:00.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.502 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:42:00.502 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:00.502 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 104.76822426299999, 2024-09-14T08:42:00.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:42:00.503 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.503 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:00.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:42:00.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:00.503 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:42:00.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.509 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.232470438, 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:00.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:42:00.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:42:00.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:42:00.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:42:00.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:42:00.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:42:00.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:42:00.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:42:00.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:42:00.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:42:00.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:00.517 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.197805553999999, 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:00.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.197604583, 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.522 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.296929194000001, 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.527 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:42:00.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.296894979000001, 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.531 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.535 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.29685349, 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.536 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:42:00.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:42:00.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:00.540 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.296795008, 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:42:00.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.296765328999999, 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.545 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:42:00.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.549 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.296736119999998, 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.550 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:42:00.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.289129825, 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:42:00.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:42:00.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:42:00.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:42:00.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.289101835, 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.560 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:42:00.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:00.564 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.289073503000001, 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:42:00.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.289031743999999, 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.569 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:42:00.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.289002865, 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.288969055999999, 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:42:00.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.288936697, 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:42:00.583 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:00.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.280808894, 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.588 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.280777909000001, 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.592 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.280749003, 2024-09-14T08:42:00.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:00.600 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:00.602 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:00.602 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:00.603+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:00.702 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:00.701+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:00.728 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:00.728 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:00.728 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:00.728 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:00.742 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:00.803 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:00.803+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:00.904 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:00.901+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:00.908 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:00.908 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:00.909 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:00.909 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:00.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:01.005 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:01.003+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.020213102, 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:42:01.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.020155898, 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.108 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.020097014, 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:01.109 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:42:01.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:42:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:42:01.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.02003208799999, 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:42:01.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:42:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.019970637, 2024-09-14T08:42:01.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:01.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:42:01.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.019911103, 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:01.122 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:01.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:42:01.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:01.126 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.019851793, 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:01.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:42:01.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.019779761, 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:42:01.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:42:01.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.865079383999998, 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:01.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:01.139 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.865047958999995, 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:01.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:42:01.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:42:01.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:42:01.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.144 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.144 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:01.144 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:01.144 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 51.501184338999998, 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:42:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:42:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:42:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:42:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 51.501124988999997, 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:42:01.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:42:01.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:42:01.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:42:01.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 51.501085037000003, 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:01.156 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:01.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:42:01.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:42:01.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:42:01.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.017662084000001, 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:42:01.162 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:42:01.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:42:01.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:42:01.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:42:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:42:01.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:01.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:42:01.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:42:01.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.011269517999999, 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:01.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:42:01.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:42:01.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:01.175 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.251680098000001, 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.181 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.210940696000002, 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:01.182 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:42:01.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:42:01.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.943369612000001, 2024-09-14T08:42:01.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:01.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:42:01.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:42:01.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:01.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:42:01.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:42:01.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.879565717999998, 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.195 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:42:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:42:01.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:42:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:42:01.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:42:01.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.852094019999999, 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:01.201 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:01.208 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:01.208 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:01.208 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone28 from 0xa263800 (overlap 0x90000) to 0x56600 2024-09-14T08:42:01.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:01.210 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:01.209+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:01.310 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:01.307+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:01.346 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:01.346 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:01.346 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:01.346 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:01.361 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:01.447 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:01.447+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:01.512 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:01.509+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:01.525 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:01.525 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:01.525 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:01.526 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:01.526 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:01.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:01.627 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:01.627+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:01.708 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:01.708 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:01.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:01.708 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [] 2024-09-14T08:42:01.708 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:01.714 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:01.711+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:01.722 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:01.813 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-14T08:42:01.814 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:01.813+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:01.893 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:01.894 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:01.894 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:01.894 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:01.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:42:01.909 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:01.955 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:01.955+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:02.015 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:02.015+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:02.077 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:02.077 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:02.077 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:02.077 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:02.077 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:02.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:02.100 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:02.116 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:02.113+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:02.216 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:02.213+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:02.260 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:02.260 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:02.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:02.260 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:02.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.260 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:02.260 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:02.260 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 125.334694138, 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:02.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 125.33463936, 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.265 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.266 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.266 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.266 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:02.266 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:02.266 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:42:02.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.266 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:42:02.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.906868901, 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:42:02.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:42:02.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.914264833999994, 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:02.275 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:02.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:02.276 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:42:02.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.276 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:02.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:42:02.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:42:02.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.913426462999993, 2024-09-14T08:42:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:42:02.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:42:02.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.894918361999999, 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.285 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:42:02.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:42:02.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:42:02.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.290 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.290 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.290 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:02.290 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.894604153, 2024-09-14T08:42:02.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:42:02.291 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.292 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:42:02.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.292 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:02.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:02.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:42:02.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:42:02.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:42:02.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:42:02.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:42:02.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:42:02.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:42:02.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:42:02.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:42:02.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:42:02.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:42:02.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:42:02.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:42:02.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:42:02.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.299 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.300 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:02.300 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.892967827, 2024-09-14T08:42:02.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:42:02.300 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.301 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:42:02.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.302 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:02.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:02.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:42:02.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:42:02.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:42:02.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:42:02.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.892749867999999, 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:02.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:42:02.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.311 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.892454466, 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:42:02.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:42:02.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.892183631000002, 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.316 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.68099295, 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:42:02.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.680972916000002, 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:42:02.325 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.680951837999999, 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:42:02.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.680932244000001, 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.335 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.68091209, 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.339 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:02.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.680892694000001, 2024-09-14T08:42:02.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:02.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.347 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.674362894000001, 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:42:02.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:42:02.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:42:02.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:42:02.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:42:02.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.674343008000001, 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:42:02.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:42:02.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.674323634, 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:02.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:42:02.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:42:02.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:02.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:02.362 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:02.362 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5] out_osds: [3, 0] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:42:02.362 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:42:02.362 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-14T08:42:02.363 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T08:42:02.363 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T08:42:02.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-14T08:42:02.364 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:02.365 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:02.365 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:02.365 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:02.366 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:02.366 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:02.366 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:02.367 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:02.367 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:02.367 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:02.367 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:02.368 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:02.363+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:02.379 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:02.379 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:02.465 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:02.463+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:02.498 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:02.498 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T08:42:02.498 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:02.502 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:02.502 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:02.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:02.565 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:02.565+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:02.666 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:02.665+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:02.693 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:02.693 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:02.707 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:02.767 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:02.765+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:02.828 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:02.828 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:02.842 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:02.885 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:02.885+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:02.902 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:42:02.969 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:02.967+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:02.988 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:02.989 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:03.004 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:03.070 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:03.067+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:03.167 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:03.167 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:03.171 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:03.169+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:03.181 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:03.272 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:03.271+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:03.349 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:03.350 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:03.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:03.373 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:03.371+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:03.473 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:03.471+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:03.492 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:03.492 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:03.506 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:03.574 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:03.573+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:03.621 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:03.621 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:03.635 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:03.677 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:03.677+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:03.776 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:03.775+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:03.804 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:03.804 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:03.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:03.877 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:03.873+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:03.938 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:03.938 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:03.952 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:03.978 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:03.975+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:04.078 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:04.077+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:04.110 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:04.124 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:04.209 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:04.209+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:04.280 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:04.277+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:04.297 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:04.297 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:04.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:04.381 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:04.379+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:04.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:04.454 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:04.454 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:04.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:04.482 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:04.481+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:04.546 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:04.546 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:04.564 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:04.564 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:04.581 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:04.581 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:04.583 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:04.583+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:04.597 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:04.598 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:04.598 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:04.598 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:04.598 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:04.603 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:04.603 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:04.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:04.626 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:04.627 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:04.651 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:04.652 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:04.711 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:04.711+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:04.744 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [] 2024-09-14T08:42:04.744 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:04.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:04.785 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:04.785+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:04.886 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:04.885+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:04.922 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:04.923 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:04.925 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:42:04.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:04.987 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:04.985+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:05.009 INFO:teuthology.orchestra.run.smithi188.stdout:4085 write 0xe8de600 thru 0xe8ed18d (0xeb8e bytes) 2024-09-14T08:42:05.011 INFO:teuthology.orchestra.run.smithi188.stdout:4090 read 0xa5c6600 thru 0xa5ceea2 (0x88a3 bytes) 2024-09-14T08:42:05.011 INFO:teuthology.orchestra.run.smithi188.stdout:4091 write 0x26eba00 thru 0x26ed6b3 (0x1cb4 bytes) 2024-09-14T08:42:05.038 INFO:teuthology.orchestra.run.smithi188.stdout:4093 trunc from 0xe8ed200 to 0x6bd3200 2024-09-14T08:42:05.087 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:05.087+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:05.089 INFO:teuthology.orchestra.run.smithi188.stdout:4094 read 0x2271800 thru 0x2277fec (0x67ed bytes) 2024-09-14T08:42:05.091 INFO:teuthology.orchestra.run.smithi188.stdout:4095 punch from 0x66f6600 to 0x66f9800, (0x3200 bytes) 2024-09-14T08:42:05.092 INFO:teuthology.orchestra.run.smithi188.stdout:4097 write 0x192400 thru 0x19e18d (0xbd8e bytes) 2024-09-14T08:42:05.094 INFO:teuthology.orchestra.run.smithi188.stdout:4099 write 0xef2400 thru 0xf007d3 (0xe3d4 bytes) 2024-09-14T08:42:05.095 INFO:teuthology.orchestra.run.smithi188.stdout:4101 read 0x3260000 thru 0x3267ae7 (0x7ae8 bytes) 2024-09-14T08:42:05.108 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:05.109 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:05.109 INFO:teuthology.orchestra.run.smithi188.stdout:4102 trunc from 0x6bd3200 to 0xc150800 2024-09-14T08:42:05.125 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:05.149 INFO:teuthology.orchestra.run.smithi188.stdout:4103 read 0x266ec00 thru 0x267373e (0x4b3f bytes) 2024-09-14T08:42:05.152 INFO:teuthology.orchestra.run.smithi188.stdout:4104 read 0x5f97600 thru 0x5f97dd3 (0x7d4 bytes) 2024-09-14T08:42:05.152 INFO:teuthology.orchestra.run.smithi188.stdout:4105 write 0xb132800 thru 0xb133e1e (0x161f bytes) 2024-09-14T08:42:05.152 INFO:teuthology.orchestra.run.smithi188.stdout:4106 write 0x1887800 thru 0x188d372 (0x5b73 bytes) 2024-09-14T08:42:05.153 INFO:teuthology.orchestra.run.smithi188.stdout:4107 punch from 0x1ebfe00 to 0x1ec5c00, (0x5e00 bytes) 2024-09-14T08:42:05.154 INFO:teuthology.orchestra.run.smithi188.stdout:4108 write 0x7ca1400 thru 0x7cb091f (0xf520 bytes) 2024-09-14T08:42:05.154 INFO:teuthology.orchestra.run.smithi188.stdout:4109 read 0x3417800 thru 0x34247d6 (0xcfd7 bytes) 2024-09-14T08:42:05.188 INFO:teuthology.orchestra.run.smithi188.stdout:4110 write 0xcb57400 thru 0xcb575aa (0x1ab bytes) 2024-09-14T08:42:05.190 INFO:teuthology.orchestra.run.smithi188.stdout:4111 write 0xba7a400 thru 0xba7b768 (0x1369 bytes) 2024-09-14T08:42:05.191 INFO:teuthology.orchestra.run.smithi188.stdout:4112 punch from 0xc8f4400 to 0xc8f8600, (0x4200 bytes) 2024-09-14T08:42:05.191 INFO:teuthology.orchestra.run.smithi188.stdout:4113 read 0x9776e00 thru 0x9777c13 (0xe14 bytes) 2024-09-14T08:42:05.210 INFO:teuthology.orchestra.run.smithi188.stdout:4115 trunc from 0xcb57600 to 0x5d47c00 2024-09-14T08:42:05.215 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:05.215+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:05.258 INFO:teuthology.orchestra.run.smithi188.stdout:4121 read 0x2aa6c00 thru 0x2aa8399 (0x179a bytes) 2024-09-14T08:42:05.271 INFO:teuthology.orchestra.run.smithi188.stdout:4122 trunc from 0x5d47c00 to 0xa110c00 2024-09-14T08:42:05.286 INFO:teuthology.orchestra.run.smithi188.stdout:4123 write 0x8090a00 thru 0x809d2fa (0xc8fb bytes) 2024-09-14T08:42:05.288 INFO:teuthology.orchestra.run.smithi188.stdout:4125 read 0x6aaa600 thru 0x6aafe3f (0x5840 bytes) 2024-09-14T08:42:05.288 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:05.285+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:05.294 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:05.294 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:05.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:05.294 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 128.36889392200001, 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:05.295 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:42:05.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:05.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:42:05.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:42:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:42:05.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:42:05.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:42:05.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:42:05.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:05.300 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 128.36883914399999, 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:42:05.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.941068685, 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:42:05.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.309 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.948464618000003, 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:05.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:42:05.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.947626247000002, 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:05.315 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:42:05.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.929118146, 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.320 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:42:05.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.928803936999998, 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:42:05.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:42:05.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.329 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.927167611000002, 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:42:05.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.926949651999998, 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:42:05.334 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:42:05.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.926654249999999, 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:05.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:42:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.926383414999997, 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:42:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.715192733999999, 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:42:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:42:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.715172699999997, 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.715151622, 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:42:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.715132027999999, 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.715111874000002, 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:42:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.715092478000003, 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:42:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.708562678, 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:42:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.708542792000003, 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:42:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:42:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:42:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:42:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.708523417999999, 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:42:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:42:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:42:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:42:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:42:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.396 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:05.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:05.399 INFO:teuthology.orchestra.run.smithi188.stdout:4126 write 0xd4f4a00 thru 0xd4ff99b (0xaf9c bytes) 2024-09-14T08:42:05.399 INFO:teuthology.orchestra.run.smithi188.stdout:4128 punch from 0x4045c00 to 0x4046000, (0x400 bytes) 2024-09-14T08:42:05.399 INFO:teuthology.orchestra.run.smithi188.stdout:4131 read 0xe10000 thru 0xe1744f (0x7450 bytes) 2024-09-14T08:42:05.399 INFO:teuthology.orchestra.run.smithi188.stdout:4132 trunc from 0xd4ffa00 to 0xce52000 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4133 punch from 0xab86c00 to 0xab96200, (0xf600 bytes) 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4136 punch from 0x11ea600 to 0x11ec400, (0x1e00 bytes) 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4140 write 0x789000 thru 0x78fa25 (0x6a26 bytes) 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4141 write 0x99e000 thru 0x9a5b90 (0x7b91 bytes) 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4142 read 0x2f9a400 thru 0x2f9e653 (0x4254 bytes) 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4144 read 0x32d8000 thru 0x32e01f4 (0x81f5 bytes) 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4146 read 0x8db0e00 thru 0x8dbf50f (0xe710 bytes) 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4147 write 0x1ec1400 thru 0x1ec47d5 (0x33d6 bytes) 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4148 read 0x5ecec00 thru 0x5ed5130 (0x6531 bytes) 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4151 write 0x1bf0c00 thru 0x1bf2bac (0x1fad bytes) 2024-09-14T08:42:05.400 INFO:teuthology.orchestra.run.smithi188.stdout:4152 trunc from 0xce52000 to 0xc35d400 2024-09-14T08:42:05.401 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:05.397+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:05.409 INFO:teuthology.orchestra.run.smithi188.stdout:4153 punch from 0x2f3e800 to 0x2f49200, (0xaa00 bytes) 2024-09-14T08:42:05.412 INFO:teuthology.orchestra.run.smithi188.stdout:4154 read 0x18d5c00 thru 0x18d9ebd (0x42be bytes) 2024-09-14T08:42:05.413 INFO:teuthology.orchestra.run.smithi188.stdout:4160 write 0x2b86e00 thru 0x2b94a7c (0xdc7d bytes) 2024-09-14T08:42:05.421 INFO:teuthology.orchestra.run.smithi188.stdout:4162 trunc from 0xc35d400 to 0x9536e00 2024-09-14T08:42:05.466 INFO:teuthology.orchestra.run.smithi188.stdout:4164 write 0x1aa2e00 thru 0x1aa883e (0x5a3f bytes) 2024-09-14T08:42:05.473 INFO:teuthology.orchestra.run.smithi188.stdout:4165 trunc from 0x9536e00 to 0x8232c00 2024-09-14T08:42:05.498 INFO:teuthology.orchestra.run.smithi188.stdout:4166 punch from 0x4c29000 to 0x4c30200, (0x7200 bytes) 2024-09-14T08:42:05.498 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:05.497+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:05.501 INFO:teuthology.orchestra.run.smithi188.stdout:4168 write 0x7d29200 thru 0x7d38bfa (0xf9fb bytes) 2024-09-14T08:42:05.542 INFO:teuthology.orchestra.run.smithi188.stdout:4171 write 0xc9e3e00 thru 0xc9f299a (0xeb9b bytes) 2024-09-14T08:42:05.548 INFO:teuthology.orchestra.run.smithi188.stdout:4173 trunc from 0xc9f2a00 to 0xa166e00 2024-09-14T08:42:05.590 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:05.591 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:05.599 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:05.597+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:05.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:05.664 INFO:teuthology.orchestra.run.smithi188.stdout:4174 trunc from 0xa166e00 to 0x306600 2024-09-14T08:42:05.700 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:05.697+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:05.723 INFO:teuthology.orchestra.run.smithi188.stdout:4175 punch from 0x2c3600 to 0x2cf600, (0xc000 bytes) 2024-09-14T08:42:05.725 INFO:teuthology.orchestra.run.smithi188.stdout:4176 read 0x2c4600 thru 0x2c4e88 (0x889 bytes) 2024-09-14T08:42:05.730 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:05.730 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:05.730 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:05.730 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:05.730 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:05.730 INFO:teuthology.orchestra.run.smithi188.stdout:4177 read 0x2bb600 thru 0x2bfcb6 (0x46b7 bytes) 2024-09-14T08:42:05.744 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:05.779 INFO:teuthology.orchestra.run.smithi188.stdout:4178 write 0xed0cc00 thru 0xed19d8a (0xd18b bytes) 2024-09-14T08:42:05.784 INFO:teuthology.orchestra.run.smithi188.stdout:4181 trunc from 0xed19e00 to 0xd488600 2024-09-14T08:42:05.803 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:05.801+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:05.822 INFO:teuthology.orchestra.run.smithi188.stdout:4184 punch from 0x639ea00 to 0x639f800, (0xe00 bytes) 2024-09-14T08:42:05.824 INFO:teuthology.orchestra.run.smithi188.stdout:4185 punch from 0xac8d600 to 0xac91600, (0x4000 bytes) 2024-09-14T08:42:05.827 INFO:teuthology.orchestra.run.smithi188.stdout:4186 trunc from 0xd488600 to 0xc1fae00 2024-09-14T08:42:05.853 INFO:teuthology.orchestra.run.smithi188.stdout:4187 read 0x7faa400 thru 0x7fb6f31 (0xcb32 bytes) 2024-09-14T08:42:05.855 INFO:teuthology.orchestra.run.smithi188.stdout:4188 write 0x13f6a00 thru 0x14010fd (0xa6fe bytes) 2024-09-14T08:42:05.856 INFO:teuthology.orchestra.run.smithi188.stdout:4189 punch from 0x457c00 to 0x458e00, (0x1200 bytes) 2024-09-14T08:42:05.856 INFO:teuthology.orchestra.run.smithi188.stdout:4190 write 0x3b9fc00 thru 0x3ba9884 (0x9c85 bytes) 2024-09-14T08:42:05.856 INFO:teuthology.orchestra.run.smithi188.stdout:4191 punch from 0x8900000 to 0x890b800, (0xb800 bytes) 2024-09-14T08:42:05.860 INFO:teuthology.orchestra.run.smithi188.stdout:4192 trunc from 0xc1fae00 to 0xda8c000 2024-09-14T08:42:05.873 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:05.873 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:05.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:05.873 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:05.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.873 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:42:05.873 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:05.874 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 115.566468316, 2024-09-14T08:42:05.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:42:05.874 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.874 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.874 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:05.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:42:05.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:05.874 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.304358136999994, 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.304210965999999, 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.886 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:05.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:05.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:42:05.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.891 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.304069166000005, 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:42:05.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:42:05.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.896 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.740803399000001, 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.897 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:42:05.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.732512108999998, 2024-09-14T08:42:05.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:42:05.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.732488868000001, 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.732469603999998, 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:05.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:42:05.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.732450327999999, 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.915 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:42:05.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.919 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.732237874999999, 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.920 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:42:05.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.924 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.725024781999998, 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:42:05.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:42:05.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.725003569999998, 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:42:05.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.933 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.72498422, 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:42:05.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.724957181000001, 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.942 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.724938031000001, 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:42:05.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.724916446999998, 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.947 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:42:05.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.724897038000002, 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:42:05.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:42:05.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.724878162, 2024-09-14T08:42:05.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:42:05.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.716847326, 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:42:05.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.716820930000001, 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:05.965 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:05.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:42:05.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:05.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:05.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:05.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:42:05.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:42:05.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.969 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:05.969 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:05.969 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:05.970 INFO:teuthology.orchestra.run.smithi188.stdout:4194 write 0x6685a00 thru 0x6687eab (0x24ac bytes) 2024-09-14T08:42:05.971 INFO:teuthology.orchestra.run.smithi188.stdout:4195 trunc from 0xda8c000 to 0xe88b000 2024-09-14T08:42:05.971 INFO:teuthology.orchestra.run.smithi188.stdout:4199 trunc from 0xe88b000 to 0x61c7e00 2024-09-14T08:42:05.971 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:42:05.972 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:05.967+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:06.017 INFO:teuthology.orchestra.run.smithi188.stdout:4205 write 0x9172000 thru 0x917965e (0x765f bytes) 2024-09-14T08:42:06.021 INFO:teuthology.orchestra.run.smithi188.stdout:4207 trunc from 0x9179800 to 0xaa7c000 2024-09-14T08:42:06.050 INFO:teuthology.orchestra.run.smithi188.stdout:4208 trunc from 0xaa7c000 to 0x87e1e00 2024-09-14T08:42:06.071 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:06.069+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:06.087 INFO:teuthology.orchestra.run.smithi188.stdout:4209 punch from 0x3bbd000 to 0x3bc5000, (0x8000 bytes) 2024-09-14T08:42:06.089 INFO:teuthology.orchestra.run.smithi188.stdout:4212 write 0xe63400 thru 0xe694b4 (0x60b5 bytes) 2024-09-14T08:42:06.094 INFO:teuthology.orchestra.run.smithi188.stdout:4213 trunc from 0x87e1e00 to 0x6e72c00 2024-09-14T08:42:06.110 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:06.110 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:06.110 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:06.110 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:06.124 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:06.125 INFO:teuthology.orchestra.run.smithi188.stdout:4215 punch from 0x308a000 to 0x3093600, (0x9600 bytes) 2024-09-14T08:42:06.125 INFO:teuthology.orchestra.run.smithi188.stdout:4216 write 0x62f2c00 thru 0x62fa0ae (0x74af bytes) 2024-09-14T08:42:06.142 INFO:teuthology.orchestra.run.smithi188.stdout:4217 trunc from 0x6e72c00 to 0x9e0e00 2024-09-14T08:42:06.172 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:06.171+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:06.256 INFO:teuthology.orchestra.run.smithi188.stdout:4218 write 0xe216400 thru 0xe21b9cf (0x55d0 bytes) 2024-09-14T08:42:06.258 INFO:teuthology.orchestra.run.smithi188.stdout:4220 write 0x8af2600 thru 0x8af50cf (0x2ad0 bytes) 2024-09-14T08:42:06.258 INFO:teuthology.orchestra.run.smithi188.stdout:4225 read 0xc646400 thru 0xc64bc20 (0x5821 bytes) 2024-09-14T08:42:06.258 INFO:teuthology.orchestra.run.smithi188.stdout:4226 punch from 0xb4cfe00 to 0xb4d0200, (0x400 bytes) 2024-09-14T08:42:06.262 INFO:teuthology.orchestra.run.smithi188.stdout:4228 trunc from 0xe21ba00 to 0xc6f8200 2024-09-14T08:42:06.273 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:06.271+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:06.290 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:06.291 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:06.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:06.307 INFO:teuthology.orchestra.run.smithi188.stdout:4231 punch from 0x4aa6200 to 0x4aaf000, (0x8e00 bytes) 2024-09-14T08:42:06.311 INFO:teuthology.orchestra.run.smithi188.stdout:4232 write 0xbaad000 thru 0xbab2c80 (0x5c81 bytes) 2024-09-14T08:42:06.311 INFO:teuthology.orchestra.run.smithi188.stdout:4234 read 0xb1d5600 thru 0xb1e0b82 (0xb583 bytes) 2024-09-14T08:42:06.335 INFO:teuthology.orchestra.run.smithi188.stdout:4235 trunc from 0xc6f8200 to 0x3791000 2024-09-14T08:42:06.374 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:06.373+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:06.376 INFO:teuthology.orchestra.run.smithi188.stdout:4240 punch from 0x1804400 to 0x1808600, (0x4200 bytes) 2024-09-14T08:42:06.378 INFO:teuthology.orchestra.run.smithi188.stdout:4241 read 0x1e34800 thru 0x1e35abc (0x12bd bytes) 2024-09-14T08:42:06.378 INFO:teuthology.orchestra.run.smithi188.stdout:4242 punch from 0x33d3800 to 0x33d8600, (0x4e00 bytes) 2024-09-14T08:42:06.379 INFO:teuthology.orchestra.run.smithi188.stdout:4244 punch from 0x1639400 to 0x163ee00, (0x5a00 bytes) 2024-09-14T08:42:06.379 INFO:teuthology.orchestra.run.smithi188.stdout:4246 punch from 0x2401000 to 0x240e000, (0xd000 bytes) 2024-09-14T08:42:06.379 INFO:teuthology.orchestra.run.smithi188.stdout:4250 read 0xd49a00 thru 0xd4d6ba (0x3cbb bytes) 2024-09-14T08:42:06.379 INFO:teuthology.orchestra.run.smithi188.stdout:4253 read 0x2949a00 thru 0x294fb67 (0x6168 bytes) 2024-09-14T08:42:06.415 INFO:teuthology.orchestra.run.smithi188.stdout:4257 write 0xaf58200 thru 0xaf66590 (0xe391 bytes) 2024-09-14T08:42:06.417 INFO:teuthology.orchestra.run.smithi188.stdout:4258 trunc from 0xaf66600 to 0xad03800 2024-09-14T08:42:06.433 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:06.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18530822899999, 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:42:06.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:42:06.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.185246216, 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.439 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:42:06.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.443 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18517988599999, 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:42:06.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18512442599999, 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:42:06.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:42:06.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:42:06.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:42:06.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:06.452 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18506480600001, 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:42:06.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:42:06.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18498326599999, 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.457 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:42:06.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:42:06.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18492693799999, 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.461 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:06.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.465 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.184855443, 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:42:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:42:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:42:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:42:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:42:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18478257199999, 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:42:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:42:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18474036000001, 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:42:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:42:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18471052999999, 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:42:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:42:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:42:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18468223299999, 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:42:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:42:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18464113799999, 2024-09-14T08:42:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18461210800001, 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.184583624, 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18455548399999, 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:42:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:42:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.184526788, 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:42:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.184498031, 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:42:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:42:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:42:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.184469984, 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:42:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:42:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.18444000700001, 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:42:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:06.524 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:06.525 INFO:teuthology.orchestra.run.smithi188.stdout:4259 read 0x9605200 thru 0x96062ed (0x10ee bytes) 2024-09-14T08:42:06.526 INFO:teuthology.orchestra.run.smithi188.stdout:4260 trunc from 0xad03800 to 0x9a12a00 2024-09-14T08:42:06.526 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:06.527 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:06.523+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:06.528 INFO:teuthology.orchestra.run.smithi188.stdout:4261 write 0xc755c00 thru 0xc756f0f (0x1310 bytes) 2024-09-14T08:42:06.529 INFO:teuthology.orchestra.run.smithi188.stdout:4262 read 0xa8c8400 thru 0xa8ce4be (0x60bf bytes) 2024-09-14T08:42:06.530 INFO:teuthology.orchestra.run.smithi188.stdout:4264 read 0x3cf9200 thru 0x3d0781d (0xe61e bytes) 2024-09-14T08:42:06.530 INFO:teuthology.orchestra.run.smithi188.stdout:4265 write 0x8299a00 thru 0x829d0d7 (0x36d8 bytes) 2024-09-14T08:42:06.530 INFO:teuthology.orchestra.run.smithi188.stdout:4267 write 0x31e5000 thru 0x31e57db (0x7dc bytes) 2024-09-14T08:42:06.530 INFO:teuthology.orchestra.run.smithi188.stdout:4268 read 0x7367a00 thru 0x737008f (0x8690 bytes) 2024-09-14T08:42:06.531 INFO:teuthology.orchestra.run.smithi188.stdout:4269 read 0x35d2600 thru 0x35e258a (0xff8b bytes) 2024-09-14T08:42:06.531 INFO:teuthology.orchestra.run.smithi188.stdout:4273 write 0x5255200 thru 0x5262bac (0xd9ad bytes) 2024-09-14T08:42:06.531 INFO:teuthology.orchestra.run.smithi188.stdout:4276 clone 30 order 25 su 524288 sc 11 2024-09-14T08:42:06.626 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:06.623+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:06.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:06.698 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:06.698 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:06.699 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:06.699 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:06.713 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:06.727 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:06.727+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:06.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:06.823 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:06.828 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:06.825+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:06.833 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:06.834 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:06.834 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:06.834 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:06.834 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:06.839 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:06.839 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:06.847 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:06.856 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:06.857 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:06.876 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:06.877 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:06.893 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:06.894 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:06.915 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:06.916 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:06.928 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:06.927+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:07.017 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:07.017 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:07.028 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:07.025+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:07.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:07.130 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:07.127+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:07.147 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone29 from 0xc757000 (overlap 0x306600) to 0x26b800 2024-09-14T08:42:07.206 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:07.206 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:07.222 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:07.265 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:07.265+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:07.331 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:07.329+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:07.346 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:07.346 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:07.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:07.445 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:07.445+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:07.515 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5] out_osds: [3, 0] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:42:07.515 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:42:07.515 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T08:42:07.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T08:42:07.525 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:07.525 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:07.532 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:07.529+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:07.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:07.632 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:07.631+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:07.698 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:07.698 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:07.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:07.734 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:07.733+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:07.834 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:07.831+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:42:07.847 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 133, 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "57b092b7-5550-41a0-8f78-531de0e7c469", 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-09-14T08:38:48.610112+0000", 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-09-14T08:42:06.910851+0000", 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-09-14T08:41:54.399976+0000", 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-09-14T08:41:08.566849+0000", 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5801984, 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "noscrub", 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-09-14T08:42:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 7, 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 3, 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 6, 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "luminous", 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-09-14T08:42:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:00.306403+0000", 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:42:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:42:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "15", 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:42:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:42:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:42:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 6.059999942779541, 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 6.059999942779541, 2024-09-14T08:42:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.87890881299972534, 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.87999999523162842, 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:06.370159+0000", 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:42:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-09-14T08:42:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-09-14T08:42:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:42:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:42:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:42:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:42:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:42:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 2, 2024-09-14T08:42:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 19, 2024-09-14T08:42:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:42:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:42:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:42:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:42:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.9900000095367432, 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.9900000095367432, 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.67000001668930054, 2024-09-14T08:42:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.87890881299972534, 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.87999999523162842, 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "pool_client.0", 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-09-14T08:39:16.437713+0000", 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 8193, 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-09-14T08:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "is_stretch_pool": false, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-09-14T08:42:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "133", 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T08:42:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T08:42:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-09-14T08:42:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-09-14T08:42:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 32, 2024-09-14T08:42:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 133, 2024-09-14T08:42:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-09-14T08:42:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-09-14T08:42:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-09-14T08:42:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-09-14T08:42:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-09-14T08:42:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-09-14T08:42:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-09-14T08:42:07.868 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.059999942779541, 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.059999942779541, 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.67000001668930054, 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.87890881299972534, 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.87999999523162842, 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.869 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d", 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 0, 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0, 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 105, 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 115, 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 127, 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 21, 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 117, 2024-09-14T08:42:07.870 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6800", 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1732765385 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6801", 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1732765385 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:42:07.871 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6802", 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1732765385 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6803", 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1732765385 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6806", 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1732765385 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6807", 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1732765385 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6804", 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1732765385 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6805", 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1732765385 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6801/1732765385", 2024-09-14T08:42:07.874 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6803/1732765385", 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6807/1732765385", 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6805/1732765385", 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "09ba1390-a0d1-48a3-9342-5f5aa64e2217", 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:42:07.875 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 113, 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6808", 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.876 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6809", 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6810", 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6811", 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6814", 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:42:07.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6815", 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6812", 2024-09-14T08:42:07.879 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6813", 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2739597491 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6809/2739597491", 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6811/2739597491", 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6815/2739597491", 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6813/2739597491", 2024-09-14T08:42:07.880 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "a7cd8610-d8e1-44e7-a423-4419cad90d8e", 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:42:07.881 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 98, 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6816", 2024-09-14T08:42:07.882 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817", 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818", 2024-09-14T08:42:07.883 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819", 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6822", 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6823", 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6820", 2024-09-14T08:42:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:42:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6821", 2024-09-14T08:42:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1157205327 2024-09-14T08:42:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.886 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6817/1157205327", 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6819/1157205327", 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6823/1157205327", 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6821/1157205327", 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "1339fb05-5d1c-4c0a-8388-314119543bb6", 2024-09-14T08:42:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 0, 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0, 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 79, 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.888 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6808", 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6809", 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.889 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6810", 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6811", 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:42:07.890 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6814", 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6815", 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.891 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6812", 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6813", 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1656791341 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6809/1656791341", 2024-09-14T08:42:07.892 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6811/1656791341", 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6815/1656791341", 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6813/1656791341", 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "0cebba54-9019-47bd-870f-306664e390e1", 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:42:07.893 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:42:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 13, 2024-09-14T08:42:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 99, 2024-09-14T08:42:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:42:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:42:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:42:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6816", 2024-09-14T08:42:07.894 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6817", 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6818", 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6819", 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.896 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6822", 2024-09-14T08:42:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:42:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6823", 2024-09-14T08:42:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:42:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6820", 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6821", 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1186206237 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6817/1186206237", 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6819/1186206237", 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6823/1186206237", 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6821/1186206237", 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "e571e73b-0e9d-417d-b01c-59b651016763", 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-09-14T08:42:07.899 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0.2734527587890625, 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 12, 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 120, 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.900 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6800", 2024-09-14T08:42:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:42:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6801", 2024-09-14T08:42:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:42:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-09-14T08:42:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6802", 2024-09-14T08:42:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:42:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6803", 2024-09-14T08:42:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:42:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-09-14T08:42:07.903 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6806", 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6807", 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.904 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6804", 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.112:6805", 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 796623465 2024-09-14T08:42:07.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.112:6801/796623465", 2024-09-14T08:42:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.112:6803/796623465", 2024-09-14T08:42:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.112:6807/796623465", 2024-09-14T08:42:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.112:6805/796623465", 2024-09-14T08:42:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-09-14T08:42:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-09-14T08:42:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-09-14T08:42:07.906 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 65536, 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.174731+0000", 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 117 2024-09-14T08:42:07.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.475467+0000", 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-09-14T08:42:07.908 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.606174+0000", 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:42:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 65536, 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.835957+0000", 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 4, 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.753547+0000", 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:42:07.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 5, 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540719139924082687, 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-09-14T08:38:57.284212+0000", 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [ 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.4", 2024-09-14T08:42:07.911 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: 5, 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: 1 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.a", 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: 2, 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: 5 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.912 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [ 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "pgid": "3.10", 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "mappings": [ 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "from": 5, 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: "to": 2 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:07.914 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:07.915 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:07.917 INFO:tasks.thrashosds.thrasher:j is {'epoch': 133, 'fsid': '57b092b7-5550-41a0-8f78-531de0e7c469', 'created': '2024-09-14T08:38:48.610112+0000', 'modified': '2024-09-14T08:42:06.910851+0000', 'last_up_change': '2024-09-14T08:41:54.399976+0000', 'last_in_change': '2024-09-14T08:41:08.566849+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T08:39:00.306403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8789088129997253, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T08:39:06.370159+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8789088129997253, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T08:39:16.437713+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 32, 'snap_epoch': 133, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 0.8789088129997253, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}], 'osds': [{'osd': 0, 'uuid': '2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 105, 'last_clean_end': 115, 'up_from': 127, 'up_thru': 21, 'down_at': 117, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 1732765385}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 1732765385}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 1732765385}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 1732765385}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 1732765385}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 1732765385}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 1732765385}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 1732765385}]}, 'public_addr': '172.21.15.89:6801/1732765385', 'cluster_addr': '172.21.15.89:6803/1732765385', 'heartbeat_back_addr': '172.21.15.89:6807/1732765385', 'heartbeat_front_addr': '172.21.15.89:6805/1732765385', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '09ba1390-a0d1-48a3-9342-5f5aa64e2217', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6808', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6809', 'nonce': 2739597491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6810', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6811', 'nonce': 2739597491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6814', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6815', 'nonce': 2739597491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6812', 'nonce': 2739597491}, {'type': 'v1', 'addr': '172.21.15.89:6813', 'nonce': 2739597491}]}, 'public_addr': '172.21.15.89:6809/2739597491', 'cluster_addr': '172.21.15.89:6811/2739597491', 'heartbeat_back_addr': '172.21.15.89:6815/2739597491', 'heartbeat_front_addr': '172.21.15.89:6813/2739597491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a7cd8610-d8e1-44e7-a423-4419cad90d8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 98, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6816', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6817', 'nonce': 1157205327}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6818', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 1157205327}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6822', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6823', 'nonce': 1157205327}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6820', 'nonce': 1157205327}, {'type': 'v1', 'addr': '172.21.15.89:6821', 'nonce': 1157205327}]}, 'public_addr': '172.21.15.89:6817/1157205327', 'cluster_addr': '172.21.15.89:6819/1157205327', 'heartbeat_back_addr': '172.21.15.89:6823/1157205327', 'heartbeat_front_addr': '172.21.15.89:6821/1157205327', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1339fb05-5d1c-4c0a-8388-314119543bb6', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 79, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6808', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6809', 'nonce': 1656791341}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6810', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6811', 'nonce': 1656791341}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6814', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6815', 'nonce': 1656791341}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6812', 'nonce': 1656791341}, {'type': 'v1', 'addr': '172.21.15.112:6813', 'nonce': 1656791341}]}, 'public_addr': '172.21.15.112:6809/1656791341', 'cluster_addr': '172.21.15.112:6811/1656791341', 'heartbeat_back_addr': '172.21.15.112:6815/1656791341', 'heartbeat_front_addr': '172.21.15.112:6813/1656791341', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0cebba54-9019-47bd-870f-306664e390e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 99, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6816', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6817', 'nonce': 1186206237}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6818', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6819', 'nonce': 1186206237}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6822', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6823', 'nonce': 1186206237}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6820', 'nonce': 1186206237}, {'type': 'v1', 'addr': '172.21.15.112:6821', 'nonce': 1186206237}]}, 'public_addr': '172.21.15.112:6817/1186206237', 'cluster_addr': '172.21.15.112:6819/1186206237', 'heartbeat_back_addr': '172.21.15.112:6823/1186206237', 'heartbeat_front_addr': '172.21.15.112:6821/1186206237', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e571e73b-0e9d-417d-b01c-59b651016763', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2734527587890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 120, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 796623465}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 796623465}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 796623465}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 796623465}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 796623465}]}, 'public_addr': '172.21.15.112:6801/796623465', 'cluster_addr': '172.21.15.112:6803/796623465', 'heartbeat_back_addr': '172.21.15.112:6807/796623465', 'heartbeat_front_addr': '172.21.15.112:6805/796623465', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.174731+0000', 'dead_epoch': 117}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.475467+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.606174+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.835957+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.753547+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T08:38:57.284212+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.4', 'osds': [5, 1]}, {'pgid': '3.a', 'osds': [2, 5]}], 'pg_upmap_items': [{'pgid': '3.10', 'mappings': [{'from': 5, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T08:42:07.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:42:07.919 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:07.919 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:07.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:07.960 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:07.959+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:07.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:42:08.036 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:08.033+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:08.087 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:08.087 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:08.104 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:08.121 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-14T08:42:08.137 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:08.133+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:08.225 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:08.225 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:08.238 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:08.237+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:08.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:08.248 INFO:teuthology.orchestra.run.smithi188.stdout:4277 write 0xd69f800 thru 0xd6ad96e (0xe16f bytes) 2024-09-14T08:42:08.249 INFO:teuthology.orchestra.run.smithi188.stdout:4279 write 0x6bf2400 thru 0x6c0172a (0xf32b bytes) 2024-09-14T08:42:08.250 INFO:teuthology.orchestra.run.smithi188.stdout:4281 write 0x7f1c800 thru 0x7f22e98 (0x6699 bytes) 2024-09-14T08:42:08.250 INFO:teuthology.orchestra.run.smithi188.stdout:4282 read 0x2b37e00 thru 0x2b47a67 (0xfc68 bytes) 2024-09-14T08:42:08.250 INFO:teuthology.orchestra.run.smithi188.stdout:4283 write 0x791f000 thru 0x792cfb8 (0xdfb9 bytes) 2024-09-14T08:42:08.250 INFO:teuthology.orchestra.run.smithi188.stdout:4288 read 0xbf7800 thru 0xc007f9 (0x8ffa bytes) 2024-09-14T08:42:08.293 INFO:teuthology.orchestra.run.smithi188.stdout:4289 write 0xe526400 thru 0xe52a282 (0x3e83 bytes) 2024-09-14T08:42:08.297 INFO:teuthology.orchestra.run.smithi188.stdout:4290 read 0x2bf3e00 thru 0x2bf66ae (0x28af bytes) 2024-09-14T08:42:08.297 INFO:teuthology.orchestra.run.smithi188.stdout:4291 write 0x9b2da00 thru 0x9b34da0 (0x73a1 bytes) 2024-09-14T08:42:08.309 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:42:08.310 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:42:08.328 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-09-14T08:42:06.919347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1009763891,"num_objects":1702,"num_object_clones":385,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":743,"num_read":540728,"num_read_kb":1111224,"num_write":19778,"num_write_kb":248735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1365,"num_bytes_recovered":37125988,"num_keys_recovered":231,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17159,"ondisk_log_size":17159,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":415680,"kb_used_data":188216,"kb_used_omap":6,"kb_used_meta":227385,"kb_avail":377071680,"statfs":{"total":386547056640,"available":386121400320,"internally_reserved":0,"allocated":192733184,"data_stored":230994008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6380,"internal_metadata":232843028},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12263526,"num_objects":42,"num_object_clones":23,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":20,"num_read":23112,"num_read_kb":80835,"num_write":1082,"num_write_kb":11471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.041966"},"pg_stats":[{"pgid":"3.1f","version":"131'252","reported_seq":3391,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.963174+0000","last_change":"2024-09-14T08:41:12.613999+0000","last_active":"2024-09-14T08:42:05.963174+0000","last_peered":"2024-09-14T08:42:05.963174+0000","last_clean":"2024-09-14T08:42:05.963174+0000","last_became_active":"2024-09-14T08:41:12.610989+0000","last_became_peered":"2024-09-14T08:41:12.610989+0000","last_unstale":"2024-09-14T08:42:05.963174+0000","last_undegraded":"2024-09-14T08:42:05.963174+0000","last_fullsized":"2024-09-14T08:42:05.963174+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:56.858464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001451897,"stat_sum":{"num_bytes":12166746,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":26,"num_read":2983,"num_read_kb":14038,"num_write":240,"num_write_kb":3725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":1404084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"130'286","reported_seq":29076,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.963006+0000","last_change":"2024-09-14T08:40:40.488885+0000","last_active":"2024-09-14T08:42:05.963006+0000","last_peered":"2024-09-14T08:42:05.963006+0000","last_clean":"2024-09-14T08:42:05.963006+0000","last_became_active":"2024-09-14T08:40:40.416949+0000","last_became_peered":"2024-09-14T08:40:40.416949+0000","last_unstale":"2024-09-14T08:42:05.963006+0000","last_undegraded":"2024-09-14T08:42:05.963006+0000","last_fullsized":"2024-09-14T08:42:05.963006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:48.041047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013459450000000001,"stat_sum":{"num_bytes":25247264,"num_objects":49,"num_object_clones":11,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":24,"num_read":28541,"num_read_kb":33602,"num_write":269,"num_write_kb":2626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"132'473","reported_seq":6423,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:06.324979+0000","last_change":"2024-09-14T08:40:16.727831+0000","last_active":"2024-09-14T08:42:06.324979+0000","last_peered":"2024-09-14T08:42:06.324979+0000","last_clean":"2024-09-14T08:42:06.324979+0000","last_became_active":"2024-09-14T08:40:16.726695+0000","last_became_peered":"2024-09-14T08:40:16.726695+0000","last_unstale":"2024-09-14T08:42:06.324979+0000","last_undegraded":"2024-09-14T08:42:06.324979+0000","last_fullsized":"2024-09-14T08:42:06.324979+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:52.984106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003027493,"stat_sum":{"num_bytes":18723870,"num_objects":57,"num_object_clones":12,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":26,"num_read":7651,"num_read_kb":35725,"num_write":406,"num_write_kb":4143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"132'564","reported_seq":7602,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:06.346190+0000","last_change":"2024-09-14T08:40:16.728168+0000","last_active":"2024-09-14T08:42:06.346190+0000","last_peered":"2024-09-14T08:42:06.346190+0000","last_clean":"2024-09-14T08:42:06.346190+0000","last_became_active":"2024-09-14T08:40:16.726971+0000","last_became_peered":"2024-09-14T08:40:16.726971+0000","last_unstale":"2024-09-14T08:42:06.346190+0000","last_undegraded":"2024-09-14T08:42:06.346190+0000","last_fullsized":"2024-09-14T08:42:06.346190+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:03.523571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001345691,"stat_sum":{"num_bytes":30873134,"num_objects":54,"num_object_clones":11,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":23,"num_read":7725,"num_read_kb":50083,"num_write":651,"num_write_kb":8209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"131'733","reported_seq":8959,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.925875+0000","last_change":"2024-09-14T08:41:13.630764+0000","last_active":"2024-09-14T08:42:05.925875+0000","last_peered":"2024-09-14T08:42:05.925875+0000","last_clean":"2024-09-14T08:42:05.925875+0000","last_became_active":"2024-09-14T08:41:13.628717+0000","last_became_peered":"2024-09-14T08:41:13.628717+0000","last_unstale":"2024-09-14T08:42:05.925875+0000","last_undegraded":"2024-09-14T08:42:05.925875+0000","last_fullsized":"2024-09-14T08:42:05.925875+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:37.697345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910279999999999,"stat_sum":{"num_bytes":16496803,"num_objects":39,"num_object_clones":6,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":14,"num_read":9819,"num_read_kb":38755,"num_write":800,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":1165399,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"131'344","reported_seq":9191,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:06.312848+0000","last_change":"2024-09-14T08:39:20.388365+0000","last_active":"2024-09-14T08:42:06.312848+0000","last_peered":"2024-09-14T08:42:06.312848+0000","last_clean":"2024-09-14T08:42:06.312848+0000","last_became_active":"2024-09-14T08:39:18.383879+0000","last_became_peered":"2024-09-14T08:39:18.383879+0000","last_unstale":"2024-09-14T08:42:06.312848+0000","last_undegraded":"2024-09-14T08:42:06.312848+0000","last_fullsized":"2024-09-14T08:42:06.312848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:32.937627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211712,"stat_sum":{"num_bytes":49169990,"num_objects":59,"num_object_clones":18,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":24,"num_read":9025,"num_read_kb":28637,"num_write":378,"num_write_kb":4726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"132'495","reported_seq":4689,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:06.378902+0000","last_change":"2024-09-14T08:39:20.386019+0000","last_active":"2024-09-14T08:42:06.378902+0000","last_peered":"2024-09-14T08:42:06.378902+0000","last_clean":"2024-09-14T08:42:06.378902+0000","last_became_active":"2024-09-14T08:39:18.384097+0000","last_became_peered":"2024-09-14T08:39:18.384097+0000","last_unstale":"2024-09-14T08:42:06.378902+0000","last_undegraded":"2024-09-14T08:42:06.378902+0000","last_fullsized":"2024-09-14T08:42:06.378902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:11.085606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014331750000000001,"stat_sum":{"num_bytes":13217543,"num_objects":54,"num_object_clones":8,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":22,"num_read":5273,"num_read_kb":18647,"num_write":538,"num_write_kb":6260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"132'492","reported_seq":6721,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:06.137246+0000","last_change":"2024-09-14T08:41:12.610519+0000","last_active":"2024-09-14T08:42:06.137246+0000","last_peered":"2024-09-14T08:42:06.137246+0000","last_clean":"2024-09-14T08:42:06.137246+0000","last_became_active":"2024-09-14T08:41:12.608616+0000","last_became_peered":"2024-09-14T08:41:12.608616+0000","last_unstale":"2024-09-14T08:42:06.137246+0000","last_undegraded":"2024-09-14T08:42:06.137246+0000","last_fullsized":"2024-09-14T08:42:06.137246+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:50.206930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922599999999997,"stat_sum":{"num_bytes":31690530,"num_objects":59,"num_object_clones":12,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":31,"num_read":7118,"num_read_kb":27379,"num_write":379,"num_write_kb":2666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":68,"num_bytes_recovered":110244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"129'662","reported_seq":6007,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-14T08:42:04.625771+0000","last_change":"2024-09-14T08:41:12.609333+0000","last_active":"2024-09-14T08:42:04.625771+0000","last_peered":"2024-09-14T08:42:04.625771+0000","last_clean":"2024-09-14T08:42:04.625771+0000","last_became_active":"2024-09-14T08:41:12.608651+0000","last_became_peered":"2024-09-14T08:41:12.608651+0000","last_unstale":"2024-09-14T08:42:04.625771+0000","last_undegraded":"2024-09-14T08:42:04.625771+0000","last_fullsized":"2024-09-14T08:42:04.625771+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:11.465927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862059999999999,"stat_sum":{"num_bytes":26594702,"num_objects":49,"num_object_clones":10,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":21,"num_read":7421,"num_read_kb":36243,"num_write":968,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":1537296,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"131'370","reported_seq":3467,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.346752+0000","last_change":"2024-09-14T08:41:42.852077+0000","last_active":"2024-09-14T08:42:05.346752+0000","last_peered":"2024-09-14T08:42:05.346752+0000","last_clean":"2024-09-14T08:42:05.346752+0000","last_became_active":"2024-09-14T08:41:42.850590+0000","last_became_peered":"2024-09-14T08:41:42.850590+0000","last_unstale":"2024-09-14T08:42:05.346752+0000","last_undegraded":"2024-09-14T08:42:05.346752+0000","last_fullsized":"2024-09-14T08:42:05.346752+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:07.549691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029337040000000001,"stat_sum":{"num_bytes":19162923,"num_objects":57,"num_object_clones":15,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":27,"num_read":27570,"num_read_kb":32376,"num_write":386,"num_write_kb":5738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"132'718","reported_seq":3437,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:06.283577+0000","last_change":"2024-09-14T08:41:12.611692+0000","last_active":"2024-09-14T08:42:06.283577+0000","last_peered":"2024-09-14T08:42:06.283577+0000","last_clean":"2024-09-14T08:42:06.283577+0000","last_became_active":"2024-09-14T08:41:12.610726+0000","last_became_peered":"2024-09-14T08:41:12.610726+0000","last_unstale":"2024-09-14T08:42:06.283577+0000","last_undegraded":"2024-09-14T08:42:06.283577+0000","last_fullsized":"2024-09-14T08:42:06.283577+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:04.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018449409999999999,"stat_sum":{"num_bytes":48366212,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":22,"num_read":5568,"num_read_kb":19672,"num_write":1028,"num_write_kb":6760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":4475074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"131'308","reported_seq":31805,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.926357+0000","last_change":"2024-09-14T08:40:40.495288+0000","last_active":"2024-09-14T08:42:05.926357+0000","last_peered":"2024-09-14T08:42:05.926357+0000","last_clean":"2024-09-14T08:42:05.926357+0000","last_became_active":"2024-09-14T08:40:40.411694+0000","last_became_peered":"2024-09-14T08:40:40.411694+0000","last_unstale":"2024-09-14T08:42:05.926357+0000","last_undegraded":"2024-09-14T08:42:05.926357+0000","last_fullsized":"2024-09-14T08:42:05.926357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:38.393221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014343330000000001,"stat_sum":{"num_bytes":40157940,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":19,"num_read":31411,"num_read_kb":36838,"num_write":317,"num_write_kb":2381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":222964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.926207+0000","last_change":"2024-09-14T08:40:40.408528+0000","last_active":"2024-09-14T08:42:05.926207+0000","last_peered":"2024-09-14T08:42:05.926207+0000","last_clean":"2024-09-14T08:42:05.926207+0000","last_became_active":"2024-09-14T08:40:40.408122+0000","last_became_peered":"2024-09-14T08:40:40.408122+0000","last_unstale":"2024-09-14T08:42:05.926207+0000","last_undegraded":"2024-09-14T08:42:05.926207+0000","last_fullsized":"2024-09-14T08:42:05.926207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:43.290991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"132'1813","reported_seq":53075,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:06.360231+0000","last_change":"2024-09-14T08:41:13.633860+0000","last_active":"2024-09-14T08:42:06.360231+0000","last_peered":"2024-09-14T08:42:06.360231+0000","last_clean":"2024-09-14T08:42:06.360231+0000","last_became_active":"2024-09-14T08:41:13.630960+0000","last_became_peered":"2024-09-14T08:41:13.630960+0000","last_unstale":"2024-09-14T08:42:06.360231+0000","last_undegraded":"2024-09-14T08:42:06.360231+0000","last_fullsized":"2024-09-14T08:42:06.360231+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:19.252380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484614,"stat_sum":{"num_bytes":42458297,"num_objects":54,"num_object_clones":13,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":24,"num_read":60167,"num_read_kb":57579,"num_write":3135,"num_write_kb":7345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":796857,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":253,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.921132+0000","last_change":"2024-09-14T08:40:40.418897+0000","last_active":"2024-09-14T08:42:05.921132+0000","last_peered":"2024-09-14T08:42:05.921132+0000","last_clean":"2024-09-14T08:42:05.921132+0000","last_became_active":"2024-09-14T08:40:40.418160+0000","last_became_peered":"2024-09-14T08:40:40.418160+0000","last_unstale":"2024-09-14T08:42:05.921132+0000","last_undegraded":"2024-09-14T08:42:05.921132+0000","last_fullsized":"2024-09-14T08:42:05.921132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:39.281258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"128'491","reported_seq":54897,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.963188+0000","last_change":"2024-09-14T08:39:20.419181+0000","last_active":"2024-09-14T08:42:05.963188+0000","last_peered":"2024-09-14T08:42:05.963188+0000","last_clean":"2024-09-14T08:42:05.963188+0000","last_became_active":"2024-09-14T08:39:18.382867+0000","last_became_peered":"2024-09-14T08:39:18.382867+0000","last_unstale":"2024-09-14T08:42:05.963188+0000","last_undegraded":"2024-09-14T08:42:05.963188+0000","last_fullsized":"2024-09-14T08:42:05.963188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:10.010641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015322599999999999,"stat_sum":{"num_bytes":27924549,"num_objects":53,"num_object_clones":12,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":23,"num_read":46704,"num_read_kb":44766,"num_write":415,"num_write_kb":32185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.926209+0000","last_change":"2024-09-14T08:41:10.634099+0000","last_active":"2024-09-14T08:42:05.926209+0000","last_peered":"2024-09-14T08:42:05.926209+0000","last_clean":"2024-09-14T08:42:05.926209+0000","last_became_active":"2024-09-14T08:41:10.633569+0000","last_became_peered":"2024-09-14T08:41:10.633569+0000","last_unstale":"2024-09-14T08:42:05.926209+0000","last_undegraded":"2024-09-14T08:42:05.926209+0000","last_fullsized":"2024-09-14T08:42:05.926209+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:19.076436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"130'498","reported_seq":4641,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.325185+0000","last_change":"2024-09-14T08:41:33.801801+0000","last_active":"2024-09-14T08:42:05.325185+0000","last_peered":"2024-09-14T08:42:05.325185+0000","last_clean":"2024-09-14T08:42:05.325185+0000","last_became_active":"2024-09-14T08:41:33.799774+0000","last_became_peered":"2024-09-14T08:41:33.799774+0000","last_unstale":"2024-09-14T08:42:05.325185+0000","last_undegraded":"2024-09-14T08:42:05.325185+0000","last_fullsized":"2024-09-14T08:42:05.325185+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:59.099132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010096059999999999,"stat_sum":{"num_bytes":41136271,"num_objects":58,"num_object_clones":15,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":31,"num_read":4853,"num_read_kb":16110,"num_write":528,"num_write_kb":19780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1981071,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":256,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.921140+0000","last_change":"2024-09-14T08:41:09.599832+0000","last_active":"2024-09-14T08:42:05.921140+0000","last_peered":"2024-09-14T08:42:05.921140+0000","last_clean":"2024-09-14T08:42:05.921140+0000","last_became_active":"2024-09-14T08:41:09.599051+0000","last_became_peered":"2024-09-14T08:41:09.599051+0000","last_unstale":"2024-09-14T08:42:05.921140+0000","last_undegraded":"2024-09-14T08:42:05.921140+0000","last_fullsized":"2024-09-14T08:42:05.921140+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:04.825931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"131'650","reported_seq":7643,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.962939+0000","last_change":"2024-09-14T08:40:16.717901+0000","last_active":"2024-09-14T08:42:05.962939+0000","last_peered":"2024-09-14T08:42:05.962939+0000","last_clean":"2024-09-14T08:42:05.962939+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:42:05.962939+0000","last_undegraded":"2024-09-14T08:42:05.962939+0000","last_fullsized":"2024-09-14T08:42:05.962939+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:25.795545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032365710000000002,"stat_sum":{"num_bytes":22563064,"num_objects":60,"num_object_clones":12,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":28,"num_read":8893,"num_read_kb":25930,"num_write":860,"num_write_kb":5297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"131'926","reported_seq":19236,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.926078+0000","last_change":"2024-09-14T08:41:12.620093+0000","last_active":"2024-09-14T08:42:05.926078+0000","last_peered":"2024-09-14T08:42:05.926078+0000","last_clean":"2024-09-14T08:42:05.926078+0000","last_became_active":"2024-09-14T08:41:12.618099+0000","last_became_peered":"2024-09-14T08:41:12.618099+0000","last_unstale":"2024-09-14T08:42:05.926078+0000","last_undegraded":"2024-09-14T08:42:05.926078+0000","last_fullsized":"2024-09-14T08:42:05.926078+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:24.609317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599846,"stat_sum":{"num_bytes":12694639,"num_objects":51,"num_object_clones":11,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":27,"num_read":21766,"num_read_kb":22429,"num_write":1506,"num_write_kb":3245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":129536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":179,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.920825+0000","last_change":"2024-09-14T08:40:16.717703+0000","last_active":"2024-09-14T08:42:05.920825+0000","last_peered":"2024-09-14T08:42:05.920825+0000","last_clean":"2024-09-14T08:42:05.920825+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:42:05.920825+0000","last_undegraded":"2024-09-14T08:42:05.920825+0000","last_fullsized":"2024-09-14T08:42:05.920825+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:18.988966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"128'339","reported_seq":27090,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.920523+0000","last_change":"2024-09-14T08:39:20.385113+0000","last_active":"2024-09-14T08:42:05.920523+0000","last_peered":"2024-09-14T08:42:05.920523+0000","last_clean":"2024-09-14T08:42:05.920523+0000","last_became_active":"2024-09-14T08:39:18.387585+0000","last_became_peered":"2024-09-14T08:39:18.387585+0000","last_unstale":"2024-09-14T08:42:05.920523+0000","last_undegraded":"2024-09-14T08:42:05.920523+0000","last_fullsized":"2024-09-14T08:42:05.920523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:40:27.209444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058750299999999996,"stat_sum":{"num_bytes":17184894,"num_objects":49,"num_object_clones":11,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":19,"num_read":26849,"num_read_kb":27293,"num_write":362,"num_write_kb":2874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.962768+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:42:05.962768+0000","last_peered":"2024-09-14T08:42:05.962768+0000","last_clean":"2024-09-14T08:42:05.962768+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:42:05.962768+0000","last_undegraded":"2024-09-14T08:42:05.962768+0000","last_fullsized":"2024-09-14T08:42:05.962768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"129'323","reported_seq":8088,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.925898+0000","last_change":"2024-09-14T08:41:12.608255+0000","last_active":"2024-09-14T08:42:05.925898+0000","last_peered":"2024-09-14T08:42:05.925898+0000","last_clean":"2024-09-14T08:42:05.925898+0000","last_became_active":"2024-09-14T08:41:12.607243+0000","last_became_peered":"2024-09-14T08:41:12.607243+0000","last_unstale":"2024-09-14T08:42:05.925898+0000","last_undegraded":"2024-09-14T08:42:05.925898+0000","last_fullsized":"2024-09-14T08:42:05.925898+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:03:42.629951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047135900000000002,"stat_sum":{"num_bytes":50922533,"num_objects":41,"num_object_clones":13,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":20,"num_read":7475,"num_read_kb":15563,"num_write":306,"num_write_kb":3655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":264741,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.920591+0000","last_change":"2024-09-14T08:41:10.604621+0000","last_active":"2024-09-14T08:42:05.920591+0000","last_peered":"2024-09-14T08:42:05.920591+0000","last_clean":"2024-09-14T08:42:05.920591+0000","last_became_active":"2024-09-14T08:41:10.603797+0000","last_became_peered":"2024-09-14T08:41:10.603797+0000","last_unstale":"2024-09-14T08:42:05.920591+0000","last_undegraded":"2024-09-14T08:42:05.920591+0000","last_fullsized":"2024-09-14T08:42:05.920591+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:14.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"129'399","reported_seq":16812,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.920766+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:42:05.920766+0000","last_peered":"2024-09-14T08:42:05.920766+0000","last_clean":"2024-09-14T08:42:05.920766+0000","last_became_active":"2024-09-14T08:39:18.387242+0000","last_became_peered":"2024-09-14T08:39:18.387242+0000","last_unstale":"2024-09-14T08:42:05.920766+0000","last_undegraded":"2024-09-14T08:42:05.920766+0000","last_fullsized":"2024-09-14T08:42:05.920766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:01.839345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332069,"stat_sum":{"num_bytes":33712466,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":16,"num_read":16950,"num_read_kb":55400,"num_write":499,"num_write_kb":5692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":164,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.962903+0000","last_change":"2024-09-14T08:40:16.718478+0000","last_active":"2024-09-14T08:42:05.962903+0000","last_peered":"2024-09-14T08:42:05.962903+0000","last_clean":"2024-09-14T08:42:05.962903+0000","last_became_active":"2024-09-14T08:40:16.717575+0000","last_became_peered":"2024-09-14T08:40:16.717575+0000","last_unstale":"2024-09-14T08:42:05.962903+0000","last_undegraded":"2024-09-14T08:42:05.962903+0000","last_fullsized":"2024-09-14T08:42:05.962903+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:50.808473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.920481+0000","last_change":"2024-09-14T08:41:11.435115+0000","last_active":"2024-09-14T08:42:05.920481+0000","last_peered":"2024-09-14T08:42:05.920481+0000","last_clean":"2024-09-14T08:42:05.920481+0000","last_became_active":"2024-09-14T08:41:10.643080+0000","last_became_peered":"2024-09-14T08:41:10.643080+0000","last_unstale":"2024-09-14T08:42:05.920481+0000","last_undegraded":"2024-09-14T08:42:05.920481+0000","last_fullsized":"2024-09-14T08:42:05.920481+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:40:48.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"132'451","reported_seq":33797,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:06.105363+0000","last_change":"2024-09-14T08:39:20.418935+0000","last_active":"2024-09-14T08:42:06.105363+0000","last_peered":"2024-09-14T08:42:06.105363+0000","last_clean":"2024-09-14T08:42:06.105363+0000","last_became_active":"2024-09-14T08:39:18.382844+0000","last_became_peered":"2024-09-14T08:39:18.382844+0000","last_unstale":"2024-09-14T08:42:06.105363+0000","last_undegraded":"2024-09-14T08:42:06.105363+0000","last_fullsized":"2024-09-14T08:42:06.105363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:58.049370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013334390000000001,"stat_sum":{"num_bytes":24150147,"num_objects":52,"num_object_clones":8,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":21,"num_read":32371,"num_read_kb":34389,"num_write":371,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"132'846","reported_seq":14199,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:06.152107+0000","last_change":"2024-09-14T08:41:11.611116+0000","last_active":"2024-09-14T08:42:06.152107+0000","last_peered":"2024-09-14T08:42:06.152107+0000","last_clean":"2024-09-14T08:42:06.152107+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:42:06.152107+0000","last_undegraded":"2024-09-14T08:42:06.152107+0000","last_fullsized":"2024-09-14T08:42:06.152107+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:46.511603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011980249999999999,"stat_sum":{"num_bytes":24044469,"num_objects":66,"num_object_clones":13,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":26,"num_read":13699,"num_read_kb":29363,"num_write":672,"num_write_kb":8017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"132'491","reported_seq":12946,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.965189+0000","last_change":"2024-09-14T08:40:36.360897+0000","last_active":"2024-09-14T08:42:05.965189+0000","last_peered":"2024-09-14T08:42:05.965189+0000","last_clean":"2024-09-14T08:42:05.965189+0000","last_became_active":"2024-09-14T08:40:36.358876+0000","last_became_peered":"2024-09-14T08:40:36.358876+0000","last_unstale":"2024-09-14T08:42:05.965189+0000","last_undegraded":"2024-09-14T08:42:05.965189+0000","last_fullsized":"2024-09-14T08:42:05.965189+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:23.607465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002911753,"stat_sum":{"num_bytes":64513601,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":17,"num_read":13876,"num_read_kb":82232,"num_write":511,"num_write_kb":40982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":5746688,"num_keys_recovered":33,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"131'301","reported_seq":4341,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.920878+0000","last_change":"2024-09-14T08:41:12.615018+0000","last_active":"2024-09-14T08:42:05.920878+0000","last_peered":"2024-09-14T08:42:05.920878+0000","last_clean":"2024-09-14T08:42:05.920878+0000","last_became_active":"2024-09-14T08:41:12.612738+0000","last_became_peered":"2024-09-14T08:41:12.612738+0000","last_unstale":"2024-09-14T08:42:05.920878+0000","last_undegraded":"2024-09-14T08:42:05.920878+0000","last_fullsized":"2024-09-14T08:42:05.920878+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:20.883420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013500459999999999,"stat_sum":{"num_bytes":18505796,"num_objects":49,"num_object_clones":11,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":19,"num_read":3750,"num_read_kb":19753,"num_write":287,"num_write_kb":3758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1187360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"131'786","reported_seq":36732,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.920936+0000","last_change":"2024-09-14T08:41:13.635192+0000","last_active":"2024-09-14T08:42:05.920936+0000","last_peered":"2024-09-14T08:42:05.920936+0000","last_clean":"2024-09-14T08:42:05.920936+0000","last_became_active":"2024-09-14T08:41:13.633802+0000","last_became_peered":"2024-09-14T08:41:13.633802+0000","last_unstale":"2024-09-14T08:42:05.920936+0000","last_undegraded":"2024-09-14T08:42:05.920936+0000","last_fullsized":"2024-09-14T08:42:05.920936+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:37.924659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652499,"stat_sum":{"num_bytes":31991847,"num_objects":61,"num_object_clones":14,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":28,"num_read":41526,"num_read_kb":51042,"num_write":592,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":2725415,"num_keys_recovered":34,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"131'538","reported_seq":6618,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.963069+0000","last_change":"2024-09-14T08:40:43.437156+0000","last_active":"2024-09-14T08:42:05.963069+0000","last_peered":"2024-09-14T08:42:05.963069+0000","last_clean":"2024-09-14T08:42:05.963069+0000","last_became_active":"2024-09-14T08:40:43.436214+0000","last_became_peered":"2024-09-14T08:40:43.436214+0000","last_unstale":"2024-09-14T08:42:05.963069+0000","last_undegraded":"2024-09-14T08:42:05.963069+0000","last_fullsized":"2024-09-14T08:42:05.963069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:57.902548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024901429999999998,"stat_sum":{"num_bytes":21204992,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":18,"num_read":8167,"num_read_kb":20741,"num_write":418,"num_write_kb":5815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":1135104,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"130'243","reported_seq":6875,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.926377+0000","last_change":"2024-09-14T08:40:16.728183+0000","last_active":"2024-09-14T08:42:05.926377+0000","last_peered":"2024-09-14T08:42:05.926377+0000","last_clean":"2024-09-14T08:42:05.926377+0000","last_became_active":"2024-09-14T08:40:16.727022+0000","last_became_peered":"2024-09-14T08:40:16.727022+0000","last_unstale":"2024-09-14T08:42:05.926377+0000","last_undegraded":"2024-09-14T08:42:05.926377+0000","last_fullsized":"2024-09-14T08:42:05.926377+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:46:54.966271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002389113,"stat_sum":{"num_bytes":24537616,"num_objects":52,"num_object_clones":12,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":25,"num_read":6467,"num_read_kb":21152,"num_write":225,"num_write_kb":2653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"130'415","reported_seq":7181,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.361237+0000","last_change":"2024-09-14T08:41:42.851323+0000","last_active":"2024-09-14T08:42:05.361237+0000","last_peered":"2024-09-14T08:42:05.361237+0000","last_clean":"2024-09-14T08:42:05.361237+0000","last_became_active":"2024-09-14T08:41:42.849924+0000","last_became_peered":"2024-09-14T08:41:42.849924+0000","last_unstale":"2024-09-14T08:42:05.361237+0000","last_undegraded":"2024-09-14T08:42:05.361237+0000","last_fullsized":"2024-09-14T08:42:05.361237+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:46:55.868733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023917970000000002,"stat_sum":{"num_bytes":52859424,"num_objects":70,"num_object_clones":18,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":30,"num_read":6652,"num_read_kb":32915,"num_write":410,"num_write_kb":7991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4367376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"129'335","reported_seq":17885,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.962472+0000","last_change":"2024-09-14T08:41:12.610800+0000","last_active":"2024-09-14T08:42:05.962472+0000","last_peered":"2024-09-14T08:42:05.962472+0000","last_clean":"2024-09-14T08:42:05.962472+0000","last_became_active":"2024-09-14T08:41:12.608500+0000","last_became_peered":"2024-09-14T08:41:12.608500+0000","last_unstale":"2024-09-14T08:42:05.962472+0000","last_undegraded":"2024-09-14T08:42:05.962472+0000","last_fullsized":"2024-09-14T08:42:05.962472+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:33:59.191440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024547029999999999,"stat_sum":{"num_bytes":71857294,"num_objects":60,"num_object_clones":15,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":21,"num_read":18930,"num_read_kb":53318,"num_write":321,"num_write_kb":2415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":461564,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"132'377","reported_seq":42291,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.926107+0000","last_change":"2024-09-14T08:41:13.629949+0000","last_active":"2024-09-14T08:42:05.926107+0000","last_peered":"2024-09-14T08:42:05.926107+0000","last_clean":"2024-09-14T08:42:05.926107+0000","last_became_active":"2024-09-14T08:41:13.628700+0000","last_became_peered":"2024-09-14T08:41:13.628700+0000","last_unstale":"2024-09-14T08:42:05.926107+0000","last_undegraded":"2024-09-14T08:42:05.926107+0000","last_fullsized":"2024-09-14T08:42:05.926107+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:45.969149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001362044,"stat_sum":{"num_bytes":63534671,"num_objects":58,"num_object_clones":17,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":28,"num_read":42330,"num_read_kb":99819,"num_write":334,"num_write_kb":13974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":841295,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"131'430","reported_seq":4348,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.920500+0000","last_change":"2024-09-14T08:41:12.619512+0000","last_active":"2024-09-14T08:42:05.920500+0000","last_peered":"2024-09-14T08:42:05.920500+0000","last_clean":"2024-09-14T08:42:05.920500+0000","last_became_active":"2024-09-14T08:41:12.616601+0000","last_became_peered":"2024-09-14T08:41:12.616601+0000","last_unstale":"2024-09-14T08:42:05.920500+0000","last_undegraded":"2024-09-14T08:42:05.920500+0000","last_fullsized":"2024-09-14T08:42:05.920500+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:47.381086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013117140000000001,"stat_sum":{"num_bytes":14789234,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":20,"num_read":4260,"num_read_kb":16203,"num_write":421,"num_write_kb":6297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":5260516,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"130'735","reported_seq":2762,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-14T08:42:05.157838+0000","last_change":"2024-09-14T08:41:42.856882+0000","last_active":"2024-09-14T08:42:05.157838+0000","last_peered":"2024-09-14T08:42:05.157838+0000","last_clean":"2024-09-14T08:42:05.157838+0000","last_became_active":"2024-09-14T08:41:42.852846+0000","last_became_peered":"2024-09-14T08:41:42.852846+0000","last_unstale":"2024-09-14T08:42:05.157838+0000","last_undegraded":"2024-09-14T08:42:05.157838+0000","last_fullsized":"2024-09-14T08:42:05.157838+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:25.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018326740000000001,"stat_sum":{"num_bytes":16720043,"num_objects":51,"num_object_clones":9,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":23,"num_read":4872,"num_read_kb":13177,"num_write":1142,"num_write_kb":8277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":515126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1009173504,"num_objects":1698,"num_object_clones":385,"num_object_copies":3396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1698,"num_whiteouts":743,"num_read":540662,"num_read_kb":1111169,"num_write":19675,"num_write_kb":247105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1359,"num_bytes_recovered":35354884,"num_keys_recovered":231,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":215171072,"data_stored":258479647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8169,"internal_metadata":0},"log_size":17084,"ondisk_log_size":17084,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99840,"kb_used_data":46444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94272000,"statfs":{"total":96636764160,"available":96534528000,"internally_reserved":0,"allocated":47558656,"data_stored":59394701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574889,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93452,"kb_used_data":35900,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94278388,"statfs":{"total":96636764160,"available":96541069312,"internally_reserved":0,"allocated":36761600,"data_stored":39207654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122832,"kb_used_data":59712,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94249008,"statfs":{"total":96636764160,"available":96510984192,"internally_reserved":0,"allocated":61145088,"data_stored":77611596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607593,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99556,"kb_used_data":46160,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94272284,"statfs":{"total":96636764160,"available":96534818816,"internally_reserved":0,"allocated":47267840,"data_stored":54780057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":0,"seq":545460846595,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16867328,"data_stored":16742054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8169,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":59179008,"data_stored":76586099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34390016,"data_stored":37761326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12910592,"data_stored":14407564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45903872,"data_stored":58660697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45920256,"data_stored":54321907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:42:08.331 INFO:tasks.thrashosds.thrasher:Setting 3.16 to [4, 3] 2024-09-14T08:42:08.332 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.16', '4', '3'] 2024-09-14T08:42:08.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.16 4 3 2024-09-14T08:42:08.339 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:08.337+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:08.364 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:08.364 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:08.379 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:08.380 INFO:teuthology.orchestra.run.smithi188.stdout:4292 trunc from 0xe52a400 to 0x1d6a800 2024-09-14T08:42:08.440 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:08.437+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:08.464 INFO:teuthology.orchestra.run.smithi188.stdout:4293 punch from 0xad3200 to 0xae2000, (0xee00 bytes) 2024-09-14T08:42:08.466 INFO:teuthology.orchestra.run.smithi188.stdout:4294 punch from 0x13ca200 to 0x13d6c00, (0xca00 bytes) 2024-09-14T08:42:08.498 INFO:teuthology.orchestra.run.smithi188.stdout:4295 write 0xae67000 thru 0xae6cc7c (0x5c7d bytes) 2024-09-14T08:42:08.500 INFO:teuthology.orchestra.run.smithi188.stdout:4296 write 0xa230800 thru 0xa23aaa9 (0xa2aa bytes) 2024-09-14T08:42:08.501 INFO:teuthology.orchestra.run.smithi188.stdout:4297 read 0x4e32000 thru 0x4e3db43 (0xbb44 bytes) 2024-09-14T08:42:08.502 INFO:teuthology.orchestra.run.smithi188.stdout:4299 write 0x9b61e00 thru 0x9b66d66 (0x4f67 bytes) 2024-09-14T08:42:08.504 INFO:teuthology.orchestra.run.smithi188.stdout:4300 punch from 0x6f8200 to 0x6fec00, (0x6a00 bytes) 2024-09-14T08:42:08.504 INFO:teuthology.orchestra.run.smithi188.stdout:4301 punch from 0x16fe000 to 0x1709600, (0xb600 bytes) 2024-09-14T08:42:08.505 INFO:teuthology.orchestra.run.smithi188.stdout:4302 punch from 0x516c400 to 0x5170000, (0x3c00 bytes) 2024-09-14T08:42:08.505 INFO:teuthology.orchestra.run.smithi188.stdout:4303 read 0xa9c6000 thru 0xa9d598a (0xf98b bytes) 2024-09-14T08:42:08.506 INFO:teuthology.orchestra.run.smithi188.stdout:4304 punch from 0x9b53200 to 0x9b62e00, (0xfc00 bytes) 2024-09-14T08:42:08.527 INFO:teuthology.orchestra.run.smithi188.stdout:4306 write 0xd1abe00 thru 0xd1b0ed0 (0x50d1 bytes) 2024-09-14T08:42:08.529 INFO:teuthology.orchestra.run.smithi188.stdout:4310 read 0x3820c00 thru 0x382bbde (0xafdf bytes) 2024-09-14T08:42:08.530 INFO:teuthology.orchestra.run.smithi188.stdout:4311 read 0x281d600 thru 0x2821748 (0x4149 bytes) 2024-09-14T08:42:08.530 INFO:teuthology.orchestra.run.smithi188.stdout:4312 read 0x2936200 thru 0x2936899 (0x69a bytes) 2024-09-14T08:42:08.542 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:08.541+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:08.546 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:08.546 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:08.549 INFO:teuthology.orchestra.run.smithi188.stdout:4315 trunc from 0xd1b1000 to 0x2126600 2024-09-14T08:42:08.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:08.630 INFO:teuthology.orchestra.run.smithi188.stdout:4316 write 0x78dce00 thru 0x78e2564 (0x5765 bytes) 2024-09-14T08:42:08.634 INFO:teuthology.orchestra.run.smithi188.stdout:4317 read 0x164d000 thru 0x164e4ee (0x14ef bytes) 2024-09-14T08:42:08.643 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:08.641+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:08.660 INFO:teuthology.orchestra.run.smithi188.stdout:4318 write 0x89cae00 thru 0x89cbccd (0xece bytes) 2024-09-14T08:42:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:08.695 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:08.696 INFO:teuthology.orchestra.run.smithi188.stdout:4320 write 0xd298800 thru 0xd2a03de (0x7bdf bytes) 2024-09-14T08:42:08.698 INFO:teuthology.orchestra.run.smithi188.stdout:4321 write 0x79fa600 thru 0x7a0122e (0x6c2f bytes) 2024-09-14T08:42:08.700 INFO:teuthology.orchestra.run.smithi188.stdout:4326 write 0x4bafe00 thru 0x4bbba07 (0xbc08 bytes) 2024-09-14T08:42:08.717 INFO:teuthology.orchestra.run.smithi188.stdout:4329 trunc from 0xd2a0400 to 0x657c400 2024-09-14T08:42:08.744 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:08.741+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout:4330 punch from 0x3933400 to 0x393e600, (0xb200 bytes) 2024-09-14T08:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout:4332 punch from 0x25ca000 to 0x25cda00, (0x3a00 bytes) 2024-09-14T08:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout:4333 punch from 0x3c18a00 to 0x3c1be00, (0x3400 bytes) 2024-09-14T08:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout:4337 write 0x2c75a00 thru 0x2c822aa (0xc8ab bytes) 2024-09-14T08:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout:4338 write 0x1186800 thru 0x118c88c (0x608d bytes) 2024-09-14T08:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout:4342 punch from 0x614800 to 0x61b000, (0x6800 bytes) 2024-09-14T08:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout:4347 read 0x64ee000 thru 0x64f9070 (0xb071 bytes) 2024-09-14T08:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout:4351 write 0x23d7400 thru 0x23e14e2 (0xa0e3 bytes) 2024-09-14T08:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout:4352 read 0x17e1400 thru 0x17eab68 (0x9769 bytes) 2024-09-14T08:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout:4356 punch from 0x4e9c600 to 0x4eaba00, (0xf400 bytes) 2024-09-14T08:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout:4357 write 0xb711000 thru 0xb719f53 (0x8f54 bytes) 2024-09-14T08:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout:4362 write 0xafbd800 thru 0xafbebce (0x13cf bytes) 2024-09-14T08:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout:4363 read 0x1be600 thru 0x1c9ec8 (0xb8c9 bytes) 2024-09-14T08:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout:4366 punch from 0x6333600 to 0x6336800, (0x3200 bytes) 2024-09-14T08:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout:4367 trunc from 0xb71a000 to 0x570cc00 2024-09-14T08:42:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:08.833 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:08.844 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:08.841+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:08.868 INFO:teuthology.orchestra.run.smithi188.stdout:4369 write 0x84eee00 thru 0x84fb930 (0xcb31 bytes) 2024-09-14T08:42:08.871 INFO:teuthology.orchestra.run.smithi188.stdout:4370 write 0x7c09000 thru 0x7c16758 (0xd759 bytes) 2024-09-14T08:42:08.886 INFO:teuthology.orchestra.run.smithi188.stdout:4371 trunc from 0x84fba00 to 0xe12e200 2024-09-14T08:42:08.904 INFO:teuthology.orchestra.run.smithi188.stdout:4373 read 0x1616600 thru 0x1621386 (0xad87 bytes) 2024-09-14T08:42:08.924 INFO:teuthology.orchestra.run.smithi089.stderr:set 3.16 pg_upmap mapping to [4,3] 2024-09-14T08:42:08.925 INFO:teuthology.orchestra.run.smithi188.stdout:4374 trunc from 0xe12e200 to 0x6be8600 2024-09-14T08:42:08.928 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:42:08.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:08.945 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:08.941+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:08.962 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:08.963 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:08.964 INFO:teuthology.orchestra.run.smithi188.stdout:4375 write 0x2d9000 thru 0x2e772d (0xe72e bytes) 2024-09-14T08:42:08.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:08.983 INFO:teuthology.orchestra.run.smithi188.stdout:4376 trunc from 0x6be8600 to 0xdf03c00 2024-09-14T08:42:09.000 INFO:teuthology.orchestra.run.smithi188.stdout:4380 write 0x823b400 thru 0x823ed59 (0x395a bytes) 2024-09-14T08:42:09.003 INFO:teuthology.orchestra.run.smithi188.stdout:4383 write 0xb69200 thru 0xb75f1f (0xcd20 bytes) 2024-09-14T08:42:09.004 INFO:teuthology.orchestra.run.smithi188.stdout:4385 write 0x230b400 thru 0x230dc6a (0x286b bytes) 2024-09-14T08:42:09.006 INFO:teuthology.orchestra.run.smithi188.stdout:4387 punch from 0x97be00 to 0x98b000, (0xf200 bytes) 2024-09-14T08:42:09.007 INFO:teuthology.orchestra.run.smithi188.stdout:4388 write 0x6565000 thru 0x657090f (0xb910 bytes) 2024-09-14T08:42:09.009 INFO:teuthology.orchestra.run.smithi188.stdout:4394 write 0x5184600 thru 0x51930a9 (0xeaaa bytes) 2024-09-14T08:42:09.011 INFO:teuthology.orchestra.run.smithi188.stdout:4395 punch from 0xb7d6e00 to 0xb7e1600, (0xa800 bytes) 2024-09-14T08:42:09.012 INFO:teuthology.orchestra.run.smithi188.stdout:4396 write 0x5093000 thru 0x5099670 (0x6671 bytes) 2024-09-14T08:42:09.023 INFO:teuthology.orchestra.run.smithi188.stdout:4401 trunc from 0xdf03c00 to 0x71ca400 2024-09-14T08:42:09.046 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:09.045+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:09.067 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:09.067 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:09.083 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:09.083 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:09.098 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:09.098 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:09.112 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:09.112 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:09.118 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:09.118 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:09.126 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:09.137 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:09.137 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:09.146 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:09.143+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:09.154 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:09.154 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:09.247 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:09.243+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:09.259 INFO:teuthology.orchestra.run.smithi188.stdout:4403 write 0x116ce00 thru 0x117828c (0xb48d bytes) 2024-09-14T08:42:09.273 INFO:teuthology.orchestra.run.smithi188.stdout:4408 trunc from 0x71ca400 to 0xb0a5400 2024-09-14T08:42:09.295 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:09.295 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:09.295 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:09.295 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:09.295 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:09.301 INFO:teuthology.orchestra.run.smithi188.stdout:4409 punch from 0x54b6800 to 0x54c5200, (0xea00 bytes) 2024-09-14T08:42:09.304 INFO:teuthology.orchestra.run.smithi188.stdout:4411 punch from 0x8dee800 to 0x8dfb000, (0xc800 bytes) 2024-09-14T08:42:09.304 INFO:teuthology.orchestra.run.smithi188.stdout:4412 write 0x9682a00 thru 0x9691e91 (0xf492 bytes) 2024-09-14T08:42:09.310 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:09.345 INFO:teuthology.orchestra.run.smithi188.stdout:4416 write 0xda4de00 thru 0xda525b7 (0x47b8 bytes) 2024-09-14T08:42:09.347 INFO:teuthology.orchestra.run.smithi188.stdout:4418 write 0xa819e00 thru 0xa82389d (0x9a9e bytes) 2024-09-14T08:42:09.348 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:09.347+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:09.349 INFO:teuthology.orchestra.run.smithi188.stdout:4419 read 0x7e66a00 thru 0x7e6ae81 (0x4482 bytes) 2024-09-14T08:42:09.349 INFO:teuthology.orchestra.run.smithi188.stdout:4422 read 0x7d5ec00 thru 0x7d61bd6 (0x2fd7 bytes) 2024-09-14T08:42:09.351 INFO:teuthology.orchestra.run.smithi188.stdout:4423 write 0x7067e00 thru 0x706a931 (0x2b32 bytes) 2024-09-14T08:42:09.352 INFO:teuthology.orchestra.run.smithi188.stdout:4425 read 0x8706200 thru 0x87110be (0xaebf bytes) 2024-09-14T08:42:09.353 INFO:teuthology.orchestra.run.smithi188.stdout:4426 read 0x9c89400 thru 0x9c910e6 (0x7ce7 bytes) 2024-09-14T08:42:09.354 INFO:teuthology.orchestra.run.smithi188.stdout:4427 read 0x7940400 thru 0x794c511 (0xc112 bytes) 2024-09-14T08:42:09.355 INFO:teuthology.orchestra.run.smithi188.stdout:4430 read 0x7cd8800 thru 0x7cd9d8e (0x158f bytes) 2024-09-14T08:42:09.356 INFO:teuthology.orchestra.run.smithi188.stdout:4431 read 0x61c9800 thru 0x61d5fe3 (0xc7e4 bytes) 2024-09-14T08:42:09.373 INFO:teuthology.orchestra.run.smithi188.stdout:4434 trunc from 0xda52600 to 0x79de200 2024-09-14T08:42:09.421 INFO:teuthology.orchestra.run.smithi188.stdout:4435 read 0x4b04200 thru 0x4b10d93 (0xcb94 bytes) 2024-09-14T08:42:09.439 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:09.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.191547071, 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:42:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:42:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:42:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:42:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:42:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:42:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:09.445 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19148505800001, 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:42:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.191418728, 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:42:09.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:42:09.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.191363268, 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:42:09.454 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:42:09.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.191303648, 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.459 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:42:09.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.463 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19122210800001, 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:42:09.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:42:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:42:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:42:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:42:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:42:09.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:42:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:42:09.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:42:09.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:42:09.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.470 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19116578000001, 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:09.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:42:09.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19109428499999, 2024-09-14T08:42:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:09.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:42:09.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:42:09.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:42:09.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:42:09.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:42:09.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:42:09.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:42:09.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19102141400001, 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.482 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.487 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:09.487 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19097920199999, 2024-09-14T08:42:09.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:42:09.487 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.487 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.487 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.487 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.487 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.487 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.487 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:42:09.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.491 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:09.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19094937200001, 2024-09-14T08:42:09.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:42:09.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.492 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.496 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19092107500001, 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:42:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:09.501 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19087998000001, 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:42:09.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:42:09.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19085095, 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:42:09.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19082246599999, 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.190794326, 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.515 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:42:09.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:42:09.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19076562999999, 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:09.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:42:09.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:42:09.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19073687299999, 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:42:09.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:09.528 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19070882599999, 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:42:09.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:42:09.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:42:09.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:42:09.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:42:09.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 131.19067884899999, 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:09.538 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:09.540 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:09.540 INFO:teuthology.orchestra.run.smithi188.stdout:4436 write 0xb180600 thru 0xb1855f8 (0x4ff9 bytes) 2024-09-14T08:42:09.540 INFO:teuthology.orchestra.run.smithi188.stdout:4437 read 0xabcba00 thru 0xabcf706 (0x3d07 bytes) 2024-09-14T08:42:09.540 INFO:teuthology.orchestra.run.smithi188.stdout:4439 write 0xc0e0e00 thru 0xc0e376c (0x296d bytes) 2024-09-14T08:42:09.540 INFO:teuthology.orchestra.run.smithi188.stdout:4441 read 0x1fd6200 thru 0x1fd9733 (0x3534 bytes) 2024-09-14T08:42:09.540 INFO:teuthology.orchestra.run.smithi188.stdout:4442 write 0x7e16800 thru 0x7e24fa9 (0xe7aa bytes) 2024-09-14T08:42:09.540 INFO:teuthology.orchestra.run.smithi188.stdout:4444 read 0x99fc00 thru 0x9aa185 (0xa586 bytes) 2024-09-14T08:42:09.541 INFO:teuthology.orchestra.run.smithi188.stdout:4446 write 0x1ac7600 thru 0x1acbf33 (0x4934 bytes) 2024-09-14T08:42:09.541 INFO:teuthology.orchestra.run.smithi188.stdout:4449 read 0xe8ba00 thru 0xe90989 (0x4f8a bytes) 2024-09-14T08:42:09.541 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:09.539+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:09.549 INFO:teuthology.orchestra.run.smithi188.stdout:4451 write 0xe367800 thru 0xe376082 (0xe883 bytes) 2024-09-14T08:42:09.554 INFO:teuthology.orchestra.run.smithi188.stdout:4454 write 0xbd5e00 thru 0xbd994e (0x3b4f bytes) 2024-09-14T08:42:09.558 INFO:teuthology.orchestra.run.smithi188.stdout:4455 trunc from 0xe376200 to 0xda19000 2024-09-14T08:42:09.598 INFO:teuthology.orchestra.run.smithi188.stdout:4456 write 0xd579200 thru 0xd57d827 (0x4628 bytes) 2024-09-14T08:42:09.601 INFO:teuthology.orchestra.run.smithi188.stdout:4457 write 0x1fc1800 thru 0x1fc2ca4 (0x14a5 bytes) 2024-09-14T08:42:09.603 INFO:teuthology.orchestra.run.smithi188.stdout:4458 read 0x1988000 thru 0x199554a (0xd54b bytes) 2024-09-14T08:42:09.604 INFO:teuthology.orchestra.run.smithi188.stdout:4459 punch from 0x1dfa800 to 0x1dffe00, (0x5600 bytes) 2024-09-14T08:42:09.604 INFO:teuthology.orchestra.run.smithi188.stdout:4460 read 0x3519800 thru 0x3520d93 (0x7594 bytes) 2024-09-14T08:42:09.605 INFO:teuthology.orchestra.run.smithi188.stdout:4461 read 0x8e36c00 thru 0x8e42c3f (0xc040 bytes) 2024-09-14T08:42:09.606 INFO:teuthology.orchestra.run.smithi188.stdout:4463 read 0x5f08400 thru 0x5f14dd5 (0xc9d6 bytes) 2024-09-14T08:42:09.607 INFO:teuthology.orchestra.run.smithi188.stdout:4465 read 0x5dc400 thru 0x5e704f (0xac50 bytes) 2024-09-14T08:42:09.627 INFO:teuthology.orchestra.run.smithi188.stdout:4468 trunc from 0xda19000 to 0x216dc00 2024-09-14T08:42:09.640 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:09.637+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:09.680 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:09.680 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:09.680 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:09.680 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:09.690 INFO:teuthology.orchestra.run.smithi188.stdout:4469 punch from 0x18a000 to 0x191e00, (0x7e00 bytes) 2024-09-14T08:42:09.692 INFO:teuthology.orchestra.run.smithi188.stdout:4472 read 0xea8600 thru 0xeadc34 (0x5635 bytes) 2024-09-14T08:42:09.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:09.718 INFO:teuthology.orchestra.run.smithi188.stdout:4473 trunc from 0x216dc00 to 0x126400 2024-09-14T08:42:09.781 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:09.781+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:09.821 INFO:teuthology.orchestra.run.smithi188.stdout:4474 read 0x101a00 thru 0x10eb0b (0xd10c bytes) 2024-09-14T08:42:09.824 INFO:teuthology.orchestra.run.smithi188.stdout:4476 punch from 0xa2c00 to 0xa6800, (0x3c00 bytes) 2024-09-14T08:42:09.842 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:09.839+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:09.851 INFO:teuthology.orchestra.run.smithi188.stdout:4478 trunc from 0x126400 to 0xa0bca00 2024-09-14T08:42:09.862 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:09.862 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:09.876 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:09.877 INFO:teuthology.orchestra.run.smithi188.stdout:4480 read 0x7205400 thru 0x720d142 (0x7d43 bytes) 2024-09-14T08:42:09.878 INFO:teuthology.orchestra.run.smithi188.stdout:4482 punch from 0x538a000 to 0x538b000, (0x1000 bytes) 2024-09-14T08:42:09.878 INFO:teuthology.orchestra.run.smithi188.stdout:4484 read 0x3b91800 thru 0x3b93b6c (0x236d bytes) 2024-09-14T08:42:09.879 INFO:teuthology.orchestra.run.smithi188.stdout:4490 read 0x75ab200 thru 0x75b851a (0xd31b bytes) 2024-09-14T08:42:09.879 INFO:teuthology.orchestra.run.smithi188.stdout:4492 flatten 2024-09-14T08:42:09.910 INFO:teuthology.orchestra.run.smithi188.stdout:4496 read 0x288b600 thru 0x2895f16 (0xa917 bytes) 2024-09-14T08:42:09.910 INFO:teuthology.orchestra.run.smithi188.stdout:4497 write 0x8da400 thru 0x8e4fae (0xabaf bytes) 2024-09-14T08:42:09.925 INFO:teuthology.orchestra.run.smithi188.stdout:4498 trunc from 0xa0bca00 to 0x3dda200 2024-09-14T08:42:09.969 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:09.969+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:09.983 INFO:teuthology.orchestra.run.smithi188.stdout:4504 trunc from 0x3dda200 to 0xc265e00 2024-09-14T08:42:10.011 INFO:teuthology.orchestra.run.smithi188.stdout:4505 trunc from 0xc265e00 to 0xa747200 2024-09-14T08:42:10.044 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:10.041+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:10.044 INFO:teuthology.orchestra.run.smithi188.stdout:4507 write 0x9d88c00 thru 0x9d9763b (0xea3c bytes) 2024-09-14T08:42:10.045 INFO:teuthology.orchestra.run.smithi188.stdout:4508 write 0x879ba00 thru 0x87a13c6 (0x59c7 bytes) 2024-09-14T08:42:10.053 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:42:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 114.319438843, 2024-09-14T08:42:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:42:10.053 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:42:10.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:42:10.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:10.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.783685018, 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:42:10.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:42:10.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:42:10.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.749020133999998, 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:10.065 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:42:10.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.069 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.748819163, 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:10.070 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:42:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:42:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:42:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:42:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.848143774, 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.075 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:42:10.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.848109559000001, 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:42:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:42:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:42:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:10.084 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.848068069999997, 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:42:10.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:42:10.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.088 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.848009587999996, 2024-09-14T08:42:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:42:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.089 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:42:10.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.847979909000003, 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:10.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:42:10.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.847950699999998, 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.098 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:42:10.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.102 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.840344405000003, 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:42:10.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:42:10.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:42:10.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.840316414999997, 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:42:10.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.111 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.840288082999997, 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.840246323999999, 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:42:10.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:42:10.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.840217445, 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.840183635999999, 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.124 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:10.128 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.840151276999997, 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:10.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.132 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.832023474000003, 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:10.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:42:10.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:42:10.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:42:10.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:42:10.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:42:10.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:42:10.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:42:10.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:42:10.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.831992489000001, 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.138 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:42:10.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.831963582999997, 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.143 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:42:10.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:42:10.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:42:10.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.147 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.147 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.147 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:10.149 INFO:teuthology.orchestra.run.smithi188.stdout:4510 write 0xd70b200 thru 0xd7126f9 (0x74fa bytes) 2024-09-14T08:42:10.149 INFO:teuthology.orchestra.run.smithi188.stdout:4511 trunc from 0xd712800 to 0xadc4c00 2024-09-14T08:42:10.149 INFO:teuthology.orchestra.run.smithi188.stdout:4514 write 0x8477800 thru 0x847e9c3 (0x71c4 bytes) 2024-09-14T08:42:10.149 INFO:teuthology.orchestra.run.smithi188.stdout:4515 punch from 0xa654600 to 0xa659200, (0x4c00 bytes) 2024-09-14T08:42:10.149 INFO:teuthology.orchestra.run.smithi188.stdout:4517 read 0x1b39200 thru 0x1b421e7 (0x8fe8 bytes) 2024-09-14T08:42:10.150 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:10.150 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:10.145+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:10.161 INFO:teuthology.orchestra.run.smithi188.stdout:4518 write 0xd002600 thru 0xd0064d4 (0x3ed5 bytes) 2024-09-14T08:42:10.163 INFO:teuthology.orchestra.run.smithi188.stdout:4519 write 0x82afa00 thru 0x82bf560 (0xfb61 bytes) 2024-09-14T08:42:10.163 INFO:teuthology.orchestra.run.smithi188.stdout:4521 punch from 0x157ec00 to 0x1583800, (0x4c00 bytes) 2024-09-14T08:42:10.184 INFO:teuthology.orchestra.run.smithi188.stdout:4522 trunc from 0xd006600 to 0x18fe000 2024-09-14T08:42:10.236 INFO:teuthology.orchestra.run.smithi188.stdout:4523 write 0x989200 thru 0x98fb64 (0x6965 bytes) 2024-09-14T08:42:10.240 INFO:teuthology.orchestra.run.smithi188.stdout:4524 read 0x1461c00 thru 0x1468f38 (0x7339 bytes) 2024-09-14T08:42:10.241 INFO:teuthology.orchestra.run.smithi188.stdout:4525 punch from 0x3abe00 to 0x3b3e00, (0x8000 bytes) 2024-09-14T08:42:10.242 INFO:teuthology.orchestra.run.smithi188.stdout:4526 read 0x487000 thru 0x488094 (0x1095 bytes) 2024-09-14T08:42:10.243 INFO:teuthology.orchestra.run.smithi188.stdout:4533 read 0x185ee00 thru 0x1866b06 (0x7d07 bytes) 2024-09-14T08:42:10.249 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:10.249+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:10.278 INFO:teuthology.orchestra.run.smithi188.stdout:4534 write 0x5df4a00 thru 0x5dfbd14 (0x7315 bytes) 2024-09-14T08:42:10.281 INFO:teuthology.orchestra.run.smithi188.stdout:4537 read 0x5a3a600 thru 0x5a47dc9 (0xd7ca bytes) 2024-09-14T08:42:10.326 INFO:teuthology.orchestra.run.smithi188.stdout:4540 write 0xc715400 thru 0xc717335 (0x1f36 bytes) 2024-09-14T08:42:10.329 INFO:teuthology.orchestra.run.smithi188.stdout:4544 read 0x916cc00 thru 0x9176777 (0x9b78 bytes) 2024-09-14T08:42:10.329 INFO:teuthology.orchestra.run.smithi188.stdout:4545 read 0xc5d2200 thru 0xc5dc91f (0xa720 bytes) 2024-09-14T08:42:10.331 INFO:teuthology.orchestra.run.smithi188.stdout:4547 read 0x388a600 thru 0x388f086 (0x4a87 bytes) 2024-09-14T08:42:10.331 INFO:teuthology.orchestra.run.smithi188.stdout:4548 read 0x70c1200 thru 0x70c58af (0x46b0 bytes) 2024-09-14T08:42:10.331 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:10.332 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:10.346 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:10.361 INFO:teuthology.orchestra.run.smithi188.stdout:4549 trunc from 0xc717400 to 0xb90400 2024-09-14T08:42:10.389 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:10.389+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:10.419 INFO:teuthology.orchestra.run.smithi188.stdout:4550 trunc from 0xb90400 to 0x33d0c00 2024-09-14T08:42:10.445 INFO:teuthology.orchestra.run.smithi188.stdout:4551 read 0x11e1e00 thru 0x11f07ab (0xe9ac bytes) 2024-09-14T08:42:10.450 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:10.447+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:10.503 INFO:teuthology.orchestra.run.smithi188.stdout:4552 write 0xd57dc00 thru 0xd5839d9 (0x5dda bytes) 2024-09-14T08:42:10.505 INFO:teuthology.orchestra.run.smithi188.stdout:4554 write 0xba0b400 thru 0xba0ca79 (0x167a bytes) 2024-09-14T08:42:10.513 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:10.513 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:10.513 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:10.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:10.547 INFO:teuthology.orchestra.run.smithi188.stdout:4556 write 0xec9c600 thru 0xec9f9a8 (0x33a9 bytes) 2024-09-14T08:42:10.550 INFO:teuthology.orchestra.run.smithi188.stdout:4558 write 0x8a64c00 thru 0x8a709ea (0xbdeb bytes) 2024-09-14T08:42:10.572 INFO:teuthology.orchestra.run.smithi188.stdout:4559 trunc from 0xec9fa00 to 0x6e06c00 2024-09-14T08:42:10.573 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:10.573+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:10.615 INFO:teuthology.orchestra.run.smithi188.stdout:4561 write 0x1899c00 thru 0x189a830 (0xc31 bytes) 2024-09-14T08:42:10.617 INFO:teuthology.orchestra.run.smithi188.stdout:4562 read 0x48b9000 thru 0x48c3409 (0xa40a bytes) 2024-09-14T08:42:10.618 INFO:teuthology.orchestra.run.smithi188.stdout:4564 punch from 0x1657a00 to 0x1664600, (0xcc00 bytes) 2024-09-14T08:42:10.652 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:10.649+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:10.653 INFO:teuthology.orchestra.run.smithi188.stdout:4565 write 0xd904000 thru 0xd90da41 (0x9a42 bytes) 2024-09-14T08:42:10.655 INFO:teuthology.orchestra.run.smithi188.stdout:4567 punch from 0x8acbc00 to 0x8ada600, (0xea00 bytes) 2024-09-14T08:42:10.658 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.578661496, 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:42:10.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:42:10.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.57860429199999, 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:10.664 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:42:10.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.578545408, 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.668 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.672 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.578480482, 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:42:10.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.57841903100001, 2024-09-14T08:42:10.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:42:10.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:42:10.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.57835949700001, 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:42:10.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.578300187, 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.686 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:10.690 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:10.691 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.57822815500001, 2024-09-14T08:42:10.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:42:10.691 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.691 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.691 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:10.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:10.691 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:42:10.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 105.42352777799999, 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:42:10.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:42:10.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 105.423496353, 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:42:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 61.059632733000001, 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:10.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:42:10.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 61.059573383, 2024-09-14T08:42:10.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:10.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:42:10.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:42:10.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:10.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 61.059533430999998, 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.715 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:10.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.720 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 37.576110477999997, 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.721 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:42:10.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:42:10.727 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 37.569717912000002, 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:10.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:42:10.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:42:10.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:42:10.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:10.734 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.810128492, 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:42:10.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:42:10.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:10.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.769389090000001, 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.741 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:42:10.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.747 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.501818006000001, 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:42:10.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:42:10.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:42:10.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.438014112000001, 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.755 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:42:10.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:42:10.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:42:10.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:10.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:42:10.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:42:10.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:10.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:10.762 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.410542413999998, 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:10.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:10.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:42:10.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:42:10.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:10.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:10.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:10.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:42:10.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:42:10.769 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.769 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.769 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.769 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:10.769 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:10.769 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:10.770 INFO:teuthology.orchestra.run.smithi188.stdout:4568 trunc from 0xd90dc00 to 0x2eacc00 2024-09-14T08:42:10.770 INFO:teuthology.orchestra.run.smithi188.stdout:4569 read 0x119e800 thru 0x11ab8d9 (0xd0da bytes) 2024-09-14T08:42:10.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:10.772 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:10.767+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:10.774 INFO:teuthology.orchestra.run.smithi188.stdout:4571 write 0xa7bfc00 thru 0xa7c86e0 (0x8ae1 bytes) 2024-09-14T08:42:10.778 INFO:teuthology.orchestra.run.smithi188.stdout:4572 write 0x926a200 thru 0x9274096 (0x9e97 bytes) 2024-09-14T08:42:10.798 INFO:teuthology.orchestra.run.smithi188.stdout:4573 trunc from 0xa7c8800 to 0x3615a00 2024-09-14T08:42:10.837 INFO:teuthology.orchestra.run.smithi188.stdout:4575 read 0x35d800 thru 0x35fd21 (0x2522 bytes) 2024-09-14T08:42:10.862 INFO:teuthology.orchestra.run.smithi188.stdout:4576 write 0x48a1c00 thru 0x48a7651 (0x5a52 bytes) 2024-09-14T08:42:10.871 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:10.867+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:10.905 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:10.905 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:10.905 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:10.905 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:10.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:10.954 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:42:10.972 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:10.969+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:11.021 INFO:teuthology.orchestra.run.smithi188.stdout:4578 read 0x4801400 thru 0x480c6af (0xb2b0 bytes) 2024-09-14T08:42:11.063 INFO:teuthology.orchestra.run.smithi188.stdout:4579 write 0xdb4de00 thru 0xdb5a267 (0xc468 bytes) 2024-09-14T08:42:11.068 INFO:teuthology.orchestra.run.smithi188.stdout:4580 write 0xd0c4c00 thru 0xd0c9d0b (0x510c bytes) 2024-09-14T08:42:11.069 INFO:teuthology.orchestra.run.smithi188.stdout:4581 write 0x6c98e00 thru 0x6ca3179 (0xa37a bytes) 2024-09-14T08:42:11.071 INFO:teuthology.orchestra.run.smithi188.stdout:4582 write 0xb14fa00 thru 0xb151466 (0x1a67 bytes) 2024-09-14T08:42:11.072 INFO:teuthology.orchestra.run.smithi188.stdout:4584 read 0x4e0c00 thru 0x4eccd9 (0xc0da bytes) 2024-09-14T08:42:11.072 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:11.071+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:11.074 INFO:teuthology.orchestra.run.smithi188.stdout:4586 write 0x8ff9200 thru 0x8ffe204 (0x5005 bytes) 2024-09-14T08:42:11.075 INFO:teuthology.orchestra.run.smithi188.stdout:4587 read 0x7ed2800 thru 0x7ed52ad (0x2aae bytes) 2024-09-14T08:42:11.076 INFO:teuthology.orchestra.run.smithi188.stdout:4588 read 0x2138800 thru 0x2142ca5 (0xa4a6 bytes) 2024-09-14T08:42:11.081 INFO:teuthology.orchestra.run.smithi188.stdout:4589 trunc from 0xdb5a400 to 0xbf55200 2024-09-14T08:42:11.086 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:11.086 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:11.086 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:11.087 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:11.087 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:11.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:11.127 INFO:teuthology.orchestra.run.smithi188.stdout:4594 write 0xce72c00 thru 0xce8046c (0xd86d bytes) 2024-09-14T08:42:11.130 INFO:teuthology.orchestra.run.smithi188.stdout:4595 punch from 0x69fc200 to 0x6a03000, (0x6e00 bytes) 2024-09-14T08:42:11.130 INFO:teuthology.orchestra.run.smithi188.stdout:4596 read 0xaf26e00 thru 0xaf2a7a6 (0x39a7 bytes) 2024-09-14T08:42:11.131 INFO:teuthology.orchestra.run.smithi188.stdout:4598 punch from 0x2557400 to 0x255e400, (0x7000 bytes) 2024-09-14T08:42:11.137 INFO:teuthology.orchestra.run.smithi188.stdout:4600 trunc from 0xce80600 to 0xa29d000 2024-09-14T08:42:11.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:11.173 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:11.173+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:11.177 INFO:teuthology.orchestra.run.smithi188.stdout:4602 write 0xb934a00 thru 0xb93ee82 (0xa483 bytes) 2024-09-14T08:42:11.179 INFO:teuthology.orchestra.run.smithi188.stdout:4603 write 0x7a50c00 thru 0x7a5a3b6 (0x97b7 bytes) 2024-09-14T08:42:11.183 INFO:teuthology.orchestra.run.smithi188.stdout:4604 trunc from 0xb93f000 to 0x9efe600 2024-09-14T08:42:11.222 INFO:teuthology.orchestra.run.smithi188.stdout:4605 trunc from 0x9efe600 to 0x414aa00 2024-09-14T08:42:11.273 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:11.271+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:11.278 INFO:teuthology.orchestra.run.smithi188.stdout:4606 write 0x9901e00 thru 0x9907dba (0x5fbb bytes) 2024-09-14T08:42:11.282 INFO:teuthology.orchestra.run.smithi188.stdout:4608 read 0x8d9ac00 thru 0x8d9ca9b (0x1e9c bytes) 2024-09-14T08:42:11.282 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:11.282 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:11.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:11.283 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [] 2024-09-14T08:42:11.283 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:11.283 INFO:teuthology.orchestra.run.smithi188.stdout:4609 punch from 0x12bd400 to 0x12c6600, (0x9200 bytes) 2024-09-14T08:42:11.283 INFO:teuthology.orchestra.run.smithi188.stdout:4615 read 0x2a07e00 thru 0x2a0bdf6 (0x3ff7 bytes) 2024-09-14T08:42:11.284 INFO:teuthology.orchestra.run.smithi188.stdout:4616 punch from 0x4f79a00 to 0x4f80000, (0x6600 bytes) 2024-09-14T08:42:11.294 INFO:teuthology.orchestra.run.smithi188.stdout:4619 trunc from 0x9907e00 to 0xda3f400 2024-09-14T08:42:11.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:11.310 INFO:teuthology.orchestra.run.smithi188.stdout:4621 punch from 0x335dc00 to 0x335ea00, (0xe00 bytes) 2024-09-14T08:42:11.312 INFO:teuthology.orchestra.run.smithi188.stdout:4622 read 0x3b11a00 thru 0x3b16303 (0x4904 bytes) 2024-09-14T08:42:11.313 INFO:teuthology.orchestra.run.smithi188.stdout:4626 read 0xb3ae800 thru 0xb3b925b (0xaa5c bytes) 2024-09-14T08:42:11.314 INFO:teuthology.orchestra.run.smithi188.stdout:4627 read 0x5e2ba00 thru 0x5e35c13 (0xa214 bytes) 2024-09-14T08:42:11.329 INFO:teuthology.orchestra.run.smithi188.stdout:4629 trunc from 0xda3f400 to 0x8775a00 2024-09-14T08:42:11.341 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:11.341 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:11.357 INFO:teuthology.orchestra.run.smithi188.stdout:4630 clone 31 order 22 su 1048576 sc 2 2024-09-14T08:42:11.360 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:11.360 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:11.374 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:11.373+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:11.378 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:11.378 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:11.399 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:11.400 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:11.421 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:11.421 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:11.441 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:11.441 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:11.458 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:11.458 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:11.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:11.519 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:11.519+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:11.576 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:11.573+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:11.637 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:11.637 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:11.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:11.678 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:11.677+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:11.770 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:11.770 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:11.779 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:11.777+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:11.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:11.879 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:11.879+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:11.908 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:11.908 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:11.923 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:11.942 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:42:12.011 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:12.011+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:12.074 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:12.074 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:12.081 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:12.079+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:12.088 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:12.182 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:12.179+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:12.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:12.307 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:12.307+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:12.383 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:12.381+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:12.401 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:12.401 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:12.415 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:12.501 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:12.501+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:12.582 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:12.582 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:12.585 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:12.585+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:12.595 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:12.686 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:12.683+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:12.764 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:12.764 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:12.776 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-14T08:42:12.778 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:12.825 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:12.825+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:12.868 INFO:teuthology.orchestra.run.smithi188.stdout:4631 read 0x58a4600 thru 0x58aa1f4 (0x5bf5 bytes) 2024-09-14T08:42:12.888 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:12.885+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:12.911 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:12.911 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:12.927 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:12.935 INFO:teuthology.orchestra.run.smithi188.stdout:4634 write 0xbfc9a00 thru 0xbfd0aad (0x70ae bytes) 2024-09-14T08:42:12.938 INFO:teuthology.orchestra.run.smithi188.stdout:4637 read 0x2ca2200 thru 0x2caa5bf (0x83c0 bytes) 2024-09-14T08:42:12.940 INFO:teuthology.orchestra.run.smithi188.stdout:4638 punch from 0xb715000 to 0xb719600, (0x4600 bytes) 2024-09-14T08:42:12.968 INFO:teuthology.orchestra.run.smithi188.stdout:4643 trunc from 0xbfd0c00 to 0x7395e00 2024-09-14T08:42:12.989 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:12.987+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout:4647 write 0xe273400 thru 0xe277de9 (0x49ea bytes) 2024-09-14T08:42:13.090 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:13.089+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout:4650 trunc from 0xe277e00 to 0x8eca600 2024-09-14T08:42:13.102 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:13.102 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:13.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout:4651 read 0x7fb1400 thru 0x7fb45f4 (0x31f5 bytes) 2024-09-14T08:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout:4652 read 0x8a4ae00 thru 0x8a516b2 (0x68b3 bytes) 2024-09-14T08:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout:4653 write 0x2a31e00 thru 0x2a3fcb0 (0xdeb1 bytes) 2024-09-14T08:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout:4656 punch from 0x20caa00 to 0x20d7800, (0xce00 bytes) 2024-09-14T08:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout:4657 read 0x6158e00 thru 0x6165635 (0xc836 bytes) 2024-09-14T08:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout:4658 read 0x4a4ec00 thru 0x4a4f065 (0x466 bytes) 2024-09-14T08:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout:4661 punch from 0x30ba200 to 0x30c9800, (0xf600 bytes) 2024-09-14T08:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout:4662 write 0xb220e00 thru 0xb221a8f (0xc90 bytes) 2024-09-14T08:42:13.190 INFO:teuthology.orchestra.run.smithi188.stdout:4663 trunc from 0xb221c00 to 0xea0da00 2024-09-14T08:42:13.190 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:13.187+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:13.214 INFO:teuthology.orchestra.run.smithi188.stdout:4664 write 0x19d3c00 thru 0x19d7c2e (0x402f bytes) 2024-09-14T08:42:13.260 INFO:teuthology.orchestra.run.smithi188.stdout:4665 trunc from 0xea0da00 to 0x5791400 2024-09-14T08:42:13.288 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:13.289 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:13.291 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:13.289+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:13.304 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:13.384 INFO:teuthology.orchestra.run.smithi188.stdout:4666 trunc from 0x5791400 to 0x380200 2024-09-14T08:42:13.393 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:13.393+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:13.460 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:13.460 INFO:teuthology.orchestra.run.smithi188.stdout:4667 trunc from 0x380200 to 0xdf9b000 2024-09-14T08:42:13.481 INFO:teuthology.orchestra.run.smithi188.stdout:4669 read 0x95ed800 thru 0x95f7105 (0x9906 bytes) 2024-09-14T08:42:13.484 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:13.484 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:13.484 INFO:teuthology.orchestra.run.smithi188.stdout:4670 write 0x9b16200 thru 0x9b1e9b8 (0x87b9 bytes) 2024-09-14T08:42:13.485 INFO:teuthology.orchestra.run.smithi188.stdout:4672 read 0x7502800 thru 0x750983e (0x703f bytes) 2024-09-14T08:42:13.493 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:13.493+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:13.498 INFO:teuthology.orchestra.run.smithi188.stdout:4674 trunc from 0xdf9b000 to 0x8720200 2024-09-14T08:42:13.499 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:13.555 INFO:teuthology.orchestra.run.smithi188.stdout:4675 write 0xcbf0200 thru 0xcbfe638 (0xe439 bytes) 2024-09-14T08:42:13.557 INFO:teuthology.orchestra.run.smithi188.stdout:4677 write 0x1039a00 thru 0x10485a9 (0xebaa bytes) 2024-09-14T08:42:13.557 INFO:teuthology.orchestra.run.smithi188.stdout:4680 read 0x7048a00 thru 0x70584cf (0xfad0 bytes) 2024-09-14T08:42:13.557 INFO:teuthology.orchestra.run.smithi188.stdout:4681 write 0x9565e00 thru 0x956e970 (0x8b71 bytes) 2024-09-14T08:42:13.589 INFO:teuthology.orchestra.run.smithi188.stdout:4685 write 0xebb6000 thru 0xebba789 (0x478a bytes) 2024-09-14T08:42:13.591 INFO:teuthology.orchestra.run.smithi188.stdout:4687 write 0x18e2200 thru 0x18e4644 (0x2445 bytes) 2024-09-14T08:42:13.591 INFO:teuthology.orchestra.run.smithi188.stdout:4688 write 0x866a800 thru 0x866b005 (0x806 bytes) 2024-09-14T08:42:13.591 INFO:teuthology.orchestra.run.smithi188.stdout:4689 read 0x83b7400 thru 0x83baa23 (0x3624 bytes) 2024-09-14T08:42:13.591 INFO:teuthology.orchestra.run.smithi188.stdout:4690 read 0x9cb0400 thru 0x9cbdbda (0xd7db bytes) 2024-09-14T08:42:13.592 INFO:teuthology.orchestra.run.smithi188.stdout:4693 read 0xd8e5c00 thru 0xd8f4df1 (0xf1f2 bytes) 2024-09-14T08:42:13.594 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:13.593+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:13.611 INFO:teuthology.orchestra.run.smithi188.stdout:4694 trunc from 0xebba800 to 0x75f0800 2024-09-14T08:42:13.618 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:13.618 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:13.635 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:13.636 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:13.652 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:13.652 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:13.654 INFO:teuthology.orchestra.run.smithi188.stdout:4695 read 0x6b03e00 thru 0x6b07c67 (0x3e68 bytes) 2024-09-14T08:42:13.657 INFO:teuthology.orchestra.run.smithi188.stdout:4696 read 0x1d95400 thru 0x1d9a8dd (0x54de bytes) 2024-09-14T08:42:13.671 INFO:teuthology.orchestra.run.smithi188.stdout:4698 trunc from 0x75f0800 to 0x1f2aa00 2024-09-14T08:42:13.671 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:13.680 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:13.680 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:13.692 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:13.692 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:13.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:13.696 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:13.695+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:13.717 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:13.717 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:13.737 INFO:teuthology.orchestra.run.smithi188.stdout:4700 write 0xd3da800 thru 0xd3e784f (0xd050 bytes) 2024-09-14T08:42:13.739 INFO:teuthology.orchestra.run.smithi188.stdout:4703 punch from 0x59e7a00 to 0x59eac00, (0x3200 bytes) 2024-09-14T08:42:13.739 INFO:teuthology.orchestra.run.smithi188.stdout:4704 write 0x4801e00 thru 0x4811990 (0xfb91 bytes) 2024-09-14T08:42:13.740 INFO:teuthology.orchestra.run.smithi188.stdout:4705 read 0x1cbc00 thru 0x1d1a75 (0x5e76 bytes) 2024-09-14T08:42:13.740 INFO:teuthology.orchestra.run.smithi188.stdout:4707 write 0xb1a2e00 thru 0xb1a6bd7 (0x3dd8 bytes) 2024-09-14T08:42:13.740 INFO:teuthology.orchestra.run.smithi188.stdout:4708 punch from 0x4a96400 to 0x4a9b400, (0x5000 bytes) 2024-09-14T08:42:13.741 INFO:teuthology.orchestra.run.smithi188.stdout:4709 punch from 0xa321200 to 0xa32d400, (0xc200 bytes) 2024-09-14T08:42:13.741 INFO:teuthology.orchestra.run.smithi188.stdout:4712 write 0xa111c00 thru 0xa11f529 (0xd92a bytes) 2024-09-14T08:42:13.768 INFO:teuthology.orchestra.run.smithi188.stdout:4713 write 0xdcfa600 thru 0xdd041ce (0x9bcf bytes) 2024-09-14T08:42:13.770 INFO:teuthology.orchestra.run.smithi188.stdout:4715 punch from 0x6826600 to 0x6831800, (0xb200 bytes) 2024-09-14T08:42:13.771 INFO:teuthology.orchestra.run.smithi188.stdout:4716 punch from 0x326c00 to 0x327800, (0xc00 bytes) 2024-09-14T08:42:13.771 INFO:teuthology.orchestra.run.smithi188.stdout:4717 read 0xaaee200 thru 0xaaf1330 (0x3131 bytes) 2024-09-14T08:42:13.796 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:13.795+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:13.797 INFO:teuthology.orchestra.run.smithi188.stdout:4719 trunc from 0xdd04200 to 0x308e00 2024-09-14T08:42:13.827 INFO:teuthology.orchestra.run.smithi188.stdout:4721 read 0x121000 thru 0x121361 (0x362 bytes) 2024-09-14T08:42:13.855 INFO:teuthology.orchestra.run.smithi188.stdout:4722 write 0x35e7a00 thru 0x35ef391 (0x7992 bytes) 2024-09-14T08:42:13.856 INFO:teuthology.orchestra.run.smithi188.stdout:4725 read 0x1c40c00 thru 0x1c41f07 (0x1308 bytes) 2024-09-14T08:42:13.872 INFO:teuthology.orchestra.run.smithi188.stdout:4729 trunc from 0x35ef400 to 0xa504c00 2024-09-14T08:42:13.875 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:13.875 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:13.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:13.875 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:13.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.875 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:13.875 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:13.875 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 132.795908263, 2024-09-14T08:42:13.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:42:13.875 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:42:13.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:42:13.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:42:13.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:42:13.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:42:13.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:42:13.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:42:13.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:42:13.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:42:13.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:42:13.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:42:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:42:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 132.795851059, 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.882 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:42:13.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:42:13.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:42:13.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 132.795792175, 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:13.886 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:42:13.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:42:13.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:42:13.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:42:13.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 132.79572724900001, 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:13.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:13.892 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:42:13.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.892 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:13.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:42:13.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:42:13.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:42:13.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:42:13.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 132.79566579799999, 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.896 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:42:13.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:42:13.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.900 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 132.79560626400001, 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:13.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:13.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:42:13.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:13.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:42:13.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:42:13.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:42:13.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:42:13.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:42:13.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:42:13.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 132.795546954, 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:42:13.906 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:42:13.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 132.79547492200001, 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:13.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:42:13.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:42:13.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:13.915 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 108.640774545, 2024-09-14T08:42:13.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:42:13.916 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.916 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.916 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:13.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:13.916 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:42:13.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.916 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:13.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 108.64074312, 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:42:13.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:42:13.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.276879500000007, 2024-09-14T08:42:13.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:13.929 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.276820150000006, 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:13.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:42:13.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:42:13.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:42:13.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:42:13.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.276780197999997, 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:13.936 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:42:13.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:42:13.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:42:13.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.793357245000003, 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:42:13.942 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:42:13.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:42:13.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:42:13.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:13.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:42:13.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:42:13.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:42:13.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:13.949 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.786964679, 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:42:13.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:42:13.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 32.027375259000003, 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:42:13.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.986635857, 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.963 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:42:13.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:42:13.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:13.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.969 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.970 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:13.970 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:13.970 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.719064772999999, 2024-09-14T08:42:13.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:42:13.971 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.971 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.971 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:13.971 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.971 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:42:13.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:42:13.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:42:13.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:42:13.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:13.977 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.655260879, 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:13.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:42:13.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:42:13.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.627789181000001, 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:13.984 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:13.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:13.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:13.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:13.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:13.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:42:13.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:42:13.990 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.990 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.990 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.990 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:13.990 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:13.990 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:13.990 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5] out_osds: [3, 0] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:42:13.991 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:42:13.991 INFO:tasks.thrashosds.thrasher:Adding osd 0 2024-09-14T08:42:13.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 0 2024-09-14T08:42:13.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:42:13.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:13.994 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:13.989+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:13.995 INFO:teuthology.orchestra.run.smithi188.stdout:4730 write 0x9b16000 thru 0x9b1aa4b (0x4a4c bytes) 2024-09-14T08:42:13.995 INFO:teuthology.orchestra.run.smithi188.stdout:4731 read 0x8ef5e00 thru 0x8f01d83 (0xbf84 bytes) 2024-09-14T08:42:13.995 INFO:teuthology.orchestra.run.smithi188.stdout:4732 write 0xec38800 thru 0xec3eea6 (0x66a7 bytes) 2024-09-14T08:42:13.995 INFO:teuthology.orchestra.run.smithi188.stdout:4734 read 0x6ea3c00 thru 0x6eadb82 (0x9f83 bytes) 2024-09-14T08:42:13.995 INFO:teuthology.orchestra.run.smithi188.stdout:4735 punch from 0xc2eba00 to 0xc2fb000, (0xf600 bytes) 2024-09-14T08:42:13.995 INFO:teuthology.orchestra.run.smithi188.stdout:4738 write 0x11c6a00 thru 0x11ca7da (0x3ddb bytes) 2024-09-14T08:42:13.995 INFO:teuthology.orchestra.run.smithi188.stdout:4741 read 0x3c81800 thru 0x3c84017 (0x2818 bytes) 2024-09-14T08:42:13.995 INFO:teuthology.orchestra.run.smithi188.stdout:4742 write 0x623fe00 thru 0x624a0ad (0xa2ae bytes) 2024-09-14T08:42:13.995 INFO:teuthology.orchestra.run.smithi188.stdout:4745 read 0x858600 thru 0x8652e0 (0xcce1 bytes) 2024-09-14T08:42:13.996 INFO:teuthology.orchestra.run.smithi188.stdout:4748 write 0x974c000 thru 0x9753376 (0x7377 bytes) 2024-09-14T08:42:13.996 INFO:teuthology.orchestra.run.smithi188.stdout:4750 trunc from 0xec3f000 to 0xbdf8400 2024-09-14T08:42:14.003 INFO:teuthology.orchestra.run.smithi188.stdout:4751 read 0x89cc000 thru 0x89d73a0 (0xb3a1 bytes) 2024-09-14T08:42:14.015 INFO:teuthology.orchestra.run.smithi188.stdout:4752 trunc from 0xbdf8400 to 0x820b800 2024-09-14T08:42:14.060 INFO:teuthology.orchestra.run.smithi188.stdout:4753 trunc from 0x820b800 to 0x5b84a00 2024-09-14T08:42:14.092 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:14.091+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:14.097 INFO:teuthology.orchestra.run.smithi188.stdout:4755 read 0x5021400 thru 0x50299e7 (0x85e8 bytes) 2024-09-14T08:42:14.100 INFO:teuthology.orchestra.run.smithi188.stdout:4761 read 0x794c00 thru 0x7a08fb (0xbcfc bytes) 2024-09-14T08:42:14.139 INFO:teuthology.orchestra.run.smithi188.stdout:4762 write 0xb004000 thru 0xb011845 (0xd846 bytes) 2024-09-14T08:42:14.142 INFO:teuthology.orchestra.run.smithi188.stdout:4763 punch from 0x9adee00 to 0x9ae3a00, (0x4c00 bytes) 2024-09-14T08:42:14.143 INFO:teuthology.orchestra.run.smithi188.stdout:4764 write 0x4bdfe00 thru 0x4bead72 (0xaf73 bytes) 2024-09-14T08:42:14.143 INFO:teuthology.orchestra.run.smithi188.stdout:4766 write 0x2886400 thru 0x2892b65 (0xc766 bytes) 2024-09-14T08:42:14.143 INFO:teuthology.orchestra.run.smithi188.stdout:4767 read 0x90d5200 thru 0x90e2019 (0xce1a bytes) 2024-09-14T08:42:14.144 INFO:teuthology.orchestra.run.smithi188.stdout:4768 read 0x1fb1200 thru 0x1fbd484 (0xc285 bytes) 2024-09-14T08:42:14.144 INFO:teuthology.orchestra.run.smithi188.stdout:4769 write 0x6d06000 thru 0x6d15dd1 (0xfdd2 bytes) 2024-09-14T08:42:14.144 INFO:teuthology.orchestra.run.smithi188.stdout:4770 write 0x1fa8e00 thru 0x1fa9685 (0x886 bytes) 2024-09-14T08:42:14.144 INFO:teuthology.orchestra.run.smithi188.stdout:4773 write 0x13f0a00 thru 0x13f37b4 (0x2db5 bytes) 2024-09-14T08:42:14.149 INFO:teuthology.orchestra.run.smithi188.stdout:4774 trunc from 0xb011a00 to 0x8e31400 2024-09-14T08:42:14.186 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:14.186 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:14.192 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:14.191+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:14.201 INFO:teuthology.orchestra.run.smithi188.stdout:4775 read 0x358c00 thru 0x35d62e (0x4a2f bytes) 2024-09-14T08:42:14.204 INFO:teuthology.orchestra.run.smithi188.stdout:4776 read 0x174b800 thru 0x174cf61 (0x1762 bytes) 2024-09-14T08:42:14.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:14.240 INFO:teuthology.orchestra.run.smithi188.stdout:4777 write 0xbca1400 thru 0xbcaffbf (0xebc0 bytes) 2024-09-14T08:42:14.243 INFO:teuthology.orchestra.run.smithi188.stdout:4778 write 0x82bfa00 thru 0x82cba17 (0xc018 bytes) 2024-09-14T08:42:14.244 INFO:teuthology.orchestra.run.smithi188.stdout:4780 punch from 0x622ae00 to 0x622da00, (0x2c00 bytes) 2024-09-14T08:42:14.267 INFO:teuthology.orchestra.run.smithi188.stdout:4786 trunc from 0xbcb0000 to 0x266e00 2024-09-14T08:42:14.299 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:14.299+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:14.307 INFO:teuthology.orchestra.run.smithi188.stdout:4787 read 0x7400 thru 0x140e3 (0xcce4 bytes) 2024-09-14T08:42:14.311 INFO:teuthology.orchestra.run.smithi188.stdout:4789 punch from 0x82800 to 0x87800, (0x5000 bytes) 2024-09-14T08:42:14.311 INFO:teuthology.orchestra.run.smithi188.stdout:4790 punch from 0x157600 to 0x161600, (0xa000 bytes) 2024-09-14T08:42:14.345 INFO:teuthology.orchestra.run.smithi188.stdout:4792 write 0x17adc00 thru 0x17ae4ea (0x8eb bytes) 2024-09-14T08:42:14.376 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-14T08:42:14.375+0000 7f7148add640 -1 mon.a@0(leader).osd e135 definitely_dead 0 2024-09-14T08:42:14.381 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:14.381 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:14.381 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:14.381 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:14.381 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:14.393 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:14.391+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:14.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:14.397 INFO:teuthology.orchestra.run.smithi188.stdout:4797 write 0x757fa00 thru 0x758f805 (0xfe06 bytes) 2024-09-14T08:42:14.431 INFO:teuthology.orchestra.run.smithi188.stdout:4800 write 0x80cc200 thru 0x80d4233 (0x8034 bytes) 2024-09-14T08:42:14.469 INFO:teuthology.orchestra.run.smithi188.stdout:4801 write 0x9abc200 thru 0x9ac9f00 (0xdd01 bytes) 2024-09-14T08:42:14.472 INFO:teuthology.orchestra.run.smithi188.stdout:4802 read 0x67e7600 thru 0x67e8ee9 (0x18ea bytes) 2024-09-14T08:42:14.472 INFO:teuthology.orchestra.run.smithi188.stdout:4808 write 0x7100e00 thru 0x710f65f (0xe860 bytes) 2024-09-14T08:42:14.490 INFO:teuthology.orchestra.run.smithi188.stdout:4809 trunc from 0x9aca000 to 0x1221e00 2024-09-14T08:42:14.494 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:14.491+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:14.535 INFO:teuthology.orchestra.run.smithi188.stdout:4810 read 0x587a00 thru 0x58fa37 (0x8038 bytes) 2024-09-14T08:42:14.560 INFO:teuthology.orchestra.run.smithi188.stdout:4812 trunc from 0x1221e00 to 0x9912600 2024-09-14T08:42:14.567 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:14.567 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:14.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:14.567 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [] 2024-09-14T08:42:14.567 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:14.582 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:14.587 INFO:teuthology.orchestra.run.smithi188.stdout:4817 punch from 0x1f7dc00 to 0x1f7ec00, (0x1000 bytes) 2024-09-14T08:42:14.589 INFO:teuthology.orchestra.run.smithi188.stdout:4818 write 0x3e0a800 thru 0x3e173eb (0xcbec bytes) 2024-09-14T08:42:14.589 INFO:teuthology.orchestra.run.smithi188.stdout:4820 write 0x206000 thru 0x213de1 (0xdde2 bytes) 2024-09-14T08:42:14.600 INFO:teuthology.orchestra.run.smithi188.stdout:4821 trunc from 0x9912600 to 0xd642e00 2024-09-14T08:42:14.627 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:14.627+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:14.632 INFO:teuthology.orchestra.run.smithi188.stdout:4824 read 0xa095200 thru 0xa09740e (0x220f bytes) 2024-09-14T08:42:14.637 INFO:teuthology.orchestra.run.smithi188.stdout:4826 write 0x6cff400 thru 0x6d0e913 (0xf514 bytes) 2024-09-14T08:42:14.637 INFO:teuthology.orchestra.run.smithi188.stdout:4830 read 0x812e00 thru 0x817abb (0x4cbc bytes) 2024-09-14T08:42:14.637 INFO:teuthology.orchestra.run.smithi188.stdout:4833 write 0x94fd400 thru 0x94fdd53 (0x954 bytes) 2024-09-14T08:42:14.637 INFO:teuthology.orchestra.run.smithi188.stdout:4834 punch from 0x2893800 to 0x289da00, (0xa200 bytes) 2024-09-14T08:42:14.658 INFO:teuthology.orchestra.run.smithi188.stdout:4835 trunc from 0xd642e00 to 0x20f3c00 2024-09-14T08:42:14.696 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:14.695+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:14.701 INFO:teuthology.orchestra.run.smithi188.stdout:4838 punch from 0x1d95000 to 0x1d9c800, (0x7800 bytes) 2024-09-14T08:42:14.703 INFO:teuthology.orchestra.run.smithi188.stdout:4839 read 0x272400 thru 0x275044 (0x2c45 bytes) 2024-09-14T08:42:14.754 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:14.754 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:14.757 INFO:teuthology.orchestra.run.smithi188.stdout:4840 write 0xadfe600 thru 0xae0dfcf (0xf9d0 bytes) 2024-09-14T08:42:14.759 INFO:teuthology.orchestra.run.smithi188.stdout:4844 punch from 0x49ff200 to 0x4a00000, (0xe00 bytes) 2024-09-14T08:42:14.760 INFO:teuthology.orchestra.run.smithi188.stdout:4846 punch from 0x3756400 to 0x3766000, (0xfc00 bytes) 2024-09-14T08:42:14.760 INFO:teuthology.orchestra.run.smithi188.stdout:4847 read 0x1eaec00 thru 0x1eb8287 (0x9688 bytes) 2024-09-14T08:42:14.761 INFO:teuthology.orchestra.run.smithi188.stdout:4848 read 0x9561800 thru 0x956eb39 (0xd33a bytes) 2024-09-14T08:42:14.761 INFO:teuthology.orchestra.run.smithi188.stdout:4849 punch from 0xaad4800 to 0xaad6200, (0x1a00 bytes) 2024-09-14T08:42:14.761 INFO:teuthology.orchestra.run.smithi188.stdout:4850 read 0x6466800 thru 0x64735fd (0xcdfe bytes) 2024-09-14T08:42:14.761 INFO:teuthology.orchestra.run.smithi188.stdout:4852 read 0x8bb6e00 thru 0x8bc2fb6 (0xc1b7 bytes) 2024-09-14T08:42:14.761 INFO:teuthology.orchestra.run.smithi188.stdout:4853 write 0x2635200 thru 0x2638d9d (0x3b9e bytes) 2024-09-14T08:42:14.761 INFO:teuthology.orchestra.run.smithi188.stdout:4857 punch from 0x85bbc00 to 0x85be200, (0x2600 bytes) 2024-09-14T08:42:14.762 INFO:teuthology.orchestra.run.smithi188.stdout:4860 punch from 0x8ced400 to 0x8cf8800, (0xb400 bytes) 2024-09-14T08:42:14.763 INFO:teuthology.orchestra.run.smithi188.stdout:4861 read 0x1028c00 thru 0x102c5ed (0x39ee bytes) 2024-09-14T08:42:14.763 INFO:teuthology.orchestra.run.smithi188.stdout:4865 read 0xa868200 thru 0xa877131 (0xef32 bytes) 2024-09-14T08:42:14.763 INFO:teuthology.orchestra.run.smithi188.stdout:4866 punch from 0x5ced000 to 0x5cf3200, (0x6200 bytes) 2024-09-14T08:42:14.763 INFO:teuthology.orchestra.run.smithi188.stdout:4867 read 0x9a12400 thru 0x9a143d2 (0x1fd3 bytes) 2024-09-14T08:42:14.763 INFO:teuthology.orchestra.run.smithi188.stdout:4869 write 0xa6b7200 thru 0xa6bf8f5 (0x86f6 bytes) 2024-09-14T08:42:14.763 INFO:teuthology.orchestra.run.smithi188.stdout:4872 read 0x311e600 thru 0x31263d0 (0x7dd1 bytes) 2024-09-14T08:42:14.763 INFO:teuthology.orchestra.run.smithi188.stdout:4874 read 0x11f7200 thru 0x11fa471 (0x3272 bytes) 2024-09-14T08:42:14.767 INFO:teuthology.orchestra.run.smithi188.stdout:4876 trunc from 0xae0e000 to 0xc9bae00 2024-09-14T08:42:14.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:14.797 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:14.797+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:14.814 INFO:teuthology.orchestra.run.smithi188.stdout:4878 read 0x1360200 thru 0x136c886 (0xc687 bytes) 2024-09-14T08:42:14.817 INFO:teuthology.orchestra.run.smithi188.stdout:4879 read 0x669e400 thru 0x66a9e55 (0xba56 bytes) 2024-09-14T08:42:14.832 INFO:teuthology.orchestra.run.smithi188.stdout:4881 trunc from 0xc9bae00 to 0x7570800 2024-09-14T08:42:14.869 INFO:teuthology.orchestra.run.smithi188.stdout:4882 read 0x6de8400 thru 0x6debf5b (0x3b5c bytes) 2024-09-14T08:42:14.871 INFO:teuthology.orchestra.run.smithi188.stdout:4883 punch from 0x72bc400 to 0x72bf000, (0x2c00 bytes) 2024-09-14T08:42:14.898 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:14.895+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:14.908 INFO:teuthology.orchestra.run.smithi188.stdout:4885 write 0xc5b1400 thru 0xc5b25cb (0x11cc bytes) 2024-09-14T08:42:14.910 INFO:teuthology.orchestra.run.smithi188.stdout:4886 punch from 0x4382e00 to 0x438b800, (0x8a00 bytes) 2024-09-14T08:42:14.910 INFO:teuthology.orchestra.run.smithi188.stdout:4887 punch from 0x1be2000 to 0x1beb200, (0x9200 bytes) 2024-09-14T08:42:14.911 INFO:teuthology.orchestra.run.smithi188.stdout:4889 read 0xa713c00 thru 0xa71fe33 (0xc234 bytes) 2024-09-14T08:42:14.911 INFO:teuthology.orchestra.run.smithi188.stdout:4890 punch from 0xa624600 to 0xa627c00, (0x3600 bytes) 2024-09-14T08:42:14.912 INFO:teuthology.orchestra.run.smithi188.stdout:4891 write 0x2a42200 thru 0x2a426ea (0x4eb bytes) 2024-09-14T08:42:14.912 INFO:teuthology.orchestra.run.smithi188.stdout:4893 punch from 0xf2a800 to 0xf30200, (0x5a00 bytes) 2024-09-14T08:42:14.912 INFO:teuthology.orchestra.run.smithi188.stdout:4895 read 0xafaf600 thru 0xafb0ed4 (0x18d5 bytes) 2024-09-14T08:42:14.912 INFO:teuthology.orchestra.run.smithi188.stdout:4896 write 0x7a90000 thru 0x7a9aef2 (0xaef3 bytes) 2024-09-14T08:42:14.912 INFO:teuthology.orchestra.run.smithi188.stdout:4898 read 0xa14cc00 thru 0xa157983 (0xad84 bytes) 2024-09-14T08:42:14.912 INFO:teuthology.orchestra.run.smithi188.stdout:4899 write 0x3f75000 thru 0x3f75c69 (0xc6a bytes) 2024-09-14T08:42:14.913 INFO:teuthology.orchestra.run.smithi188.stdout:4900 read 0x9952800 thru 0x9961c85 (0xf486 bytes) 2024-09-14T08:42:14.913 INFO:teuthology.orchestra.run.smithi188.stdout:4902 punch from 0x3556e00 to 0x3564000, (0xd200 bytes) 2024-09-14T08:42:14.913 INFO:teuthology.orchestra.run.smithi188.stdout:4903 read 0x1fda00 thru 0x203e27 (0x6428 bytes) 2024-09-14T08:42:14.915 INFO:teuthology.orchestra.run.smithi188.stdout:4904 write 0x46afc00 thru 0x46bcf3b (0xd33c bytes) 2024-09-14T08:42:14.915 INFO:teuthology.orchestra.run.smithi188.stdout:4905 read 0x73f7200 thru 0x73fd1bb (0x5fbc bytes) 2024-09-14T08:42:14.915 INFO:teuthology.orchestra.run.smithi188.stdout:4907 read 0x26bee00 thru 0x26c2d08 (0x3f09 bytes) 2024-09-14T08:42:14.915 INFO:teuthology.orchestra.run.smithi188.stdout:4908 write 0xa0a7600 thru 0xa0b3a2d (0xc42e bytes) 2024-09-14T08:42:14.915 INFO:teuthology.orchestra.run.smithi188.stdout:4910 write 0xb5800 thru 0xb7c75 (0x2476 bytes) 2024-09-14T08:42:14.916 INFO:teuthology.orchestra.run.smithi188.stdout:4911 punch from 0x6b64a00 to 0x6b6d800, (0x8e00 bytes) 2024-09-14T08:42:14.917 INFO:teuthology.orchestra.run.smithi188.stdout:4913 write 0x548a800 thru 0x548d2f7 (0x2af8 bytes) 2024-09-14T08:42:14.923 INFO:teuthology.orchestra.run.smithi188.stdout:4915 trunc from 0xc5b2600 to 0x921ca00 2024-09-14T08:42:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:14.951 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:14.952 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:14.953 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:42:14.953 INFO:teuthology.orchestra.run.smithi089.stderr:marked in osd.0. 2024-09-14T08:42:14.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:14.993 INFO:tasks.thrashosds.thrasher:Added osd 0 2024-09-14T08:42:15.035 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:15.035+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:15.101 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:15.096+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:15.108 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:15.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:15.108 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:15.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 138.182018188, 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:42:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:42:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 138.18196341000001, 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:42:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 124.75419295099999, 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.76158888400001, 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:42:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:42:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.760750513, 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.742242412000003, 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:42:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.741928203000001, 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:42:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.740291876999997, 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.740073918, 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:42:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:42:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.739778516000001, 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.739507680999999, 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:42:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:42:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.528317000000001, 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.528296965999999, 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:42:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:42:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:42:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.528275888000003, 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.528256294000002, 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.528236139999997, 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:42:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.528216743999998, 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:42:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.521686944000002, 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:42:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.521667057999998, 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:42:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:42:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:42:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:42:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.521647684000001, 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:42:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:15.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:15.203 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:15.204+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:15.303 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:15.300+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:15.369 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:15.369 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:15.369 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:15.369 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:15.383 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:15.427 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:15.427+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:15.500 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:15.500 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:15.500 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:15.500 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:15.500 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:15.505 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:15.504+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:15.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:15.606 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:15.604+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 125.375331995, 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.681 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:42:15.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 93.113221816000006, 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:42:15.687 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 93.113074644999998, 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.692 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:15.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:42:15.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:42:15.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.697 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 93.112932845000003, 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:42:15.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:42:15.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:42:15.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:42:15.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.703 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.549667077999999, 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:42:15.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.541375788000003, 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.708 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.712 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.541352547000002, 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:42:15.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:42:15.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.541333283, 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.717 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.721 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.541314006999997, 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:42:15.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:42:15.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.541101554000001, 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:42:15.726 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:42:15.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:42:15.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:42:15.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:42:15.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.533888460999997, 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:42:15.731 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:42:15.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.735 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.533867248999996, 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.736 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:15.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:42:15.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.533847899000001, 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:42:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:15.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:15.745 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.533820859999999, 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:15.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:42:15.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:42:15.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.533801709999999, 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:42:15.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.533780126000003, 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:42:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.758 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.533760717, 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:42:15.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:42:15.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.533741841000001, 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.763 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.767 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.525711004999998, 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.525684609000002, 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:15.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:42:15.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:42:15.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:15.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:42:15.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:42:15.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:15.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:15.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:42:15.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:42:15.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.777 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:15.777 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:15.777 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:15.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:15.779 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:15.780+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:15.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:15.879 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:15.879+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:15.910 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:15.911 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:15.926 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:15.980 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:15.976+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:15.986 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:15.986 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:16.003 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:16.003 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:16.019 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:16.020 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:16.038 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:16.039 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:16.054 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:16.054 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:16.059 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:16.059 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:16.069 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:16.078 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:16.078 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:16.081 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:16.079+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:16.182 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:16.179+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:16.234 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:16.234 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:16.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:16.283 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:16.283+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:16.367 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:16.367 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:16.382 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:16.384 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:16.383+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:16.485 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:16.484+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:16.498 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:16.498 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:16.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:16.601 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:16.600+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:16.674 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:16.674 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:16.687 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:16.687+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:16.688 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:16.788 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:16.784+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:16.853 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:16.854 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:16.867 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:16.889 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:16.887+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:16.988 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:42:17.010 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:16.987+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:17.037 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:17.037 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:17.050 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:17.097 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:17.096+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout:4916 trunc from 0x921ca00 to 0xa4d3400 2024-09-14T08:42:17.140 INFO:teuthology.orchestra.run.smithi188.stdout:4918 punch from 0x945e00 to 0x94ce00, (0x7000 bytes) 2024-09-14T08:42:17.141 INFO:teuthology.orchestra.run.smithi188.stdout:4921 read 0x5b42a00 thru 0x5b4ce5d (0xa45e bytes) 2024-09-14T08:42:17.141 INFO:teuthology.orchestra.run.smithi188.stdout:4922 write 0x6337a00 thru 0x633ec7e (0x727f bytes) 2024-09-14T08:42:17.142 INFO:teuthology.orchestra.run.smithi188.stdout:4924 write 0x635a600 thru 0x635fe8a (0x588b bytes) 2024-09-14T08:42:17.142 INFO:teuthology.orchestra.run.smithi188.stdout:4925 punch from 0xca5400 to 0xcada00, (0x8600 bytes) 2024-09-14T08:42:17.142 INFO:teuthology.orchestra.run.smithi188.stdout:4926 read 0x5af7800 thru 0x5afdb99 (0x639a bytes) 2024-09-14T08:42:17.144 INFO:teuthology.orchestra.run.smithi188.stdout:4928 read 0x7af1400 thru 0x7affc35 (0xe836 bytes) 2024-09-14T08:42:17.145 INFO:teuthology.orchestra.run.smithi188.stdout:4929 read 0x882e800 thru 0x8831d5f (0x3560 bytes) 2024-09-14T08:42:17.177 INFO:teuthology.orchestra.run.smithi188.stdout:4931 write 0xa78dc00 thru 0xa797a6f (0x9e70 bytes) 2024-09-14T08:42:17.178 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:17.179 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:17.179 INFO:teuthology.orchestra.run.smithi188.stdout:4933 write 0x1314600 thru 0x1315c79 (0x167a bytes) 2024-09-14T08:42:17.181 INFO:teuthology.orchestra.run.smithi188.stdout:4934 read 0x685c800 thru 0x686c659 (0xfe5a bytes) 2024-09-14T08:42:17.181 INFO:teuthology.orchestra.run.smithi188.stdout:4935 read 0x12f3e00 thru 0x12fb610 (0x7811 bytes) 2024-09-14T08:42:17.191 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:17.188+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:17.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:17.237 INFO:teuthology.orchestra.run.smithi188.stdout:4936 write 0xe3a4000 thru 0xe3ac93f (0x8940 bytes) 2024-09-14T08:42:17.238 INFO:teuthology.orchestra.run.smithi188.stdout:4937 write 0x3bdc400 thru 0x3be832e (0xbf2f bytes) 2024-09-14T08:42:17.239 INFO:teuthology.orchestra.run.smithi188.stdout:4940 write 0x60ccc00 thru 0x60cf238 (0x2639 bytes) 2024-09-14T08:42:17.244 INFO:teuthology.orchestra.run.smithi188.stdout:4941 trunc from 0xe3aca00 to 0xd72c200 2024-09-14T08:42:17.292 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:17.291+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:17.294 INFO:teuthology.orchestra.run.smithi188.stdout:4942 write 0x7404600 thru 0x740ccc3 (0x86c4 bytes) 2024-09-14T08:42:17.299 INFO:teuthology.orchestra.run.smithi188.stdout:4944 read 0x8b19e00 thru 0x8b22003 (0x8204 bytes) 2024-09-14T08:42:17.301 INFO:teuthology.orchestra.run.smithi188.stdout:4945 trunc from 0xd72c200 to 0xe5a7e00 2024-09-14T08:42:17.326 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:17.326 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:17.336 INFO:teuthology.orchestra.run.smithi188.stdout:4946 read 0x387d400 thru 0x388a2ef (0xcef0 bytes) 2024-09-14T08:42:17.340 INFO:teuthology.orchestra.run.smithi188.stdout:4947 read 0xd48c600 thru 0xd493f1b (0x791c bytes) 2024-09-14T08:42:17.341 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:17.356 INFO:teuthology.orchestra.run.smithi188.stdout:4948 trunc from 0xe5a7e00 to 0x5b28c00 2024-09-14T08:42:17.398 INFO:teuthology.orchestra.run.smithi188.stdout:4949 write 0x1ff6a00 thru 0x1fff430 (0x8a31 bytes) 2024-09-14T08:42:17.422 INFO:teuthology.orchestra.run.smithi188.stdout:4950 trunc from 0x5b28c00 to 0xdb55800 2024-09-14T08:42:17.427 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:17.427+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:17.494 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:17.491+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:17.496 INFO:teuthology.orchestra.run.smithi188.stdout:4951 write 0xea01800 thru 0xea055ee (0x3def bytes) 2024-09-14T08:42:17.497 INFO:teuthology.orchestra.run.smithi188.stdout:4952 read 0xc41f200 thru 0xc41f9b3 (0x7b4 bytes) 2024-09-14T08:42:17.497 INFO:teuthology.orchestra.run.smithi188.stdout:4954 punch from 0x2a83400 to 0x2a92000, (0xec00 bytes) 2024-09-14T08:42:17.498 INFO:teuthology.orchestra.run.smithi188.stdout:4955 write 0x7deb400 thru 0x7deb487 (0x88 bytes) 2024-09-14T08:42:17.498 INFO:teuthology.orchestra.run.smithi188.stdout:4956 write 0x830f000 thru 0x83192b5 (0xa2b6 bytes) 2024-09-14T08:42:17.503 INFO:teuthology.orchestra.run.smithi188.stdout:4957 trunc from 0xea05600 to 0xc977c00 2024-09-14T08:42:17.514 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:17.514 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:17.529 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:17.554 INFO:teuthology.orchestra.run.smithi188.stdout:4959 read 0x2296800 thru 0x229e52c (0x7d2d bytes) 2024-09-14T08:42:17.594 INFO:teuthology.orchestra.run.smithi188.stdout:4960 punch from 0x40c1e00 to 0x40c9a00, (0x7c00 bytes) 2024-09-14T08:42:17.594 INFO:teuthology.orchestra.run.smithi188.stdout:4961 write 0x3350e00 thru 0x3354f38 (0x4139 bytes) 2024-09-14T08:42:17.594 INFO:teuthology.orchestra.run.smithi188.stdout:4964 write 0xd3c5800 thru 0xd3cbbe9 (0x63ea bytes) 2024-09-14T08:42:17.594 INFO:teuthology.orchestra.run.smithi188.stdout:4965 write 0x25eae00 thru 0x25f7b33 (0xcd34 bytes) 2024-09-14T08:42:17.595 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:17.595+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:17.596 INFO:teuthology.orchestra.run.smithi188.stdout:4966 trunc from 0xd3cbc00 to 0xcc36600 2024-09-14T08:42:17.652 INFO:teuthology.orchestra.run.smithi188.stdout:4968 read 0x5125600 thru 0x5134d1e (0xf71f bytes) 2024-09-14T08:42:17.669 INFO:teuthology.orchestra.run.smithi188.stdout:4971 trunc from 0xcc36600 to 0x7864000 2024-09-14T08:42:17.695 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:17.695+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:17.720 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:17.720 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:17.728 INFO:teuthology.orchestra.run.smithi188.stdout:4973 read 0x5773400 thru 0x577e879 (0xb47a bytes) 2024-09-14T08:42:17.734 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:17.736 INFO:teuthology.orchestra.run.smithi188.stdout:4974 trunc from 0x7864000 to 0x59ba400 2024-09-14T08:42:17.773 INFO:teuthology.orchestra.run.smithi188.stdout:4977 read 0x585ec00 thru 0x5867b7a (0x8f7b bytes) 2024-09-14T08:42:17.779 INFO:teuthology.orchestra.run.smithi188.stdout:4983 trunc from 0x59ba400 to 0x3f48600 2024-09-14T08:42:17.819 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:17.819+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:17.827 INFO:teuthology.orchestra.run.smithi188.stdout:4986 read 0x38b000 thru 0x38fbaf (0x4bb0 bytes) 2024-09-14T08:42:17.831 INFO:teuthology.orchestra.run.smithi188.stdout:4987 trunc from 0x3f48600 to 0x4c14c00 2024-09-14T08:42:17.870 INFO:teuthology.orchestra.run.smithi188.stdout:4988 read 0x6f6e00 thru 0x6fa6d0 (0x38d1 bytes) 2024-09-14T08:42:17.883 INFO:teuthology.orchestra.run.smithi188.stdout:4989 punch from 0x3006200 to 0x3011200, (0xb000 bytes) 2024-09-14T08:42:17.883 INFO:teuthology.orchestra.run.smithi188.stdout:4992 read 0xa4be00 thru 0xa59d61 (0xdf62 bytes) 2024-09-14T08:42:17.898 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:17.896+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:17.905 INFO:teuthology.orchestra.run.smithi188.stdout:4994 trunc from 0x4c14c00 to 0xe785600 2024-09-14T08:42:17.914 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:17.914 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:17.930 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:17.935 INFO:teuthology.orchestra.run.smithi188.stdout:4997 read 0x8ef3a00 thru 0x8ef5040 (0x1641 bytes) 2024-09-14T08:42:17.937 INFO:teuthology.orchestra.run.smithi188.stdout:4998 write 0x35c3600 thru 0x35d110d (0xdb0e bytes) 2024-09-14T08:42:17.954 INFO:teuthology.orchestra.run.smithi188.stdout:4999 trunc from 0xe785600 to 0x7597c00 2024-09-14T08:42:17.973 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:42:17.998 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:17.995+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:18.017 INFO:teuthology.orchestra.run.smithi188.stdout:5000 trunc from 0x7597c00 to 0xd45c000 2024-09-14T08:42:18.047 INFO:teuthology.orchestra.run.smithi188.stdout:5001 read 0x4120400 thru 0x412a485 (0xa086 bytes) 2024-09-14T08:42:18.049 INFO:teuthology.orchestra.run.smithi188.stdout:5002 write 0x431fc00 thru 0x432770b (0x7b0c bytes) 2024-09-14T08:42:18.049 INFO:teuthology.orchestra.run.smithi188.stdout:5003 write 0x9e3de00 thru 0x9e3e410 (0x611 bytes) 2024-09-14T08:42:18.050 INFO:teuthology.orchestra.run.smithi188.stdout:5004 read 0x493d000 thru 0x4947032 (0xa033 bytes) 2024-09-14T08:42:18.050 INFO:teuthology.orchestra.run.smithi188.stdout:5006 write 0x805ec00 thru 0x80637e9 (0x4bea bytes) 2024-09-14T08:42:18.050 INFO:teuthology.orchestra.run.smithi188.stdout:5007 punch from 0xd147400 to 0xd14be00, (0x4a00 bytes) 2024-09-14T08:42:18.050 INFO:teuthology.orchestra.run.smithi188.stdout:5008 write 0xca53a00 thru 0xca559ba (0x1fbb bytes) 2024-09-14T08:42:18.050 INFO:teuthology.orchestra.run.smithi188.stdout:5009 read 0x8013a00 thru 0x801a6ab (0x6cac bytes) 2024-09-14T08:42:18.051 INFO:teuthology.orchestra.run.smithi188.stdout:5011 punch from 0x6108200 to 0x6108400, (0x200 bytes) 2024-09-14T08:42:18.052 INFO:teuthology.orchestra.run.smithi188.stdout:5016 read 0xd15e400 thru 0xd163ff9 (0x5bfa bytes) 2024-09-14T08:42:18.052 INFO:teuthology.orchestra.run.smithi188.stdout:5017 write 0x7547800 thru 0x75521f6 (0xa9f7 bytes) 2024-09-14T08:42:18.052 INFO:teuthology.orchestra.run.smithi188.stdout:5018 read 0x1606a00 thru 0x1613fa7 (0xd5a8 bytes) 2024-09-14T08:42:18.052 INFO:teuthology.orchestra.run.smithi188.stdout:5019 write 0xac3b800 thru 0xac43ae7 (0x82e8 bytes) 2024-09-14T08:42:18.052 INFO:teuthology.orchestra.run.smithi188.stdout:5020 read 0xca7b600 thru 0xca7d9d2 (0x23d3 bytes) 2024-09-14T08:42:18.052 INFO:teuthology.orchestra.run.smithi188.stdout:5021 write 0xc98f400 thru 0xc99cfc3 (0xdbc4 bytes) 2024-09-14T08:42:18.052 INFO:teuthology.orchestra.run.smithi188.stdout:5023 write 0x39e9c00 thru 0x39f9008 (0xf409 bytes) 2024-09-14T08:42:18.053 INFO:teuthology.orchestra.run.smithi188.stdout:5024 read 0x7898800 thru 0x78a123f (0x8a40 bytes) 2024-09-14T08:42:18.053 INFO:teuthology.orchestra.run.smithi188.stdout:5026 read 0x6158e00 thru 0x61636ff (0xa900 bytes) 2024-09-14T08:42:18.054 INFO:teuthology.orchestra.run.smithi188.stdout:5029 write 0x4701400 thru 0x4706494 (0x5095 bytes) 2024-09-14T08:42:18.054 INFO:teuthology.orchestra.run.smithi188.stdout:5030 read 0x9ae7200 thru 0x9af017a (0x8f7b bytes) 2024-09-14T08:42:18.054 INFO:teuthology.orchestra.run.smithi188.stdout:5032 read 0x137da00 thru 0x137e9c5 (0xfc6 bytes) 2024-09-14T08:42:18.055 INFO:teuthology.orchestra.run.smithi188.stdout:5034 write 0x4af5c00 thru 0x4afd208 (0x7609 bytes) 2024-09-14T08:42:18.055 INFO:teuthology.orchestra.run.smithi188.stdout:5036 write 0x12e2200 thru 0x12ec5a2 (0xa3a3 bytes) 2024-09-14T08:42:18.055 INFO:teuthology.orchestra.run.smithi188.stdout:5038 punch from 0xbbfb200 to 0xbbff800, (0x4600 bytes) 2024-09-14T08:42:18.057 INFO:teuthology.orchestra.run.smithi188.stdout:5039 write 0x2361c00 thru 0x236a991 (0x8d92 bytes) 2024-09-14T08:42:18.096 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:18.099 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:18.095+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:18.104 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:18.104 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:18.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:18.124 INFO:teuthology.orchestra.run.smithi188.stdout:5041 write 0xd846400 thru 0xd85237c (0xbf7d bytes) 2024-09-14T08:42:18.127 INFO:teuthology.orchestra.run.smithi188.stdout:5042 write 0x3916600 thru 0x3924502 (0xdf03 bytes) 2024-09-14T08:42:18.129 INFO:teuthology.orchestra.run.smithi188.stdout:5044 read 0x683be00 thru 0x68477d6 (0xb9d7 bytes) 2024-09-14T08:42:18.161 INFO:teuthology.orchestra.run.smithi188.stdout:5045 trunc from 0xd852400 to 0xe34200 2024-09-14T08:42:18.200 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:18.196+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:18.240 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:18.240 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:18.258 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:18.258 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:18.275 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:18.276 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:18.286 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 141.36185894299999, 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:42:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 141.361804165, 2024-09-14T08:42:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:42:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 127.93403370599999, 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:42:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 104.94142963900001, 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 104.94059126800001, 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:42:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:42:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:42:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:42:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:42:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.922083166999997, 2024-09-14T08:42:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:42:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:42:18.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.921768958000001, 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.316 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:42:18.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:18.320 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.920132631999998, 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:18.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:42:18.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.324 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.919914673000001, 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:42:18.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.919619271000002, 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.329 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:42:18.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:42:18.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.919348436, 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.334 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:42:18.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.708157755000002, 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.339 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:42:18.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:42:18.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:42:18.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:42:18.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:42:18.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:18.343 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.708137721, 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:42:18.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.708116642999997, 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.348 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:18.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:42:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.708097049000003, 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.708076894999998, 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:42:18.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.708057498999999, 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.362 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:42:18.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:42:18.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.701527699000003, 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:42:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.701507812999999, 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.376 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.701488439000002, 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:42:18.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:42:18.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:42:18.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:42:18.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.381 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.381 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.381 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:18.382 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:18.382 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:18.383 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:18.383 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:18.384 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:18.384 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:18.385 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:18.385 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:18.379+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:18.414 INFO:teuthology.orchestra.run.smithi188.stdout:5046 trunc from 0xe34200 to 0x770ba00 2024-09-14T08:42:18.443 INFO:teuthology.orchestra.run.smithi188.stdout:5050 punch from 0x3f1d600 to 0x3f1f800, (0x2200 bytes) 2024-09-14T08:42:18.445 INFO:teuthology.orchestra.run.smithi188.stdout:5052 punch from 0x5901a00 to 0x5903c00, (0x2200 bytes) 2024-09-14T08:42:18.445 INFO:teuthology.orchestra.run.smithi188.stdout:5055 read 0x6a3ae00 thru 0x6a405cc (0x57cd bytes) 2024-09-14T08:42:18.445 INFO:teuthology.orchestra.run.smithi188.stdout:5056 read 0xde8600 thru 0xdf0f98 (0x8999 bytes) 2024-09-14T08:42:18.446 INFO:teuthology.orchestra.run.smithi188.stdout:5058 punch from 0x319fc00 to 0x31abe00, (0xc200 bytes) 2024-09-14T08:42:18.446 INFO:teuthology.orchestra.run.smithi188.stdout:5061 read 0x650ba00 thru 0x65180d0 (0xc6d1 bytes) 2024-09-14T08:42:18.447 INFO:teuthology.orchestra.run.smithi188.stdout:5063 read 0x3855a00 thru 0x3864c82 (0xf283 bytes) 2024-09-14T08:42:18.447 INFO:teuthology.orchestra.run.smithi188.stdout:5064 write 0x58dc400 thru 0x58e6b4f (0xa750 bytes) 2024-09-14T08:42:18.447 INFO:teuthology.orchestra.run.smithi188.stdout:5066 trunc from 0x770ba00 to 0x77d1c00 2024-09-14T08:42:18.483 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:18.479+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:18.493 INFO:teuthology.orchestra.run.smithi188.stdout:5067 punch from 0x98ee00 to 0x991600, (0x2800 bytes) 2024-09-14T08:42:18.495 INFO:teuthology.orchestra.run.smithi188.stdout:5069 read 0x250ae00 thru 0x2515c3e (0xae3f bytes) 2024-09-14T08:42:18.495 INFO:teuthology.orchestra.run.smithi188.stdout:5072 read 0x90ba00 thru 0x916066 (0xa667 bytes) 2024-09-14T08:42:18.499 INFO:teuthology.orchestra.run.smithi188.stdout:5073 punch from 0x4407600 to 0x440e800, (0x7200 bytes) 2024-09-14T08:42:18.499 INFO:teuthology.orchestra.run.smithi188.stdout:5078 read 0x2102a00 thru 0x210b48f (0x8a90 bytes) 2024-09-14T08:42:18.512 INFO:teuthology.orchestra.run.smithi188.stdout:5079 trunc from 0x77d1c00 to 0x1a05e00 2024-09-14T08:42:18.552 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:18.553 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:18.553 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:18.553 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:18.556 INFO:teuthology.orchestra.run.smithi188.stdout:5080 read 0xa26000 thru 0xa3360b (0xd60c bytes) 2024-09-14T08:42:18.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:18.581 INFO:teuthology.orchestra.run.smithi188.stdout:5085 trunc from 0x1a05e00 to 0xb4f3400 2024-09-14T08:42:18.611 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:18.611+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:18.652 INFO:teuthology.orchestra.run.smithi188.stdout:5086 write 0xe653200 thru 0xe662eeb (0xfcec bytes) 2024-09-14T08:42:18.654 INFO:teuthology.orchestra.run.smithi188.stdout:5087 read 0x8f5b600 thru 0x8f66ec1 (0xb8c2 bytes) 2024-09-14T08:42:18.654 INFO:teuthology.orchestra.run.smithi188.stdout:5088 write 0x78cd200 thru 0x78cd26b (0x6c bytes) 2024-09-14T08:42:18.654 INFO:teuthology.orchestra.run.smithi188.stdout:5089 punch from 0x1468800 to 0x1471600, (0x8e00 bytes) 2024-09-14T08:42:18.655 INFO:teuthology.orchestra.run.smithi188.stdout:5090 read 0xd9c5a00 thru 0xd9cc410 (0x6a11 bytes) 2024-09-14T08:42:18.675 INFO:teuthology.orchestra.run.smithi188.stdout:5091 trunc from 0xe663000 to 0x441c200 2024-09-14T08:42:18.685 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:18.684+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:18.717 INFO:teuthology.orchestra.run.smithi188.stdout:5093 punch from 0x3049e00 to 0x3055000, (0xb200 bytes) 2024-09-14T08:42:18.752 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:18.753 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:18.759 INFO:teuthology.orchestra.run.smithi188.stdout:5094 write 0xa5eda00 thru 0xa5f5518 (0x7b19 bytes) 2024-09-14T08:42:18.765 INFO:teuthology.orchestra.run.smithi188.stdout:5097 trunc from 0xa5f5600 to 0x8bfcc00 2024-09-14T08:42:18.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:18.786 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:18.784+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:18.859 INFO:teuthology.orchestra.run.smithi188.stdout:5099 write 0xdf3b400 thru 0xdf45c6f (0xa870 bytes) 2024-09-14T08:42:18.862 INFO:teuthology.orchestra.run.smithi188.stdout:5102 write 0xc2f7400 thru 0xc300c4e (0x984f bytes) 2024-09-14T08:42:18.862 INFO:teuthology.orchestra.run.smithi188.stdout:5103 write 0x9a68c00 thru 0x9a75681 (0xca82 bytes) 2024-09-14T08:42:18.863 INFO:teuthology.orchestra.run.smithi188.stdout:5104 read 0x4532000 thru 0x453c23c (0xa23d bytes) 2024-09-14T08:42:18.864 INFO:teuthology.orchestra.run.smithi188.stdout:5106 read 0x7ed2000 thru 0x7ed5b9c (0x3b9d bytes) 2024-09-14T08:42:18.864 INFO:teuthology.orchestra.run.smithi188.stdout:5107 read 0x9664000 thru 0x9666265 (0x2266 bytes) 2024-09-14T08:42:18.864 INFO:teuthology.orchestra.run.smithi188.stdout:5108 read 0xaf4d800 thru 0xaf53af6 (0x62f7 bytes) 2024-09-14T08:42:18.864 INFO:teuthology.orchestra.run.smithi188.stdout:5110 punch from 0x30c8800 to 0x30ca800, (0x2000 bytes) 2024-09-14T08:42:18.865 INFO:teuthology.orchestra.run.smithi188.stdout:5113 write 0xa5dfa00 thru 0xa5e9077 (0x9678 bytes) 2024-09-14T08:42:18.865 INFO:teuthology.orchestra.run.smithi188.stdout:5114 write 0x5ca9000 thru 0x5cb7e10 (0xee11 bytes) 2024-09-14T08:42:18.865 INFO:teuthology.orchestra.run.smithi188.stdout:5116 read 0xdcec00 thru 0xddb15c (0xc55d bytes) 2024-09-14T08:42:18.871 INFO:teuthology.orchestra.run.smithi188.stdout:5117 trunc from 0xdf45e00 to 0xbcfb600 2024-09-14T08:42:18.887 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:18.884+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:18.909 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:18.909 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:18.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:18.909 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 128.60430174800001, 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:42:18.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:42:18.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:42:18.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 96.342191568999993, 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:42:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:18.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:42:18.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:42:18.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:42:18.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:42:18.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:42:18.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:18.922 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 96.342044397999999, 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:18.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:18.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:42:18.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:42:18.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:18.928 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 96.341902598000004, 2024-09-14T08:42:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:42:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:42:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:42:18.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:42:18.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.778636831, 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:42:18.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:42:18.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.770345540999998, 2024-09-14T08:42:18.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:42:18.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.770322299999997, 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:42:18.944 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:42:18.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.770303036000001, 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:18.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.953 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.770283759999998, 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:42:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:42:18.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:42:18.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:42:18.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.770071307000002, 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:42:18.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:42:18.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.963 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.762858213999998, 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:42:18.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:42:18.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:42:18.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:42:18.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:42:18.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:42:18.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.969 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.969 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:18.969 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.762837001999998, 2024-09-14T08:42:18.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:42:18.969 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.969 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.969 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:42:18.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.973 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.762817652000003, 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:42:18.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:42:18.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:18.978 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.762790613, 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:18.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:42:18.982 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.762771463, 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.983 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:42:18.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.987 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.762749878999998, 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:42:18.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:42:18.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.762730470000001, 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.992 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:42:18.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:18.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.762711594000002, 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.997 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:42:18.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.754680757999999, 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:42:19.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:19.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.754654361999997, 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:19.006 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:42:19.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:19.010 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:19.011 INFO:teuthology.orchestra.run.smithi188.stdout:5120 trunc from 0xbcfb600 to 0xc912c00 2024-09-14T08:42:19.012 INFO:teuthology.orchestra.run.smithi188.stdout:5121 write 0xe36c400 thru 0xe3730d5 (0x6cd6 bytes) 2024-09-14T08:42:19.012 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:19.013 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:19.011+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:19.031 INFO:teuthology.orchestra.run.smithi188.stdout:5122 trunc from 0xe373200 to 0x4d79800 2024-09-14T08:42:19.080 INFO:teuthology.orchestra.run.smithi188.stdout:5123 read 0x149de00 thru 0x14a9828 (0xba29 bytes) 2024-09-14T08:42:19.112 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:19.108+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:19.117 INFO:teuthology.orchestra.run.smithi188.stdout:5128 write 0x64d6200 thru 0x64e374a (0xd54b bytes) 2024-09-14T08:42:19.120 INFO:teuthology.orchestra.run.smithi188.stdout:5129 read 0x5336600 thru 0x533dae1 (0x74e2 bytes) 2024-09-14T08:42:19.120 INFO:teuthology.orchestra.run.smithi188.stdout:5130 write 0x2c1a800 thru 0x2c1c845 (0x2046 bytes) 2024-09-14T08:42:19.120 INFO:teuthology.orchestra.run.smithi188.stdout:5132 punch from 0x409800 to 0x411600, (0x7e00 bytes) 2024-09-14T08:42:19.121 INFO:teuthology.orchestra.run.smithi188.stdout:5133 write 0xc94600 thru 0xc9eadd (0xa4de bytes) 2024-09-14T08:42:19.160 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:19.161 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:19.173 INFO:teuthology.orchestra.run.smithi188.stdout:5134 write 0xb84c000 thru 0xb84e77a (0x277b bytes) 2024-09-14T08:42:19.174 INFO:teuthology.orchestra.run.smithi188.stdout:5135 read 0x51e6000 thru 0x51f0a92 (0xaa93 bytes) 2024-09-14T08:42:19.175 INFO:teuthology.orchestra.run.smithi188.stdout:5138 write 0x58d200 thru 0x58d7b1 (0x5b2 bytes) 2024-09-14T08:42:19.176 INFO:teuthology.orchestra.run.smithi188.stdout:5139 punch from 0xb1cc00 to 0xb26c00, (0xa000 bytes) 2024-09-14T08:42:19.176 INFO:teuthology.orchestra.run.smithi188.stdout:5140 read 0x3267c00 thru 0x32756f7 (0xdaf8 bytes) 2024-09-14T08:42:19.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:19.178 INFO:teuthology.orchestra.run.smithi188.stdout:5141 write 0x4e4ca00 thru 0x4e51844 (0x4e45 bytes) 2024-09-14T08:42:19.183 INFO:teuthology.orchestra.run.smithi188.stdout:5143 trunc from 0xb84e800 to 0xdbbba00 2024-09-14T08:42:19.209 INFO:teuthology.orchestra.run.smithi188.stdout:5144 write 0x43d2800 thru 0x43dcac3 (0xa2c4 bytes) 2024-09-14T08:42:19.209 INFO:teuthology.orchestra.run.smithi188.stdout:5145 read 0x87de000 thru 0x87e9e5a (0xbe5b bytes) 2024-09-14T08:42:19.210 INFO:teuthology.orchestra.run.smithi188.stdout:5148 write 0x3a4fc00 thru 0x3a5cc3a (0xd03b bytes) 2024-09-14T08:42:19.210 INFO:teuthology.orchestra.run.smithi188.stdout:5149 read 0x23c800 thru 0x245bd1 (0x93d2 bytes) 2024-09-14T08:42:19.216 INFO:teuthology.orchestra.run.smithi188.stdout:5150 read 0x331ac00 thru 0x331d735 (0x2b36 bytes) 2024-09-14T08:42:19.216 INFO:teuthology.orchestra.run.smithi188.stdout:5151 punch from 0x5673800 to 0x567ae00, (0x7600 bytes) 2024-09-14T08:42:19.217 INFO:teuthology.orchestra.run.smithi188.stdout:5153 read 0xb0a4600 thru 0xb0a7261 (0x2c62 bytes) 2024-09-14T08:42:19.217 INFO:teuthology.orchestra.run.smithi188.stdout:5155 punch from 0x9c00e00 to 0x9c0d800, (0xca00 bytes) 2024-09-14T08:42:19.217 INFO:teuthology.orchestra.run.smithi188.stdout:5156 read 0x2b2b000 thru 0x2b325d3 (0x75d4 bytes) 2024-09-14T08:42:19.217 INFO:teuthology.orchestra.run.smithi188.stdout:5157 punch from 0x726d400 to 0x7278400, (0xb000 bytes) 2024-09-14T08:42:19.218 INFO:teuthology.orchestra.run.smithi188.stdout:5159 punch from 0x372c000 to 0x3734200, (0x8200 bytes) 2024-09-14T08:42:19.221 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:19.220+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:19.238 INFO:teuthology.orchestra.run.smithi188.stdout:5163 trunc from 0xdbbba00 to 0x2523600 2024-09-14T08:42:19.288 INFO:teuthology.orchestra.run.smithi188.stdout:5164 trunc from 0x2523600 to 0x1d2a000 2024-09-14T08:42:19.314 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:19.311+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:19.322 INFO:teuthology.orchestra.run.smithi188.stdout:5166 write 0x1663000 thru 0x166a860 (0x7861 bytes) 2024-09-14T08:42:19.323 INFO:teuthology.orchestra.run.smithi188.stdout:5167 punch from 0xe85200 to 0xe8f000, (0x9e00 bytes) 2024-09-14T08:42:19.324 INFO:teuthology.orchestra.run.smithi188.stdout:5168 read 0x46f600 thru 0x47ac2f (0xb630 bytes) 2024-09-14T08:42:19.353 INFO:teuthology.orchestra.run.smithi188.stdout:5171 trunc from 0x1d2a000 to 0xe588600 2024-09-14T08:42:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:19.366 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:19.366 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:19.366 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:19.380 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:19.425 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:19.424+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:19.506 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:19.506 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25875220699999, 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.258690194, 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.512 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:19.516 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25862386399999, 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:42:19.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25856840399999, 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.522 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.522 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.522 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.522 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.522 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:42:19.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.522 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:42:19.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.526 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25850878400001, 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:19.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:19.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:42:19.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25842724399999, 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:42:19.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:42:19.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.536 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:19.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25837091599999, 2024-09-14T08:42:19.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:42:19.537 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.537 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.537 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.538 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:42:19.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.538 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:19.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:42:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.258299421, 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:42:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:42:19.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25822654999999, 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:42:19.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25818433800001, 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:42:19.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:42:19.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25815450799999, 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:42:19.556 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:42:19.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.560 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25812621099999, 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25808511599999, 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:42:19.565 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:42:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:42:19.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25805608600001, 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:19.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.574 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.258027602, 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:42:19.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25799946199999, 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.579 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:42:19.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:42:19.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.257970766, 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:42:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:42:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.257942009, 2024-09-14T08:42:19.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:42:19.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:42:19.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.257913962, 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:42:19.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:42:19.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.25788398500001, 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:19.597 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:19.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:42:19.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:19.601 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:19.602 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:19.603 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:19.603 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:19.603+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:19.704 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:19.700+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:19.771 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:19.772 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:19.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:19.805 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:19.803+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:19.905 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:19.904+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:19.948 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:19.948 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:19.948 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:19.948 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:19.949 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:19.963 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:19.993 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5, 0] out_osds: [3] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:42:19.993 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:42:19.993 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-14T08:42:19.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-14T08:42:19.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:42:20.043 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:20.043+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:20.108 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:20.104+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:20.131 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.39800650700001, 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:42:20.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:42:20.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:42:20.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.862252682000005, 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:20.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:20.140 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:42:20.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.140 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:20.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:42:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:42:20.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:42:20.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.827587797999996, 2024-09-14T08:42:20.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:42:20.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.827386826999998, 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:20.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:42:20.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:42:20.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.926711437999998, 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:42:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.926677222999999, 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:42:20.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:20.162 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.926635734000001, 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:42:20.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:42:20.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.166 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.926577252000001, 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:42:20.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:42:20.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.926547573000001, 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:42:20.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.926518364000003, 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.175 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:20.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:20.179 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.918912069000001, 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.183 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.918884079000001, 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.184 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:42:20.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.918855747000002, 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.188 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:42:20.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.192 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.918813987999997, 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.193 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:42:20.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:42:20.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:20.197 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.918785108999998, 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:42:20.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.918751299999997, 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:42:20.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:42:20.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.918718941000002, 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:42:20.206 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:42:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.910591138000001, 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:42:20.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.910560152999999, 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.215 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.910531247000002, 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.220 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:42:20.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:42:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:42:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.224 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.224 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:20.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:20.226 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:20.223+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:20.326 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:20.324+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:20.375 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-14T08:42:20.375+0000 7f7148add640 -1 mon.a@0(leader).osd e142 definitely_dead 0 2024-09-14T08:42:20.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:20.417 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:20.417 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:20.418 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:20.418 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:20.431 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:20.431+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:20.433 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:20.527 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:20.528 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:20.528 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:20.527+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:20.544 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:20.544 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:20.562 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:20.563 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:20.606 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:20.606 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:20.606 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:20.606 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:20.606 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:20.619 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:20.629 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:20.627+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:20.730 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:20.728+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:20.745 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 139.66576014899999, 2024-09-14T08:42:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:42:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 139.66570294499999, 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:42:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 139.66564406099999, 2024-09-14T08:42:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:42:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 139.665579135, 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:20.759 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:42:20.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 139.66551768400001, 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:42:20.763 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:42:20.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:42:20.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.767 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 139.66545815000001, 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:20.768 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:20.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:42:20.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 139.66539883999999, 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.776 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 139.665326808, 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:20.777 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:20.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.781 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 115.51062643100001, 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:42:20.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:42:20.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:42:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:42:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:42:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:42:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 115.510595006, 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:42:20.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.146731385999999, 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.791 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:42:20.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.796 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.146672035999998, 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:42:20.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:42:20.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:42:20.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.146632084000004, 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:42:20.803 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:42:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:42:20.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.663209131000002, 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:42:20.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.656816565, 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:42:20.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:42:20.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:42:20.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:42:20.823 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.897227145000002, 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.824 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:20.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:42:20.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:42:20.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.856487743000002, 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.831 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:42:20.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:20.838 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.588916658999999, 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:42:20.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:42:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:42:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:42:20.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:42:20.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:20.846 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.525112765000003, 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:20.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:42:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:42:20.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.497641067000004, 2024-09-14T08:42:20.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:42:20.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:42:20.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:42:20.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:42:20.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:42:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:20.860 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:20.860 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:20.861 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:20.862 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:20.862 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:20.862 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:20.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:20.863 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:20.863 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:20.864 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:20.859+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:20.963 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:20.960+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:21.010 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:21.010 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:21.027 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:21.063 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:21.064+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:21.155 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:21.155 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:21.164 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:21.163+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:21.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:21.265 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:21.263+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:21.347 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:21.347 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:21.360 INFO:teuthology.orchestra.run.smithi089.stderr:marked in osd.3. 2024-09-14T08:42:21.360 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:42:21.366 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:21.373 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:21.363+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:21.406 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-14T08:42:21.468 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:21.464+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:21.511 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:21.511 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:21.526 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:21.568 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:21.564+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:21.657 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:21.657 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:21.669 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:21.667+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:21.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:21.770 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:21.768+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:21.848 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:21.848 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:21.862 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:21.871 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:21.872+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:21.972 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:21.968+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:21.984 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:21.984 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:21.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:22.073 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:22.071+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:22.119 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:22.119 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:22.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:22.175 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:22.175+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:22.274 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:22.272+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:22.294 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:22.294 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:22.310 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:22.379 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:22.375+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:22.450 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:22.451 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:22.464 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:22.476 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:22.475+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:22.577 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:22.576+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:22.587 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:22.587 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:22.601 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:22.689 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:22.688+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:22.771 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:22.772 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:22.779 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:22.776+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:22.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:22.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:22.880 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:22.879+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:22.949 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:22.949 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:22.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:23.009 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:23.008+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:23.029 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:23.030 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:23.046 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:23.047 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:23.064 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:23.064 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:23.082 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:23.079+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:23.084 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:23.084 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:23.087 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:23.087 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:23.102 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:23.105 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:23.105 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:23.124 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:23.125 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:23.189 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:23.188+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:23.271 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:23.271 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 127.537883988, 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.272 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:42:23.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:42:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.002130163000004, 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:23.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:42:23.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:42:23.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:42:23.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.967465278999995, 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:42:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.967264307999997, 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:42:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.066588918999997, 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.295 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:42:23.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.066554703999998, 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:42:23.299 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:42:23.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:23.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:42:23.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.066513215000001, 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:42:23.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.308 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.066454733, 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:23.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:23.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:42:23.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.066425054, 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:42:23.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:42:23.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.066395845000002, 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:23.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:42:23.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:42:23.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.322 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.05878955, 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.323 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:42:23.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:42:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.058761560000001, 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:42:23.327 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:42:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.058733228000001, 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.332 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.336 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.058691469000003, 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:42:23.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:23.341 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.058662589999997, 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:23.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:42:23.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:42:23.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:42:23.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:42:23.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.058628781000003, 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:42:23.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.350 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.058596422000001, 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:42:23.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.050468619, 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:42:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:23.360 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.050437633999998, 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:42:23.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.050408728000001, 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:42:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:42:23.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.370 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.370 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.370 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:23.371 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:23.375 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:23.371+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:23.402 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:42:23.471 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:23.468+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:23.506 INFO:teuthology.orchestra.run.smithi188.stdout:5172 trunc from 0xe588600 to 0x5d68600 2024-09-14T08:42:23.530 INFO:teuthology.orchestra.run.smithi188.stdout:5176 punch from 0x2898800 to 0x289a800, (0x2000 bytes) 2024-09-14T08:42:23.532 INFO:teuthology.orchestra.run.smithi188.stdout:5178 read 0x1771600 thru 0x177928f (0x7c90 bytes) 2024-09-14T08:42:23.532 INFO:teuthology.orchestra.run.smithi188.stdout:5179 read 0x21b7400 thru 0x21baae5 (0x36e6 bytes) 2024-09-14T08:42:23.532 INFO:teuthology.orchestra.run.smithi188.stdout:5181 write 0xd96e00 thru 0xd9d9a0 (0x6ba1 bytes) 2024-09-14T08:42:23.533 INFO:teuthology.orchestra.run.smithi188.stdout:5183 read 0x1efb400 thru 0x1f05bf6 (0xa7f7 bytes) 2024-09-14T08:42:23.533 INFO:teuthology.orchestra.run.smithi188.stdout:5188 read 0x13dc000 thru 0x13de8f3 (0x28f4 bytes) 2024-09-14T08:42:23.533 INFO:teuthology.orchestra.run.smithi188.stdout:5193 punch from 0xe7dc00 to 0xe89800, (0xbc00 bytes) 2024-09-14T08:42:23.534 INFO:teuthology.orchestra.run.smithi188.stdout:5195 read 0x443a200 thru 0x44413b1 (0x71b2 bytes) 2024-09-14T08:42:23.534 INFO:teuthology.orchestra.run.smithi188.stdout:5199 punch from 0x3e45000 to 0x3e4de00, (0x8e00 bytes) 2024-09-14T08:42:23.560 INFO:teuthology.orchestra.run.smithi188.stdout:5202 write 0x84f6000 thru 0x84f6a72 (0xa73 bytes) 2024-09-14T08:42:23.562 INFO:teuthology.orchestra.run.smithi188.stdout:5203 read 0x29df600 thru 0x29e5bc4 (0x65c5 bytes) 2024-09-14T08:42:23.562 INFO:teuthology.orchestra.run.smithi188.stdout:5204 punch from 0x5cbe600 to 0x5cbfa00, (0x1400 bytes) 2024-09-14T08:42:23.562 INFO:teuthology.orchestra.run.smithi188.stdout:5205 read 0x3391a00 thru 0x33945a9 (0x2baa bytes) 2024-09-14T08:42:23.563 INFO:teuthology.orchestra.run.smithi188.stdout:5207 read 0x1d0a600 thru 0x1d1755d (0xcf5e bytes) 2024-09-14T08:42:23.563 INFO:teuthology.orchestra.run.smithi188.stdout:5209 punch from 0x5782600 to 0x5790a00, (0xe400 bytes) 2024-09-14T08:42:23.563 INFO:teuthology.orchestra.run.smithi188.stdout:5211 write 0x7eabc00 thru 0x7eaf5c4 (0x39c5 bytes) 2024-09-14T08:42:23.563 INFO:teuthology.orchestra.run.smithi188.stdout:5213 trunc from 0x84f6c00 to 0x87cb000 2024-09-14T08:42:23.570 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:23.570 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:23.570 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:23.570 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:23.572 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:23.571+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:23.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:23.589 INFO:teuthology.orchestra.run.smithi188.stdout:5214 punch from 0x4d08400 to 0x4d10e00, (0x8a00 bytes) 2024-09-14T08:42:23.592 INFO:teuthology.orchestra.run.smithi188.stdout:5216 write 0x7e46400 thru 0x7e4f8b6 (0x94b7 bytes) 2024-09-14T08:42:23.599 INFO:teuthology.orchestra.run.smithi188.stdout:5217 trunc from 0x87cb000 to 0x5b9aa00 2024-09-14T08:42:23.628 INFO:teuthology.orchestra.run.smithi188.stdout:5220 read 0x5a1ea00 thru 0x5a26734 (0x7d35 bytes) 2024-09-14T08:42:23.629 INFO:teuthology.orchestra.run.smithi188.stdout:5223 punch from 0x441de00 to 0x4422000, (0x4200 bytes) 2024-09-14T08:42:23.630 INFO:teuthology.orchestra.run.smithi188.stdout:5224 punch from 0x41e2e00 to 0x41e8e00, (0x6000 bytes) 2024-09-14T08:42:23.630 INFO:teuthology.orchestra.run.smithi188.stdout:5225 read 0x13e8c00 thru 0x13f0464 (0x7865 bytes) 2024-09-14T08:42:23.631 INFO:teuthology.orchestra.run.smithi188.stdout:5226 write 0x7d5800 thru 0x7e5478 (0xfc79 bytes) 2024-09-14T08:42:23.631 INFO:teuthology.orchestra.run.smithi188.stdout:5227 read 0x5718c00 thru 0x572869a (0xfa9b bytes) 2024-09-14T08:42:23.631 INFO:teuthology.orchestra.run.smithi188.stdout:5228 read 0x4bf2e00 thru 0x4bfdfa5 (0xb1a6 bytes) 2024-09-14T08:42:23.632 INFO:teuthology.orchestra.run.smithi188.stdout:5230 read 0x14baa00 thru 0x14c3b65 (0x9166 bytes) 2024-09-14T08:42:23.653 INFO:teuthology.orchestra.run.smithi188.stdout:5231 trunc from 0x5b9aa00 to 0xdcf1c00 2024-09-14T08:42:23.673 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:23.672+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:23.678 INFO:teuthology.orchestra.run.smithi188.stdout:5235 write 0xaee9400 thru 0xaef7d70 (0xe971 bytes) 2024-09-14T08:42:23.690 INFO:teuthology.orchestra.run.smithi188.stdout:5236 trunc from 0xdcf1c00 to 0x9286400 2024-09-14T08:42:23.725 INFO:teuthology.orchestra.run.smithi188.stdout:5237 read 0x4a6e400 thru 0x4a780cc (0x9ccd bytes) 2024-09-14T08:42:23.727 INFO:teuthology.orchestra.run.smithi188.stdout:5238 write 0x8df6800 thru 0x8df9897 (0x3098 bytes) 2024-09-14T08:42:23.727 INFO:teuthology.orchestra.run.smithi188.stdout:5241 punch from 0x4708c00 to 0x4717200, (0xe600 bytes) 2024-09-14T08:42:23.728 INFO:teuthology.orchestra.run.smithi188.stdout:5243 read 0x4d48c00 thru 0x4d560f5 (0xd4f6 bytes) 2024-09-14T08:42:23.729 INFO:teuthology.orchestra.run.smithi188.stdout:5247 read 0x3578400 thru 0x3584fa2 (0xcba3 bytes) 2024-09-14T08:42:23.730 INFO:teuthology.orchestra.run.smithi188.stdout:5248 read 0x3662000 thru 0x3669282 (0x7283 bytes) 2024-09-14T08:42:23.730 INFO:teuthology.orchestra.run.smithi188.stdout:5249 read 0x33e1600 thru 0x33ea707 (0x9108 bytes) 2024-09-14T08:42:23.730 INFO:teuthology.orchestra.run.smithi188.stdout:5251 read 0x7d8fc00 thru 0x7d97273 (0x7674 bytes) 2024-09-14T08:42:23.735 INFO:teuthology.orchestra.run.smithi188.stdout:5252 trunc from 0x9286400 to 0xb6d2800 2024-09-14T08:42:23.751 INFO:teuthology.orchestra.run.smithi188.stdout:5253 read 0x55de00 thru 0x5607df (0x29e0 bytes) 2024-09-14T08:42:23.752 INFO:teuthology.orchestra.run.smithi188.stdout:5254 read 0xabd2600 thru 0xabe234a (0xfd4b bytes) 2024-09-14T08:42:23.752 INFO:teuthology.orchestra.run.smithi188.stdout:5256 read 0x42f0c00 thru 0x42fa945 (0x9d46 bytes) 2024-09-14T08:42:23.753 INFO:teuthology.orchestra.run.smithi188.stdout:5258 read 0x769de00 thru 0x76a3926 (0x5b27 bytes) 2024-09-14T08:42:23.769 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:23.769 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:23.770 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:23.770 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:23.770 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:23.773 INFO:teuthology.orchestra.run.smithi188.stdout:5261 trunc from 0xb6d2800 to 0x425dc00 2024-09-14T08:42:23.773 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:23.771+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:23.787 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:23.800 INFO:teuthology.orchestra.run.smithi188.stdout:5262 read 0x4dd600 thru 0x4e2448 (0x4e49 bytes) 2024-09-14T08:42:23.804 INFO:teuthology.orchestra.run.smithi188.stdout:5265 read 0xc63800 thru 0xc6e1b2 (0xa9b3 bytes) 2024-09-14T08:42:23.806 INFO:teuthology.orchestra.run.smithi188.stdout:5266 punch from 0x2609800 to 0x260fa00, (0x6200 bytes) 2024-09-14T08:42:23.807 INFO:teuthology.orchestra.run.smithi188.stdout:5267 read 0x39aa600 thru 0x39ab68b (0x108c bytes) 2024-09-14T08:42:23.840 INFO:teuthology.orchestra.run.smithi188.stdout:5270 write 0x9f7f800 thru 0x9f8f708 (0xff09 bytes) 2024-09-14T08:42:23.842 INFO:teuthology.orchestra.run.smithi188.stdout:5271 punch from 0x1da3e00 to 0x1db3c00, (0xfe00 bytes) 2024-09-14T08:42:23.848 INFO:teuthology.orchestra.run.smithi188.stdout:5273 trunc from 0x9f8f800 to 0xcd8c200 2024-09-14T08:42:23.870 INFO:teuthology.orchestra.run.smithi188.stdout:5275 write 0x15a9a00 thru 0x15b995c (0xff5d bytes) 2024-09-14T08:42:23.873 INFO:teuthology.orchestra.run.smithi188.stdout:5276 write 0x62e600 thru 0x639d2b (0xb72c bytes) 2024-09-14T08:42:23.874 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:23.871+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:23.876 INFO:teuthology.orchestra.run.smithi188.stdout:5277 write 0x5fa4e00 thru 0x5fab477 (0x6678 bytes) 2024-09-14T08:42:23.876 INFO:teuthology.orchestra.run.smithi188.stdout:5280 read 0xb776e00 thru 0xb7783a8 (0x15a9 bytes) 2024-09-14T08:42:23.876 INFO:teuthology.orchestra.run.smithi188.stdout:5283 write 0xc6e4800 thru 0xc6eb838 (0x7039 bytes) 2024-09-14T08:42:23.876 INFO:teuthology.orchestra.run.smithi188.stdout:5284 punch from 0xc17ae00 to 0xc181c00, (0x6e00 bytes) 2024-09-14T08:42:23.877 INFO:teuthology.orchestra.run.smithi188.stdout:5285 punch from 0x3bf6800 to 0x3bfca00, (0x6200 bytes) 2024-09-14T08:42:23.891 INFO:teuthology.orchestra.run.smithi188.stdout:5286 trunc from 0xcd8c200 to 0x53b4400 2024-09-14T08:42:23.924 INFO:teuthology.orchestra.run.smithi188.stdout:5287 punch from 0x115d600 to 0x1166000, (0x8a00 bytes) 2024-09-14T08:42:23.930 INFO:teuthology.orchestra.run.smithi188.stdout:5289 trunc from 0x53b4400 to 0x3b5d600 2024-09-14T08:42:23.974 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:23.972+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:23.977 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.977 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.89930962400001, 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:42:23.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:42:23.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:23.982 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.89925242000001, 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:42:23.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.89919353600001, 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.987 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:42:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:42:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:42:23.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:23.993 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.89912860999999, 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:42:23.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.899067159, 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:23.998 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:23.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:42:24.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.899007625, 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:42:24.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:24.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.007 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.89894831500001, 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:42:24.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.89887628299999, 2024-09-14T08:42:24.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:42:24.016 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.744175906, 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:24.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 118.74414448100001, 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:42:24.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:24.026 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.380280861000003, 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:42:24.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:42:24.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.380221511000002, 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.032 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:42:24.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:42:24.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.380181558999993, 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.039 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:42:24.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:42:24.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.045 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.896758605999999, 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:42:24.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:42:24.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:42:24.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.052 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.890366040000004, 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:42:24.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:42:24.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:42:24.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.130776619999999, 2024-09-14T08:42:24.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:42:24.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:42:24.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.090037217999999, 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:42:24.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:42:24.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.822466134000003, 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:42:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:42:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.75866224, 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:42:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:42:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:42:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.731190542, 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:42:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:42:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:42:24.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:24.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:24.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:24.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:42:24.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:42:24.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.093 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:24.093 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:24.093 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:24.095 INFO:teuthology.orchestra.run.smithi188.stdout:5290 write 0xd9efa00 thru 0xd9f3e54 (0x4455 bytes) 2024-09-14T08:42:24.095 INFO:teuthology.orchestra.run.smithi188.stdout:5291 write 0x8ac4e00 thru 0x8ad07c2 (0xb9c3 bytes) 2024-09-14T08:42:24.095 INFO:teuthology.orchestra.run.smithi188.stdout:5296 trunc from 0xd9f4000 to 0xbbf1400 2024-09-14T08:42:24.095 INFO:teuthology.orchestra.run.smithi188.stdout:5297 trunc from 0xbbf1400 to 0xe042c00 2024-09-14T08:42:24.095 INFO:teuthology.orchestra.run.smithi188.stdout:5300 read 0xcac6800 thru 0xcac9e9d (0x369e bytes) 2024-09-14T08:42:24.096 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:24.096 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:24.092+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:24.101 INFO:teuthology.orchestra.run.smithi188.stdout:5301 trunc from 0xe042c00 to 0x5641a00 2024-09-14T08:42:24.137 INFO:teuthology.orchestra.run.smithi188.stdout:5302 punch from 0x3590400 to 0x3593e00, (0x3a00 bytes) 2024-09-14T08:42:24.138 INFO:teuthology.orchestra.run.smithi188.stdout:5303 read 0x35e8800 thru 0x35f6128 (0xd929 bytes) 2024-09-14T08:42:24.139 INFO:teuthology.orchestra.run.smithi188.stdout:5305 read 0x1330e00 thru 0x1340894 (0xfa95 bytes) 2024-09-14T08:42:24.140 INFO:teuthology.orchestra.run.smithi188.stdout:5309 read 0x453a400 thru 0x4545e39 (0xba3a bytes) 2024-09-14T08:42:24.140 INFO:teuthology.orchestra.run.smithi188.stdout:5310 write 0x5175000 thru 0x5184f2a (0xff2b bytes) 2024-09-14T08:42:24.150 INFO:teuthology.orchestra.run.smithi188.stdout:5311 trunc from 0x5641a00 to 0x15d5600 2024-09-14T08:42:24.195 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:24.192+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:24.229 INFO:teuthology.orchestra.run.smithi188.stdout:5312 write 0x5d22000 thru 0x5d31d51 (0xfd52 bytes) 2024-09-14T08:42:24.232 INFO:teuthology.orchestra.run.smithi188.stdout:5315 punch from 0x454ea00 to 0x4555000, (0x6600 bytes) 2024-09-14T08:42:24.233 INFO:teuthology.orchestra.run.smithi188.stdout:5317 write 0x450aa00 thru 0x451943d (0xea3e bytes) 2024-09-14T08:42:24.233 INFO:teuthology.orchestra.run.smithi188.stdout:5319 read 0x5483a00 thru 0x5491132 (0xd733 bytes) 2024-09-14T08:42:24.233 INFO:teuthology.orchestra.run.smithi188.stdout:5320 read 0x13ca400 thru 0x13cc089 (0x1c8a bytes) 2024-09-14T08:42:24.234 INFO:teuthology.orchestra.run.smithi188.stdout:5321 read 0x935000 thru 0x93bd1f (0x6d20 bytes) 2024-09-14T08:42:24.236 INFO:teuthology.orchestra.run.smithi188.stdout:5323 read 0x3828800 thru 0x3832795 (0x9f96 bytes) 2024-09-14T08:42:24.236 INFO:teuthology.orchestra.run.smithi188.stdout:5326 read 0xf15e00 thru 0xf163bd (0x5be bytes) 2024-09-14T08:42:24.237 INFO:teuthology.orchestra.run.smithi188.stdout:truncating to largest ever: 0xee32800 2024-09-14T08:42:24.246 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:24.246 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:24.246 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:24.246 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:24.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:24.262 INFO:teuthology.orchestra.run.smithi188.stdout:5329 trunc from 0x5d31e00 to 0xee32800 2024-09-14T08:42:24.284 INFO:teuthology.orchestra.run.smithi188.stdout:5331 punch from 0x9b48c00 to 0x9b55600, (0xca00 bytes) 2024-09-14T08:42:24.286 INFO:teuthology.orchestra.run.smithi188.stdout:5333 read 0x29b8a00 thru 0x29be6c1 (0x5cc2 bytes) 2024-09-14T08:42:24.287 INFO:teuthology.orchestra.run.smithi188.stdout:5335 write 0x730e600 thru 0x731b396 (0xcd97 bytes) 2024-09-14T08:42:24.287 INFO:teuthology.orchestra.run.smithi188.stdout:skipping zero length punch hole 2024-09-14T08:42:24.287 INFO:teuthology.orchestra.run.smithi188.stdout:5338 read 0xed3a00 thru 0xee0525 (0xcb26 bytes) 2024-09-14T08:42:24.297 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:24.292+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:24.320 INFO:teuthology.orchestra.run.smithi188.stdout:5339 trunc from 0xee32800 to 0x2ef7000 2024-09-14T08:42:24.376 INFO:teuthology.orchestra.run.smithi188.stdout:5340 trunc from 0x2ef7000 to 0x7566800 2024-09-14T08:42:24.400 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:24.395+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:24.403 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:42:24.404 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:24.404 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:24.404 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:24.404 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:24.404 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:24.407 INFO:teuthology.orchestra.run.smithi188.stdout:5341 read 0x553f800 thru 0x554a456 (0xac57 bytes) 2024-09-14T08:42:24.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:24.440 INFO:teuthology.orchestra.run.smithi188.stdout:5344 write 0xc945a00 thru 0xc94d6cf (0x7cd0 bytes) 2024-09-14T08:42:24.443 INFO:teuthology.orchestra.run.smithi188.stdout:5345 read 0x33dfe00 thru 0x33ede96 (0xe097 bytes) 2024-09-14T08:42:24.444 INFO:teuthology.orchestra.run.smithi188.stdout:5346 write 0x6f4ae00 thru 0x6f54b2b (0x9d2c bytes) 2024-09-14T08:42:24.444 INFO:teuthology.orchestra.run.smithi188.stdout:5347 write 0x84c4200 thru 0x84c912d (0x4f2e bytes) 2024-09-14T08:42:24.444 INFO:teuthology.orchestra.run.smithi188.stdout:5349 read 0xb1bbe00 thru 0xb1c9aa1 (0xdca2 bytes) 2024-09-14T08:42:24.444 INFO:teuthology.orchestra.run.smithi188.stdout:5350 read 0x6ba00 thru 0x73cb0 (0x82b1 bytes) 2024-09-14T08:42:24.445 INFO:teuthology.orchestra.run.smithi188.stdout:5351 write 0x7031a00 thru 0x703dd16 (0xc317 bytes) 2024-09-14T08:42:24.446 INFO:teuthology.orchestra.run.smithi188.stdout:5353 write 0x94ee200 thru 0x94fbc41 (0xda42 bytes) 2024-09-14T08:42:24.446 INFO:teuthology.orchestra.run.smithi188.stdout:5355 write 0x7815400 thru 0x7820fd6 (0xbbd7 bytes) 2024-09-14T08:42:24.446 INFO:teuthology.orchestra.run.smithi188.stdout:5356 punch from 0x21c3800 to 0x21cb000, (0x7800 bytes) 2024-09-14T08:42:24.447 INFO:teuthology.orchestra.run.smithi188.stdout:5357 write 0x3c0ba00 thru 0x3c16c1c (0xb21d bytes) 2024-09-14T08:42:24.447 INFO:teuthology.orchestra.run.smithi188.stdout:5358 read 0x17b3600 thru 0x17c269c (0xf09d bytes) 2024-09-14T08:42:24.448 INFO:teuthology.orchestra.run.smithi188.stdout:5359 write 0x600de00 thru 0x600edb8 (0xfb9 bytes) 2024-09-14T08:42:24.448 INFO:teuthology.orchestra.run.smithi188.stdout:5361 read 0x7777e00 thru 0x778723d (0xf43e bytes) 2024-09-14T08:42:24.448 INFO:teuthology.orchestra.run.smithi188.stdout:5362 write 0x242ac00 thru 0x2432cbc (0x80bd bytes) 2024-09-14T08:42:24.449 INFO:teuthology.orchestra.run.smithi188.stdout:5363 write 0xad54c00 thru 0xad612ab (0xc6ac bytes) 2024-09-14T08:42:24.449 INFO:teuthology.orchestra.run.smithi188.stdout:5364 read 0xa91be00 thru 0xa920350 (0x4551 bytes) 2024-09-14T08:42:24.449 INFO:teuthology.orchestra.run.smithi188.stdout:5366 punch from 0x28ec400 to 0x28f5c00, (0x9800 bytes) 2024-09-14T08:42:24.468 INFO:teuthology.orchestra.run.smithi188.stdout:5368 trunc from 0xc94d800 to 0x16f9600 2024-09-14T08:42:24.499 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:24.496+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout:5372 write 0x2200a00 thru 0x22073a5 (0x69a6 bytes) 2024-09-14T08:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout:5374 write 0x9594800 thru 0x959fa1c (0xb21d bytes) 2024-09-14T08:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout:5375 read 0x8e80800 thru 0x8e8ae7c (0xa67d bytes) 2024-09-14T08:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout:5376 punch from 0x6466800 to 0x6470000, (0x9800 bytes) 2024-09-14T08:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout:5377 write 0x8f3ca00 thru 0x8f4a65a (0xdc5b bytes) 2024-09-14T08:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout:5378 read 0x5e4d400 thru 0x5e5abba (0xd7bb bytes) 2024-09-14T08:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout:5381 read 0x8599000 thru 0x85a6d9d (0xdd9e bytes) 2024-09-14T08:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout:5384 punch from 0x7af200 to 0x7b4600, (0x5400 bytes) 2024-09-14T08:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout:5389 write 0xcb9600 thru 0xcc1435 (0x7e36 bytes) 2024-09-14T08:42:24.600 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:24.599+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:24.616 INFO:teuthology.orchestra.run.smithi188.stdout:5392 write 0xec89a00 thru 0xec8ff61 (0x6562 bytes) 2024-09-14T08:42:24.618 INFO:teuthology.orchestra.run.smithi188.stdout:5393 read 0x6328800 thru 0x6335987 (0xd188 bytes) 2024-09-14T08:42:24.618 INFO:teuthology.orchestra.run.smithi188.stdout:5395 read 0xd1fa600 thru 0xd20157c (0x6f7d bytes) 2024-09-14T08:42:24.618 INFO:teuthology.orchestra.run.smithi188.stdout:5398 punch from 0xc33ba00 to 0xc344200, (0x8800 bytes) 2024-09-14T08:42:24.619 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:24.619 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:24.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:24.619 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.6604200300000009, 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:42:24.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:42:24.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:42:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.624 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.6592229439999997, 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:42:24.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.6591602519999995, 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.630 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:42:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.6591225049999991, 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:42:24.635 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:42:24.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:42:24.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.6590254420000008, 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:42:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.642 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:24.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:24.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:42:24.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:42:24.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:42:24.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:42:24.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:42:24.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:42:24.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:42:24.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:42:24.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.6589445949999995, 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:42:24.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:42:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.6069.0:4584 3.c e140/137 3:37690830:::rbd_data.10f18f8e41e.0000000000000002:head v 140'800, mlcod=0'0)", 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:18.373466+0000", 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 6.24644479, 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057865, 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.373466+0000", 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.373466+0000", 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.373467+0000", 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.373472+0000", 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6489999999999996e-06 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.373481+0000", 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1849999999999993e-06 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.373489+0000", 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8169999999999999e-06 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.373579+0000", 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9460000000000001e-05 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.373604+0000", 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5797999999999999e-05 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.379216+0000", 2024-09-14T08:42:24.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005611998 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.379252+0000", 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5981e-05 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "pg_update_log_missing(3.15 epoch 140/137 rep_tid 5158 entries 140'873 (0'0) error 3:aea5419d:::rbd_header.10f18f8e41e:head by client.6069.0:5108 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:18.785285+0000", 2024-09-14T08:42:24.656 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.8346257670000004, 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0061932319999999999, 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785285+0000", 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785285+0000", 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785286+0000", 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6599999999999996e-07 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785294+0000", 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3720000000000005e-06 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785316+0000", 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2106000000000001e-05 2024-09-14T08:42:24.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785331+0000", 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4686e-05 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785403+0000", 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2249000000000006e-05 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.791478+0000", 2024-09-14T08:42:24.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0060751529999999998 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5463 3.12 3:4e37f627:::rbd_data.10f18f8e41e.0000000000000029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.052009+0000", 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.5679014110000002, 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0080280200000000003, 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5463 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052009+0000", 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052009+0000", 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052012+0000", 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0120000000000001e-06 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052024+0000", 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1231e-05 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052049+0000", 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5761999999999998e-05 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052063+0000", 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3733e-05 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052183+0000", 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011953800000000001 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052367+0000", 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018422499999999999 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052594+0000", 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022711000000000001 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.056815+0000", 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0042212680000000002 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.059841+0000", 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003026043 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.059972+0000", 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013100199999999999 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.060037+0000", 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5096000000000002e-05 2024-09-14T08:42:24.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.666 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.666 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5549 3.12 3:49868067:::rbd_data.10f18f8e41e.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2205696~8704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T08:42:24.666 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.127550+0000", 2024-09-14T08:42:24.666 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4923608369999997, 2024-09-14T08:42:24.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005755497, 2024-09-14T08:42:24.666 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.666 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5549 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.127550+0000", 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.127550+0000", 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.127552+0000", 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.221e-06 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.127574+0000", 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1778000000000001e-05 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.127593+0000", 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8895000000000001e-05 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.127607+0000", 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4559000000000001e-05 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.127783+0000", 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017605999999999999 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.127942+0000", 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015857999999999999 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.128366+0000", 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00042419799999999998 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.130756+0000", 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023901859999999999 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.133081+0000", 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023249619999999999 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.133214+0000", 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013242700000000001 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.133305+0000", 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1631000000000004e-05 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.671 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "MOSDPGPush(3.15 140/137 [PushOp(3:aeedb83a:::rbd_data.10f1952d058d.0000000000000002:head, version: 86'108, data_included: [0~425984,491520~106496,630784~94208,770048~69632,909312~36864], data_size: 733184, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:aeedb83a:::rbd_data.10f1952d058d.0000000000000002:head@86'108, size: 946176, copy_subset: [(0, 946176)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 946176, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.211512+0000", 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4083984889999996, 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0053580950000000002, 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.211512+0000", 2024-09-14T08:42:24.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.211512+0000", 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.211514+0000", 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7230000000000001e-06 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.212207+0000", 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00069347600000000005 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.212257+0000", 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9892000000000003e-05 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.212292+0000", 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4959000000000002e-05 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.212489+0000", 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000196283 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.212532+0000", 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3201999999999997e-05 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.216870+0000", 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00433856 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.675 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5733 3.12 3:49868067:::rbd_data.10f18f8e41e.000000000000000a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.253718+0000", 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3661928210000003, 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078145260000000005, 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.676 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5733 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253718+0000", 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253718+0000", 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253720+0000", 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2929999999999999e-06 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253728+0000", 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7950000000000008e-06 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253747+0000", 2024-09-14T08:42:24.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8493000000000001e-05 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253755+0000", 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2640000000000008e-06 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253903+0000", 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000147715 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.254103+0000", 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020008800000000001 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.254385+0000", 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00028287400000000002 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.258587+0000", 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0042015339999999998 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261327+0000", 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00274033 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261440+0000", 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011230600000000001 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261532+0000", 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2833999999999999e-05 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5734 3.12 3:4b5ed939:::rbd_data.10f18f8e41e.000000000000000c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.253785+0000", 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3661253349999996, 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078991800000000004, 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5734 2024-09-14T08:42:24.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253785+0000", 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253785+0000", 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253786+0000", 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3099999999999997e-07 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253790+0000", 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0160000000000002e-06 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253805+0000", 2024-09-14T08:42:24.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4776e-05 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253813+0000", 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3229999999999998e-06 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.255813+0000", 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019999729999999999 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.255946+0000", 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013272100000000001 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.256100+0000", 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015390299999999999 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.260867+0000", 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047667209999999998 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261599+0000", 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00073193900000000003 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261647+0000", 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8196999999999999e-05 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261685+0000", 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7880000000000003e-05 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.687 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.6069.0:5742 3.6 e140/137 3:628087eb:::rbd_data.10f18f8e41e.0000000000000018:head v 140'1871, mlcod=27'6)", 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.257010+0000", 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3629004990000002, 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0067439400000000004, 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257010+0000", 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257010+0000", 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257011+0000", 2024-09-14T08:42:24.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4799999999999997e-07 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257019+0000", 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2609999999999993e-06 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257038+0000", 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8219e-05 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257047+0000", 2024-09-14T08:42:24.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7690000000000008e-06 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257148+0000", 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100642 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257189+0000", 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0907e-05 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.263663+0000", 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0064735299999999999 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.263754+0000", 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1663999999999995e-05 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2669382459999996, 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:42:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5928 3.15 3:aea5419d:::rbd_header.10f18f8e41e:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:23.517832+0000", 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.102079131, 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0059182219999999999, 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5928 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.517832+0000", 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.517832+0000", 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.517833+0000", 2024-09-14T08:42:24.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3740000000000001e-06 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.517840+0000", 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.517859+0000", 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9103e-05 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.517875+0000", 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6427e-05 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.519423+0000", 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015475059999999999 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.519687+0000", 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026384800000000001 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 3", 2024-09-14T08:42:24.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.520406+0000", 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00071955599999999999 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.522130+0000", 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0017232790000000001 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.523507+0000", 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013776630000000001 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.523570+0000", 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3126000000000005e-05 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.523750+0000", 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017939099999999999 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5966 3.c 3:37690830:::rbd_data.10f18f8e41e.0000000000000002:head [write 3660800~48128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:23.537817+0000", 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.082093478, 2024-09-14T08:42:24.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006470511, 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5966 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537817+0000", 2024-09-14T08:42:24.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537817+0000", 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537818+0000", 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1800000000000001e-07 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537943+0000", 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012569299999999999 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537952+0000", 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9709999999999993e-06 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537956+0000", 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9210000000000002e-06 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.538110+0000", 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153926 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.538316+0000", 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020529700000000001 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:24.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.538480+0000", 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016449800000000001 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.540455+0000", 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001974515 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.544232+0000", 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003777 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.544259+0000", 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7202000000000001e-05 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.544288+0000", 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9070000000000001e-05 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.710 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5976 3.12 3:49868067:::rbd_data.10f18f8e41e.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,write 624640~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:23.541042+0000", 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.078868604, 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0087749890000000004, 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5976 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.711 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541042+0000", 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541042+0000", 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541043+0000", 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:42:24.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541052+0000", 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9600000000000006e-06 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541063+0000", 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0562e-05 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541068+0000", 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4310000000000002e-06 2024-09-14T08:42:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541123+0000", 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4755e-05 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for missing object", 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541216+0000", 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3478000000000002e-05 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.544953+0000", 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003736489 2024-09-14T08:42:24.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.545055+0000", 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101958 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 3", 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.545180+0000", 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125656 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.546873+0000", 2024-09-14T08:42:24.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001692732 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.549635+0000", 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002761552 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.549681+0000", 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6174999999999998e-05 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.549817+0000", 2024-09-14T08:42:24.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136382 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:7332 3.15 3:aea5419d:::rbd_header.10f18f8e41e:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:24.388796+0000", 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.23111525599999999, 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066472909999999996, 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.717 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 7332 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388796+0000", 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388796+0000", 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388796+0000", 2024-09-14T08:42:24.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5799999999999999e-07 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388800+0000", 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1139999999999999e-06 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388809+0000", 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9250000000000001e-06 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388814+0000", 2024-09-14T08:42:24.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8829999999999997e-06 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388853+0000", 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8859999999999997e-05 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388916+0000", 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3492999999999997e-05 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 3", 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.389068+0000", 2024-09-14T08:42:24.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015199899999999999 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.390015+0000", 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00094657200000000002 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.395228+0000", 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052129730000000001 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.395294+0000", 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5709000000000004e-05 2024-09-14T08:42:24.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.395443+0000", 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014910499999999999 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:7484 3.6 3:628087eb:::rbd_data.10f18f8e41e.0000000000000018:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:24.496785+0000", 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.123125762, 2024-09-14T08:42:24.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0060589809999999997, 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 7484 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.496785+0000", 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.496785+0000", 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.496786+0000", 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8500000000000001e-07 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.496788+0000", 2024-09-14T08:42:24.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6840000000000001e-06 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.496795+0000", 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6510000000000004e-06 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.496800+0000", 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3199999999999999e-06 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.496901+0000", 2024-09-14T08:42:24.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101029 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.496975+0000", 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3653999999999996e-05 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.497076+0000", 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010129200000000001 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.499108+0000", 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020313509999999998 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.502762+0000", 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0036544450000000001 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.502808+0000", 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5593000000000002e-05 2024-09-14T08:42:24.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:24.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:24.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:24.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.502844+0000", 2024-09-14T08:42:24.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6377000000000001e-05 2024-09-14T08:42:24.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.728 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:24.728 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:24.728 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:24.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:24.731 INFO:teuthology.orchestra.run.smithi188.stdout:5401 write 0xdba8200 thru 0xdbb36f2 (0xb4f3 bytes) 2024-09-14T08:42:24.731 INFO:teuthology.orchestra.run.smithi188.stdout:5402 write 0xaaa3400 thru 0xaab2c41 (0xf842 bytes) 2024-09-14T08:42:24.731 INFO:teuthology.orchestra.run.smithi188.stdout:5404 read 0x1683600 thru 0x168c37c (0x8d7d bytes) 2024-09-14T08:42:24.731 INFO:teuthology.orchestra.run.smithi188.stdout:5405 write 0x11e7400 thru 0x11f4eb5 (0xdab6 bytes) 2024-09-14T08:42:24.732 INFO:teuthology.orchestra.run.smithi188.stdout:5409 write 0x89cac00 thru 0x89d7967 (0xcd68 bytes) 2024-09-14T08:42:24.732 INFO:teuthology.orchestra.run.smithi188.stdout:5411 write 0x9954200 thru 0x995f07b (0xae7c bytes) 2024-09-14T08:42:24.732 INFO:teuthology.orchestra.run.smithi188.stdout:5412 read 0x69d3e00 thru 0x69dcd56 (0x8f57 bytes) 2024-09-14T08:42:24.732 INFO:teuthology.orchestra.run.smithi188.stdout:5415 read 0xae39600 thru 0xae413ed (0x7dee bytes) 2024-09-14T08:42:24.732 INFO:teuthology.orchestra.run.smithi188.stdout:5419 write 0xc468000 thru 0xc474f0d (0xcf0e bytes) 2024-09-14T08:42:24.732 INFO:teuthology.orchestra.run.smithi188.stdout:5422 write 0xb137c00 thru 0xb142e7e (0xb27f bytes) 2024-09-14T08:42:24.732 INFO:teuthology.orchestra.run.smithi188.stdout:5425 write 0x3df5800 thru 0x3dfe481 (0x8c82 bytes) 2024-09-14T08:42:24.732 INFO:teuthology.orchestra.run.smithi188.stdout:5426 trunc from 0xec90000 to 0x2dc9000 2024-09-14T08:42:24.732 INFO:teuthology.orchestra.run.smithi188.stdout:5431 read 0x66b400 thru 0x66b89d (0x49e bytes) 2024-09-14T08:42:24.732 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:24.728+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:24.737 INFO:teuthology.orchestra.run.smithi188.stdout:5432 write 0x9bafa00 thru 0x9bb9553 (0x9b54 bytes) 2024-09-14T08:42:24.739 INFO:teuthology.orchestra.run.smithi188.stdout:5433 write 0x122d600 thru 0x122d7bb (0x1bc bytes) 2024-09-14T08:42:24.740 INFO:teuthology.orchestra.run.smithi188.stdout:5434 punch from 0x9043000 to 0x904b800, (0x8800 bytes) 2024-09-14T08:42:24.740 INFO:teuthology.orchestra.run.smithi188.stdout:5435 punch from 0x6ec3600 to 0x6ed2400, (0xee00 bytes) 2024-09-14T08:42:24.740 INFO:teuthology.orchestra.run.smithi188.stdout:5437 write 0x1aa1a00 thru 0x1aa6120 (0x4721 bytes) 2024-09-14T08:42:24.755 INFO:teuthology.orchestra.run.smithi188.stdout:5439 trunc from 0x9bb9600 to 0x4c0e00 2024-09-14T08:42:24.821 INFO:teuthology.orchestra.run.smithi188.stdout:5441 read 0x5b600 thru 0x686e3 (0xd0e4 bytes) 2024-09-14T08:42:24.826 INFO:teuthology.orchestra.run.smithi188.stdout:5443 punch from 0x3ba000 to 0x3c7600, (0xd600 bytes) 2024-09-14T08:42:24.827 INFO:teuthology.orchestra.run.smithi188.stdout:5445 punch from 0x170600 to 0x176e00, (0x6800 bytes) 2024-09-14T08:42:24.830 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:24.827+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:24.875 INFO:teuthology.orchestra.run.smithi188.stdout:5446 write 0xb2f7e00 thru 0xb2ff75c (0x795d bytes) 2024-09-14T08:42:24.876 INFO:teuthology.orchestra.run.smithi188.stdout:5447 read 0x685b200 thru 0x685ed6b (0x3b6c bytes) 2024-09-14T08:42:24.903 INFO:teuthology.orchestra.run.smithi188.stdout:5448 trunc from 0xb2ff800 to 0x442400 2024-09-14T08:42:24.919 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:24.919 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:24.919 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:24.919 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:24.931 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:24.931+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:24.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:24.943 INFO:teuthology.orchestra.run.smithi188.stdout:5450 read 0x5c200 thru 0x63943 (0x7744 bytes) 2024-09-14T08:42:24.949 INFO:teuthology.orchestra.run.smithi188.stdout:5457 read 0x2a9800 thru 0x2b5694 (0xbe95 bytes) 2024-09-14T08:42:24.953 INFO:teuthology.orchestra.run.smithi188.stdout:5461 punch from 0x42800 to 0x50400, (0xdc00 bytes) 2024-09-14T08:42:24.954 INFO:teuthology.orchestra.run.smithi188.stdout:5462 punch from 0x308600 to 0x30f600, (0x7000 bytes) 2024-09-14T08:42:24.964 INFO:teuthology.orchestra.run.smithi188.stdout:5464 trunc from 0x442400 to 0x3f1d600 2024-09-14T08:42:24.984 INFO:teuthology.orchestra.run.smithi188.stdout:5466 read 0x1e57c00 thru 0x1e62582 (0xa983 bytes) 2024-09-14T08:42:25.031 INFO:teuthology.orchestra.run.smithi188.stdout:5469 write 0xcc8e200 thru 0xcc90313 (0x2114 bytes) 2024-09-14T08:42:25.032 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:25.031+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:25.033 INFO:teuthology.orchestra.run.smithi188.stdout:5472 punch from 0x9bbb600 to 0x9bcac00, (0xf600 bytes) 2024-09-14T08:42:25.034 INFO:teuthology.orchestra.run.smithi188.stdout:5473 clone 32 order 20 su 262144 sc 13 2024-09-14T08:42:25.107 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:25.107 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:25.107 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:25.107 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:25.107 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:25.122 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:25.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:25.163 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:25.163+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:25.233 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:25.232+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:25.289 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:25.289 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:25.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:25.289 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:25.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.290 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:25.290 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:25.290 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 148.36405010499999, 2024-09-14T08:42:25.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:42:25.290 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.290 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.290 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.290 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:25.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:25.291 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:42:25.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.291 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:25.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:42:25.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:42:25.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:42:25.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:42:25.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:42:25.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:42:25.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:42:25.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 148.363995327, 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.296 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.297 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:25.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:25.297 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:42:25.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.297 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:25.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:25.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:42:25.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:42:25.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:42:25.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:25.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:42:25.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:42:25.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:42:25.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:42:25.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 134.93622486800001, 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.302 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.94362080099999, 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:42:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.311 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.94278242999999, 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:42:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.316 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.924274328999999, 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.923960119999997, 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.321 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:42:25.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.922323794, 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.325 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:42:25.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.326 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:25.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:42:25.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:42:25.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:42:25.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.922105834999996, 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:42:25.330 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:25.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:42:25.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:42:25.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:42:25.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.921810432999997, 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:42:25.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.921539598000003, 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:42:25.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:42:25.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:42:25.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.344 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.344 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.344 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.710348916999997, 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:42:25.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.710328883000003, 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:42:25.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.710307804999999, 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:42:25.353 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:42:25.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.357 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.710288210999998, 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:42:25.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:42:25.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.710268057, 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.362 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:42:25.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.710248661000001, 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:42:25.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:42:25.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:42:25.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:42:25.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:42:25.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:42:25.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.371 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.371 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:25.371 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.703718860999999, 2024-09-14T08:42:25.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:42:25.371 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.703698975000002, 2024-09-14T08:42:25.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:42:25.376 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.376 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.376 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.376 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:42:25.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.376 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:42:25.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.703679600999997, 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:25.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:25.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:42:25.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:42:25.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:25.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:25.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:25.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:42:25.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:42:25.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.384 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:25.384 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:25.384 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:25.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:25.386 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:25.386 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:25.387 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:25.387 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:25.387 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:25.387 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:25.388 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:25.388 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:25.389 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:25.384+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:25.389 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:25.389 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:25.418 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:25.420 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:25.486 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:25.483+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:25.512 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:25.512 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:25.526 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:25.587 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:25.584+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:25.688 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:25.684+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:25.691 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:25.691 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:25.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:25.789 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:25.788+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:25.837 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:25.837 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:25.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:25.889 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:25.887+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:25.990 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:25.988+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:25.995 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:25.995 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:26.010 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:26.105 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:26.104+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:26.192 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:26.188+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:26.197 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:26.197 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:26.212 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:26.293 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:26.291+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:26.388 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:26.388 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:26.394 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:26.392+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:26.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:26.407 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5, 0, 3] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:42:26.407 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:42:26.407 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-14T08:42:26.407 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-14T08:42:26.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:42:26.495 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:26.495+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:26.548 INFO:teuthology.orchestra.run.smithi188.stdout:leaving image image_client.0-clone31 intact 2024-09-14T08:42:26.582 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:26.583 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:26.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-14T08:42:26.595 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:26.592+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:26.597 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:26.697 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:26.692+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:26.764 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:26.765 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:26.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:26.797 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:26.795+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:26.802 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-14T08:42:26.897 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:26.895+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:26.951 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:26.952 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:26.965 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:27.011 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-14T08:42:27.013 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:27.012+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:27.088 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:27.088 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:27.098 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:27.096+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:27.102 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:27.125 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-14T08:42:27.199 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:27.196+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:27.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-14T08:42:27.267 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:27.267 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:27.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:27.325 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:27.324+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:27.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-14T08:42:27.401 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:27.396+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:27.402 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:42:27.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:27.460 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:27.460 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:27.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:27.515 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:27.515+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:27.601 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:27.599+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:27.623 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:27.624 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:27.647 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:27.647 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:27.654 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:27.654 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:27.654 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:27.654 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:27.664 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:27.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:27.685 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:27.686 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:27.702 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:27.700+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:27.707 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:27.707 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:27.728 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:27.728 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:27.797 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:27.797 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:27.797 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:27.797 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:27.797 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:27.803 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:27.803+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:27.811 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:27.904 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:27.900+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:27.968 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.01012781, 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:42:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:42:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:42:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:42:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:42:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:42:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.008930724000001, 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:42:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.008868032000001, 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.008830285, 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:42:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:42:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.008733222, 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.008652375, 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:27.992 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:42:27.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:42:27.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:42:27.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "pg_update_log_missing(3.15 epoch 140/137 rep_tid 5158 entries 140'873 (0'0) error 3:aea5419d:::rbd_header.10f18f8e41e:head by client.6069.0:5108 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:18.785285+0000", 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.1843335469999996, 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0061932319999999999, 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:27.997 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:27.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:27.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785285+0000", 2024-09-14T08:42:27.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:27.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785285+0000", 2024-09-14T08:42:27.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:27.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785286+0000", 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6599999999999996e-07 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785294+0000", 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3720000000000005e-06 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:27.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785316+0000", 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2106000000000001e-05 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785331+0000", 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4686e-05 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.785403+0000", 2024-09-14T08:42:28.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2249000000000006e-05 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:18.791478+0000", 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0060751529999999998 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5463 3.12 3:4e37f627:::rbd_data.10f18f8e41e.0000000000000029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.052009+0000", 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9176091910000004, 2024-09-14T08:42:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0080280200000000003, 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5463 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052009+0000", 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052009+0000", 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052012+0000", 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0120000000000001e-06 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052024+0000", 2024-09-14T08:42:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1231e-05 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052049+0000", 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5761999999999998e-05 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052063+0000", 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3733e-05 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052183+0000", 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011953800000000001 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052367+0000", 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018422499999999999 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.052594+0000", 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022711000000000001 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.056815+0000", 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0042212680000000002 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.059841+0000", 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003026043 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.059972+0000", 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013100199999999999 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.060037+0000", 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5096000000000002e-05 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5733 3.12 3:49868067:::rbd_data.10f18f8e41e.000000000000000a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.253718+0000", 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.7159006009999995, 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078145260000000005, 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5733 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253718+0000", 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253718+0000", 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253720+0000", 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2929999999999999e-06 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253728+0000", 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7950000000000008e-06 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253747+0000", 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8493000000000001e-05 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253755+0000", 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2640000000000008e-06 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253903+0000", 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000147715 2024-09-14T08:42:28.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.254103+0000", 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020008800000000001 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.254385+0000", 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00028287400000000002 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.258587+0000", 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0042015339999999998 2024-09-14T08:42:28.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261327+0000", 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00274033 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261440+0000", 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011230600000000001 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261532+0000", 2024-09-14T08:42:28.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2833999999999999e-05 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5734 3.12 3:4b5ed939:::rbd_data.10f18f8e41e.000000000000000c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.253785+0000", 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.7158331150000006, 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078991800000000004, 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5734 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253785+0000", 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253785+0000", 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253786+0000", 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3099999999999997e-07 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253790+0000", 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0160000000000002e-06 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253805+0000", 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4776e-05 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.253813+0000", 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3229999999999998e-06 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.255813+0000", 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019999729999999999 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.255946+0000", 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013272100000000001 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.256100+0000", 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015390299999999999 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.260867+0000", 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047667209999999998 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261599+0000", 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00073193900000000003 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261647+0000", 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8196999999999999e-05 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.261685+0000", 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7880000000000003e-05 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.018 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.6069.0:5742 3.6 e140/137 3:628087eb:::rbd_data.10f18f8e41e.0000000000000018:head v 140'1871, mlcod=27'6)", 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.257010+0000", 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.7126082789999995, 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0067439400000000004, 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257010+0000", 2024-09-14T08:42:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257010+0000", 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257011+0000", 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4799999999999997e-07 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257019+0000", 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2609999999999993e-06 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257038+0000", 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8219e-05 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257047+0000", 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7690000000000008e-06 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257148+0000", 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100642 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.257189+0000", 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0907e-05 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.263663+0000", 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0064735299999999999 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.263754+0000", 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1663999999999995e-05 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.6166460259999997, 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.023 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:42:28.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:42:28.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:42:28.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5966 3.c 3:37690830:::rbd_data.10f18f8e41e.0000000000000002:head [write 3660800~48128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:23.537817+0000", 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4318012580000001, 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006470511, 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5966 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.029 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537817+0000", 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537817+0000", 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537818+0000", 2024-09-14T08:42:28.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1800000000000001e-07 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537943+0000", 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012569299999999999 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537952+0000", 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9709999999999993e-06 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.537956+0000", 2024-09-14T08:42:28.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9210000000000002e-06 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.538110+0000", 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153926 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.538316+0000", 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020529700000000001 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.538480+0000", 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016449800000000001 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.540455+0000", 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001974515 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.544232+0000", 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003777 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.544259+0000", 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7202000000000001e-05 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.544288+0000", 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9070000000000001e-05 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5976 3.12 3:49868067:::rbd_data.10f18f8e41e.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,write 624640~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-14T08:42:28.034 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:23.541042+0000", 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.4285763840000003, 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0087749890000000004, 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5976 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541042+0000", 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541042+0000", 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541043+0000", 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541052+0000", 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9600000000000006e-06 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541063+0000", 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0562e-05 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541068+0000", 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4310000000000002e-06 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541123+0000", 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4755e-05 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for missing object", 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.541216+0000", 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3478000000000002e-05 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.544953+0000", 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003736489 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.545055+0000", 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101958 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 3", 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.545180+0000", 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125656 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.040 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:28.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.546873+0000", 2024-09-14T08:42:28.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001692732 2024-09-14T08:42:28.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.040 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:28.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.549635+0000", 2024-09-14T08:42:28.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002761552 2024-09-14T08:42:28.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.549681+0000", 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6174999999999998e-05 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:23.549817+0000", 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136382 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.041 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:7332 3.15 3:aea5419d:::rbd_header.10f18f8e41e:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:24.388796+0000", 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.580823036, 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066472909999999996, 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 7332 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388796+0000", 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388796+0000", 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388796+0000", 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5799999999999999e-07 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388800+0000", 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1139999999999999e-06 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388809+0000", 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9250000000000001e-06 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388814+0000", 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8829999999999997e-06 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388853+0000", 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8859999999999997e-05 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.388916+0000", 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3492999999999997e-05 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 3", 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.389068+0000", 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015199899999999999 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.390015+0000", 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00094657200000000002 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.395228+0000", 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052129730000000001 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.395294+0000", 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5709000000000004e-05 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.395443+0000", 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014910499999999999 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:7830 3.6 3:628087eb:::rbd_data.10f18f8e41e.0000000000000018:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:24.680469+0000", 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.2891494149999998, 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0071282280000000003, 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.047 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 7830 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.680469+0000", 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.680469+0000", 2024-09-14T08:42:28.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.680470+0000", 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1200000000000002e-07 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.680474+0000", 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1869999999999999e-06 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.680486+0000", 2024-09-14T08:42:28.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1671999999999999e-05 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.680492+0000", 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.680556+0000", 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4706e-05 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.680608+0000", 2024-09-14T08:42:28.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1184999999999999e-05 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.680712+0000", 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000104379 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.681995+0000", 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0012831229999999999 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:28.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.687400+0000", 2024-09-14T08:42:28.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0054051890000000003 2024-09-14T08:42:28.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.687499+0000", 2024-09-14T08:42:28.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8313999999999994e-05 2024-09-14T08:42:28.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.687597+0000", 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8839999999999996e-05 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:7975 3.15 3:a97743f5:::rbd_data.10f18f8e41e.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1710592~18432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:24.764744+0000", 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.2048746490000002, 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013541413, 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 7975 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.764744+0000", 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.764744+0000", 2024-09-14T08:42:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.764747+0000", 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7130000000000001e-06 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.764782+0000", 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5472999999999997e-05 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.764820+0000", 2024-09-14T08:42:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7489e-05 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.764842+0000", 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2330000000000001e-05 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.764941+0000", 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8868000000000003e-05 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for missing object", 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.765080+0000", 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013893400000000001 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.774531+0000", 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0094515550000000004 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.774868+0000", 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033701400000000001 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 3", 2024-09-14T08:42:28.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.775272+0000", 2024-09-14T08:42:28.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00040366399999999998 2024-09-14T08:42:28.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:28.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.777492+0000", 2024-09-14T08:42:28.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022202390000000002 2024-09-14T08:42:28.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.778152+0000", 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00066005800000000004 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.778192+0000", 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9848999999999997e-05 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.778285+0000", 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3226999999999994e-05 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:21361 3.15 3:aea5419d:::rbd_header.10f18f8e41e:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e146)", 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:24.792164+0000", 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.177454805, 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0061831209999999998, 2024-09-14T08:42:28.060 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21361 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.792164+0000", 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.792164+0000", 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.792165+0000", 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6950000000000001e-06 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.792175+0000", 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3370000000000006e-06 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.792194+0000", 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9519999999999999e-05 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.792206+0000", 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1846e-05 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.794368+0000", 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021617989999999998 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.794476+0000", 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108449 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.798347+0000", 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003870475 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.064 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:8223 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [stat,write 272384~56320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:24.957341+0000", 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.0122775470000001, 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078196299999999993, 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.065 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8223 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.957341+0000", 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.957341+0000", 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.957342+0000", 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9100000000000003e-07 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.957543+0000", 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000201695 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.957552+0000", 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3410000000000003e-06 2024-09-14T08:42:28.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.957557+0000", 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0900000000000004e-06 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.960439+0000", 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00288251 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.960495+0000", 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5414000000000002e-05 2024-09-14T08:42:28.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.960600+0000", 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010523599999999999 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.962273+0000", 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001673513 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.964954+0000", 2024-09-14T08:42:28.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002680464 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.964989+0000", 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5398999999999998e-05 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.965161+0000", 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017127700000000001 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:8232 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 3584~512] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e146)", 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:24.961302+0000", 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.008316561, 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0060730560000000003, 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 8232 2024-09-14T08:42:28.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.961302+0000", 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.961302+0000", 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.961303+0000", 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3900000000000005e-07 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.961305+0000", 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4210000000000002e-06 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.961314+0000", 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3139999999999993e-06 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.961320+0000", 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0299999999999999e-06 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.962068+0000", 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00074753000000000005 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for rw locks", 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.962246+0000", 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000178393 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.967270+0000", 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050240079999999999 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.967310+0000", 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0027999999999997e-05 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:24.967375+0000", 2024-09-14T08:42:28.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4793000000000001e-05 2024-09-14T08:42:28.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.076 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.076 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.076 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:28.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:28.078 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:28.076+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:28.178 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:28.175+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:28.199 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:28.199 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:28.199 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:28.199 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:28.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:28.279 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:28.276+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:28.315 INFO:teuthology.orchestra.run.smithi188.stdout:5475 write 0x67a5a00 thru 0x67b4cc6 (0xf2c7 bytes) 2024-09-14T08:42:28.317 INFO:teuthology.orchestra.run.smithi188.stdout:5476 write 0x1fe5000 thru 0x1ff1d28 (0xcd29 bytes) 2024-09-14T08:42:28.318 INFO:teuthology.orchestra.run.smithi188.stdout:5478 read 0x81ad200 thru 0x81ad842 (0x643 bytes) 2024-09-14T08:42:28.371 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:28.371 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:28.371 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:28.371 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:28.371 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:28.379 INFO:teuthology.orchestra.run.smithi188.stdout:5481 trunc from 0xcc90400 to 0x1c01c00 2024-09-14T08:42:28.380 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:28.379+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:28.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:28.446 INFO:teuthology.orchestra.run.smithi188.stdout:5483 punch from 0xfa7400 to 0xfad800, (0x6400 bytes) 2024-09-14T08:42:28.448 INFO:teuthology.orchestra.run.smithi188.stdout:5486 read 0x9ac000 thru 0x9b2843 (0x6844 bytes) 2024-09-14T08:42:28.448 INFO:teuthology.orchestra.run.smithi188.stdout:5488 clone 33 order 19 su 8192 sc 14 2024-09-14T08:42:28.481 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:28.480+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:28.550 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:28.550 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:28.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:28.550 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:28.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 151.62432222300001, 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:28.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 151.62426744499999, 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.555 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:28.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:42:28.559 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 138.196496986, 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 115.203892919, 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:42:28.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:42:28.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 115.203054548, 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.569 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.573 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.184546447000002, 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.577 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.184232238, 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.578 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:42:28.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.182595911999996, 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.582 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:42:28.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:28.586 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.182377953, 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.590 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.182082551000001, 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:28.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:42:28.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:42:28.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.181811715999999, 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.970621035000001, 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.599 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.970601000999999, 2024-09-14T08:42:28.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:42:28.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:42:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.970579923000003, 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:42:28.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.970560329000001, 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.970540174999996, 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.616 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:28.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:42:28.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.970520778999997, 2024-09-14T08:42:28.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.624 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.963990979000002, 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:28.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:42:28.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:42:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.963971092999998, 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:42:28.632 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.963951719000001, 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:28.633 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:28.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:42:28.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:42:28.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.637 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:28.637 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:28.637 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:28.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:28.639 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:28.635+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:28.739 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:28.740+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:28.804 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:28.805 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:28.805 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:28.805 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:28.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:28.863 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:28.863+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:28.941 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:28.939+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:28.943 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:28.943 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:28.943 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:28.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:29.042 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:29.044+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 138.82067137199999, 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 106.558561193, 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:42:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 106.55841402199999, 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:42:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 106.558272222, 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.995006455000002, 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:42:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:42:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:42:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:42:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.986715165, 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.986691923999999, 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:42:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:42:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.986672659999996, 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.986653384, 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:42:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.986440930999997, 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:42:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.979227838, 2024-09-14T08:42:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:42:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.979206626, 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:42:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.979187275999998, 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.979160237000002, 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:42:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.979141087000002, 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:42:29.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:42:29.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:42:29.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.979119503, 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:42:29.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:42:29.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:42:29.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:42:29.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.979100094000003, 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:42:29.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.979081217999997, 2024-09-14T08:42:29.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:42:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:42:29.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.971050382000001, 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.971023985999999, 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:29.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:42:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:42:29.213 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.214 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:29.214 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:29.214 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:29.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:29.216 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:29.216+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:29.316 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:29.312+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:29.348 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:29.348 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:29.362 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:29.417 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:29.415+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:29.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:42:29.518 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:29.515+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:29.532 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:29.533 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:29.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:29.612 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone32 from 0x1c01c00 (overlap 0x1c01c00) to 0x0 2024-09-14T08:42:29.619 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:29.615+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43409888100001, 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.682 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:42:29.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43403686799999, 2024-09-14T08:42:29.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:29.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43397053800001, 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.694 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43391507800001, 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:42:29.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:42:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:42:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43385545800001, 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:42:29.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43377391799999, 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.706 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:42:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:42:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:42:29.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43371758999999, 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:42:29.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:42:29.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:42:29.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:42:29.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.433646095, 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:42:29.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:42:29.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:42:29.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:42:29.717 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43357322400001, 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.718 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.433531012, 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:29.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:42:29.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:42:29.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43350118199999, 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.726 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:42:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:42:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.730 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43347288499999, 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.734 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43343178999999, 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.735 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:42:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43340276000001, 2024-09-14T08:42:29.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:42:29.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.743 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.433374276, 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:42:29.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:42:29.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43334613600001, 2024-09-14T08:42:29.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:42:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:42:29.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.752 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.43331744, 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:42:29.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:42:29.756 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.433288683, 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.757 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:42:29.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.433260636, 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:42:29.761 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:42:29.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:42:29.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.433230659, 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.766 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:29.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:29.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:42:29.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:42:29.770 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.770 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.770 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.770 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:29.770 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:29.770 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:29.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:29.772 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:29.773 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:29.768+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:29.872 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:29.868+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:29.910 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:29.927 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:29.927 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:29.943 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:29.943 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:29.946 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:29.947 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:29.961 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:29.963 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:29.963 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:29.982 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:29.982 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:30.000 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:30.001 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:30.005 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:30.004+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:30.073 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:30.072+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:30.129 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:30.129 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:30.142 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-14T08:42:30.143 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:30.174 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:30.170+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:30.275 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:30.274+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:30.306 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:30.306 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:30.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:30.376 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:30.372+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:30.450 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:30.451 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:30.458 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:42:30.468 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:30.509 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:30.508+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:30.578 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:30.576+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:30.631 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:30.631 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:30.645 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:30.678 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:30.674+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:30.780 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:30.778+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:30.812 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:30.812 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:30.827 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:30.880 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:30.876+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:30.961 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:30.962 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:30.976 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:31.023 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:31.022+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:31.081 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:31.078+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:31.098 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:31.098 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:31.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:31.203 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:31.202+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:31.281 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:31.281 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:31.283 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:31.280+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:31.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:31.374 INFO:teuthology.orchestra.run.smithi188.stdout:5489 punch from 0x173e00 to 0x179600, (0x5800 bytes) 2024-09-14T08:42:31.384 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:31.380+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:31.415 INFO:teuthology.orchestra.run.smithi188.stdout:5491 punch from 0x1300e00 to 0x1309200, (0x8400 bytes) 2024-09-14T08:42:31.438 INFO:teuthology.orchestra.run.smithi188.stdout:5495 read 0x1b12000 thru 0x1b15df9 (0x3dfa bytes) 2024-09-14T08:42:31.439 INFO:teuthology.orchestra.run.smithi188.stdout:5497 read 0x126b200 thru 0x1271992 (0x6793 bytes) 2024-09-14T08:42:31.466 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:31.466 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:31.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:31.491 INFO:teuthology.orchestra.run.smithi188.stdout:5498 trunc from 0x1c01c00 to 0x9371200 2024-09-14T08:42:31.525 INFO:teuthology.orchestra.run.smithi188.stdout:5499 trunc from 0x9371200 to 0x5739400 2024-09-14T08:42:31.531 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:31.530+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:31.550 INFO:teuthology.orchestra.run.smithi188.stdout:5500 punch from 0x47b8800 to 0x47c4600, (0xbe00 bytes) 2024-09-14T08:42:31.552 INFO:teuthology.orchestra.run.smithi188.stdout:5503 punch from 0x1c11e00 to 0x1c1bc00, (0x9e00 bytes) 2024-09-14T08:42:31.553 INFO:teuthology.orchestra.run.smithi188.stdout:5504 write 0x109ca00 thru 0x10a7a37 (0xb038 bytes) 2024-09-14T08:42:31.554 INFO:teuthology.orchestra.run.smithi188.stdout:5505 read 0x8c1a00 thru 0x8c6992 (0x4f93 bytes) 2024-09-14T08:42:31.555 INFO:teuthology.orchestra.run.smithi188.stdout:5508 write 0x22cae00 thru 0x22d40cc (0x92cd bytes) 2024-09-14T08:42:31.555 INFO:teuthology.orchestra.run.smithi188.stdout:5510 punch from 0x3a72a00 to 0x3a80000, (0xd600 bytes) 2024-09-14T08:42:31.557 INFO:teuthology.orchestra.run.smithi188.stdout:5511 read 0x35f1600 thru 0x35f472c (0x312d bytes) 2024-09-14T08:42:31.558 INFO:teuthology.orchestra.run.smithi188.stdout:5513 read 0x3a35000 thru 0x3a3bc49 (0x6c4a bytes) 2024-09-14T08:42:31.558 INFO:teuthology.orchestra.run.smithi188.stdout:5516 write 0x1f1d400 thru 0x1f2b712 (0xe313 bytes) 2024-09-14T08:42:31.571 INFO:teuthology.orchestra.run.smithi188.stdout:5517 trunc from 0x5739400 to 0xa739000 2024-09-14T08:42:31.586 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:31.584+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:31.602 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:31.602 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:31.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:31.652 INFO:teuthology.orchestra.run.smithi188.stdout:5521 read 0x899a000 thru 0x899e6d1 (0x46d2 bytes) 2024-09-14T08:42:31.654 INFO:teuthology.orchestra.run.smithi188.stdout:5524 write 0x6ec6000 thru 0x6ec7985 (0x1986 bytes) 2024-09-14T08:42:31.654 INFO:teuthology.orchestra.run.smithi188.stdout:5525 write 0x7d25000 thru 0x7d28c5d (0x3c5e bytes) 2024-09-14T08:42:31.707 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:31.706+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:31.715 INFO:teuthology.orchestra.run.smithi188.stdout:5526 write 0xd7eea00 thru 0xd7f211b (0x371c bytes) 2024-09-14T08:42:31.718 INFO:teuthology.orchestra.run.smithi188.stdout:5527 write 0xc6b0600 thru 0xc6bbcb1 (0xb6b2 bytes) 2024-09-14T08:42:31.718 INFO:teuthology.orchestra.run.smithi188.stdout:5530 read 0x3063800 thru 0x30661db (0x29dc bytes) 2024-09-14T08:42:31.718 INFO:teuthology.orchestra.run.smithi188.stdout:5531 punch from 0x3adc600 to 0x3aeb600, (0xf000 bytes) 2024-09-14T08:42:31.720 INFO:teuthology.orchestra.run.smithi188.stdout:5534 read 0x2145200 thru 0x21544fb (0xf2fc bytes) 2024-09-14T08:42:31.722 INFO:teuthology.orchestra.run.smithi188.stdout:5535 read 0x476e400 thru 0x4779dba (0xb9bb bytes) 2024-09-14T08:42:31.723 INFO:teuthology.orchestra.run.smithi188.stdout:5536 read 0x57d3a00 thru 0x57dab6e (0x716f bytes) 2024-09-14T08:42:31.723 INFO:teuthology.orchestra.run.smithi188.stdout:5541 read 0x27d1400 thru 0x27d3626 (0x2227 bytes) 2024-09-14T08:42:31.724 INFO:teuthology.orchestra.run.smithi188.stdout:5542 read 0x7d34400 thru 0x7d3822b (0x3e2c bytes) 2024-09-14T08:42:31.745 INFO:teuthology.orchestra.run.smithi188.stdout:5543 trunc from 0xd7f2200 to 0x2311200 2024-09-14T08:42:31.787 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:31.786+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:31.794 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:31.795 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:31.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:31.816 INFO:teuthology.orchestra.run.smithi188.stdout:5549 punch from 0x107c600 to 0x108aa00, (0xe400 bytes) 2024-09-14T08:42:31.818 INFO:teuthology.orchestra.run.smithi188.stdout:5550 read 0x533400 thru 0x540422 (0xd023 bytes) 2024-09-14T08:42:31.835 INFO:teuthology.orchestra.run.smithi188.stdout:5551 trunc from 0x2311200 to 0xf33000 2024-09-14T08:42:31.895 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:31.894+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:31.898 INFO:teuthology.orchestra.run.smithi188.stdout:5553 read 0x755800 thru 0x75d815 (0x8016 bytes) 2024-09-14T08:42:31.942 INFO:teuthology.orchestra.run.smithi188.stdout:5555 write 0x754a400 thru 0x755423c (0x9e3d bytes) 2024-09-14T08:42:31.944 INFO:teuthology.orchestra.run.smithi188.stdout:5556 punch from 0x1910c00 to 0x1918800, (0x7c00 bytes) 2024-09-14T08:42:31.983 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:31.983 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:31.990 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:31.988+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:31.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:32.006 INFO:teuthology.orchestra.run.smithi188.stdout:5557 write 0xdb88400 thru 0xdb913a1 (0x8fa2 bytes) 2024-09-14T08:42:32.018 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:32.021 INFO:teuthology.orchestra.run.smithi188.stdout:5560 trunc from 0xdb91400 to 0x7e75e00 2024-09-14T08:42:32.087 INFO:teuthology.orchestra.run.smithi188.stdout:5561 punch from 0x4f18800 to 0x4f25400, (0xcc00 bytes) 2024-09-14T08:42:32.091 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:32.088+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:32.094 INFO:teuthology.orchestra.run.smithi188.stdout:5562 trunc from 0x7e75e00 to 0x5d71c00 2024-09-14T08:42:32.143 INFO:teuthology.orchestra.run.smithi188.stdout:5563 read 0x5d4fe00 thru 0x5d58668 (0x8869 bytes) 2024-09-14T08:42:32.145 INFO:teuthology.orchestra.run.smithi188.stdout:5567 read 0x1c7ac00 thru 0x1c85bc8 (0xafc9 bytes) 2024-09-14T08:42:32.164 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:32.164 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:32.170 INFO:teuthology.orchestra.run.smithi188.stdout:5570 write 0x7eef800 thru 0x7ef1a92 (0x2293 bytes) 2024-09-14T08:42:32.180 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:32.184 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:32.184 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:32.192 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:32.190+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:32.202 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:32.202 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:32.204 INFO:teuthology.orchestra.run.smithi188.stdout:5573 write 0x81b6400 thru 0x81c2637 (0xc238 bytes) 2024-09-14T08:42:32.206 INFO:teuthology.orchestra.run.smithi188.stdout:5574 write 0x1313c00 thru 0x131857b (0x497c bytes) 2024-09-14T08:42:32.206 INFO:teuthology.orchestra.run.smithi188.stdout:5575 clone 34 order 19 su 2048 sc 12 2024-09-14T08:42:32.222 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:32.223 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:32.244 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:32.244 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:32.265 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:32.265 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:32.286 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:32.286 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:32.293 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:32.292+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:32.301 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:32.301 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:32.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:32.301 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:32.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.301 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 141.99745356, 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:42:32.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:42:32.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:42:32.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 109.73534338100001, 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:42:32.307 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:42:32.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:42:32.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:42:32.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 109.73519621, 2024-09-14T08:42:32.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 109.73505441, 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:32.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:42:32.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:32.322 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.171788642999999, 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:42:32.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.163497352999997, 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.163474112000003, 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:42:32.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:42:32.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:42:32.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:42:32.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.163454848000001, 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:42:32.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:42:32.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.163435571999997, 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.339 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:32.343 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.163223119000001, 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:32.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.156010025999997, 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.155988813999997, 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:42:32.352 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:42:32.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.155969464000002, 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.155942424999999, 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.361 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:42:32.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.155923274999999, 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:42:32.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:42:32.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.155901690999997, 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:42:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.155882282, 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:42:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:42:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.155863406000002, 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:42:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.147832569999998, 2024-09-14T08:42:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:42:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:42:32.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.147806174000003, 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:32.387 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:42:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:42:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:32.391 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:32.392 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:32.435 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:32.434+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:32.485 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:42:32.531 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:32.530+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:32.533 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:32.533 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:32.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:32.561 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5, 0, 3] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:42:32.563 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:42:32.564 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T08:42:32.564 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.000000 2024-09-14T08:42:32.564 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0 2024-09-14T08:42:32.611 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:32.610+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:32.648 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone33 from 0x81c2800 (overlap 0xf33000) to 0x0 2024-09-14T08:42:32.677 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:32.677 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:32.697 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:32.694+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:32.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:32.797 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:32.794+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:32.834 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:32.834 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:32.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38207 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4089856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58660946399999, 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095114563999999999, 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38207 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247883+0000", 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247885+0000", 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.73e-06 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247891+0000", 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6459999999999998e-06 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247912+0000", 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1118e-05 2024-09-14T08:42:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247926+0000", 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4258e-05 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342508+0000", 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.094581876999999995 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342734+0000", 2024-09-14T08:42:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022662800000000001 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.342998+0000", 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026330700000000001 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.586547451, 2024-09-14T08:42:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:42:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58648112099999, 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:42:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:42:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58642566099999, 2024-09-14T08:42:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:42:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58636604099999, 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:42:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:42:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58628450099999, 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:42:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:42:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58622817299999, 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58615667800001, 2024-09-14T08:42:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:42:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58608380699999, 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:42:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58604159500001, 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:42:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58601176499999, 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58598346799999, 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:42:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58594237299999, 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:42:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:42:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:42:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58591334299999, 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:42:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:42:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:42:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.585884859, 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58585671899999, 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:42:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.585828023, 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:42:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:42:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58579926600001, 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:42:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:42:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:42:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:42:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:42:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:42:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:42:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58577121900001, 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 154.58574124200001, 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:42:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:32.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:32.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:42:32.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:42:32.928 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.928 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.928 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.928 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:32.928 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:32.928 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:32.929 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:32.930 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:32.926+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:33.031 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:33.026+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:33.060 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:33.060 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:33.060 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:33.060 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:33.074 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:33.131 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:33.126+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:33.195 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:33.195 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:33.195 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:33.195 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:33.195 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:33.209 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:33.253 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:33.252+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:33.333 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:33.328+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:33.338 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:33.338 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 137.60532986600001, 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 82.069576041000005, 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:42:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 82.034911156999996, 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:42:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 82.034710185999998, 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:42:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.134034796999998, 2024-09-14T08:42:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:42:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:42:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:42:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:42:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:42:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.134000581999999, 2024-09-14T08:42:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:42:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.133959093000001, 2024-09-14T08:42:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:42:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:42:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.133900611000001, 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:42:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:42:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:42:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:42:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.133870931999994, 2024-09-14T08:42:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:42:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:42:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:42:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.133841723000003, 2024-09-14T08:42:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:42:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:42:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:42:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.126235428000001, 2024-09-14T08:42:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:42:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.126207437999994, 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:42:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:42:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:42:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:42:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:42:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:42:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:42:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.126179105999995, 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:42:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:42:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.126137346999997, 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:42:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.126108467999998, 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:42:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.126074658999997, 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:42:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:42:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.126042299999995, 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:42:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.117914497000001, 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:42:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:42:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:42:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:42:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.117883512000006, 2024-09-14T08:42:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.117854605999995, 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:42:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:42:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:42:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.436 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:33.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:33.438 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:33.434+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:33.473 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.5 primary-affinity to 0 (802) 2024-09-14T08:42:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:42:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-14T08:42:33.538 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:33.536+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:33.546 INFO:teuthology.orchestra.run.smithi188.stdout:5579 read 0x2466400 thru 0x2475e68 (0xfa69 bytes) 2024-09-14T08:42:33.550 INFO:teuthology.orchestra.run.smithi188.stdout:5581 punch from 0x2eec800 to 0x2ef1c00, (0x5400 bytes) 2024-09-14T08:42:33.614 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:33.614 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:33.614 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:33.614 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:33.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:33.639 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:33.638+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:33.740 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:33.736+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:33.799 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:33.799 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:33.799 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:33.799 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:33.799 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:33.813 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:33.858 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:33.856+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:33.941 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:33.942+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:33.978 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:33.978 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 152.899568088, 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:42:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:42:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 152.89951088399999, 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 152.899452, 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 152.899387074, 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:42:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:42:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 152.89932562300001, 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:42:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 152.89926608900001, 2024-09-14T08:42:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:42:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:42:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 152.899206779, 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 152.89913474700001, 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:42:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.74443436999999, 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:42:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 128.74440294499999, 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 84.380539325000001, 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:42:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 84.380479975, 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:42:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:42:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:42:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 84.380440023000006, 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:42:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:42:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.897017069999997, 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:42:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:42:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.890624504000002, 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:42:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:42:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:42:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.131035083999997, 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:42:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:42:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.090295681999997, 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:42:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:42:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 51.822724598000001, 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:42:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:42:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:42:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:42:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 51.758920703999998, 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:42:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:42:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:42:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 51.731449005999998, 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:42:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:42:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:42:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:34.093 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:34.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:34.095 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:34.094+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:34.197 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:34.196+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:34.227 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:34.227 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:34.227 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:34.228 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:34.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:34.297 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:34.294+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:34.364 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:34.364 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:34.365 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:34.365 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:34.365 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:34.380 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:34.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:34.423 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:34.422+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:34.499 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:34.496+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:34.547 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:34.547 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:34.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:34.547 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:34.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.589162786999999, 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.548 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.587965701000002, 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:42:34.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.587903009000001, 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:42:34.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:42:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.587865262000001, 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:42:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:42:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.587768198999999, 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:42:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.587687352, 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:42:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:42:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 15.195681003000001, 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:42:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:42:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3187 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 557056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714670+0000", 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.833983342, 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018249897000000001, 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3187 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714670+0000", 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714670+0000", 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714671+0000", 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7800000000000001e-07 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714673+0000", 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1459999999999999e-06 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714679+0000", 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1009999999999997e-06 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714683+0000", 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4730000000000002e-06 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.731957+0000", 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017273147999999999 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732019+0000", 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2051999999999995e-05 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732920+0000", 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00090139899999999999 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3190 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714734+0000", 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.8339194399999998, 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018244785999999999, 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3190 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714734+0000", 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714734+0000", 2024-09-14T08:42:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714734+0000", 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9799999999999999e-07 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714741+0000", 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714747+0000", 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469999999999999e-06 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714753+0000", 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1669999999999998e-06 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732966+0000", 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018213000999999999 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732979+0000", 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3256e-05 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3191 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714760+0000", 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.833893489, 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018258124000000001, 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3191 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714760+0000", 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714760+0000", 2024-09-14T08:42:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714760+0000", 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9499999999999998e-07 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714762+0000", 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0480000000000001e-06 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714769+0000", 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2419999999999997e-06 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714773+0000", 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.758e-06 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733012+0000", 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018238780999999999 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733018+0000", 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9000000000000003e-06 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3192 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714780+0000", 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.8338732769999999, 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018278793000000002, 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3192 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714780+0000", 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714780+0000", 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714781+0000", 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6800000000000001e-07 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714783+0000", 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1100000000000001e-06 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714789+0000", 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3729999999999998e-06 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714795+0000", 2024-09-14T08:42:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5140000000000001e-06 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733050+0000", 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018255052000000001 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733059+0000", 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3759999999999997e-06 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3193 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714802+0000", 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.8338512499999999, 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018271716, 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3193 2024-09-14T08:42:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714802+0000", 2024-09-14T08:42:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714802+0000", 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714803+0000", 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2500000000000001e-07 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714805+0000", 2024-09-14T08:42:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4430000000000002e-06 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714812+0000", 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5490000000000003e-06 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714817+0000", 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9520000000000002e-06 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733070+0000", 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018252877000000001 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733074+0000", 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4700000000000004e-06 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3194 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714825+0000", 2024-09-14T08:42:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.833828791, 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018291040000000001, 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3194 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714825+0000", 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714825+0000", 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714825+0000", 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9500000000000002e-07 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714828+0000", 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4789999999999999e-06 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714834+0000", 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4200000000000004e-06 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714839+0000", 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7029999999999997e-06 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733107+0000", 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018267945000000001 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733116+0000", 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8980000000000002e-06 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3196 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:22 [read 1474560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714867+0000", 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.8337866279999999, 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017712182, 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3196 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714867+0000", 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714867+0000", 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714867+0000", 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4700000000000001e-07 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714870+0000", 2024-09-14T08:42:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.43e-06 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714876+0000", 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6039999999999998e-06 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714882+0000", 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732429+0000", 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017547719 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732493+0000", 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3689999999999995e-05 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732579+0000", 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6092000000000002e-05 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3197 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714889+0000", 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.8337643859999999, 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018261672999999999, 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3197 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714889+0000", 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714889+0000", 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714890+0000", 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1100000000000001e-07 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714892+0000", 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3149999999999999e-06 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714898+0000", 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5390000000000004e-06 2024-09-14T08:42:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714905+0000", 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6030000000000001e-06 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733145+0000", 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018239671999999998 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733151+0000", 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1330000000000004e-06 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3199 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714934+0000", 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.8337194810000002, 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018263010999999999, 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3199 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714934+0000", 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714934+0000", 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714934+0000", 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2500000000000001e-07 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714937+0000", 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.452e-06 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714944+0000", 2024-09-14T08:42:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6059999999999999e-06 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714948+0000", 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7389999999999999e-06 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733185+0000", 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018236669 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733197+0000", 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2119999999999999e-05 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3202 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.715023+0000", 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.8336310060000001, 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018219775000000001, 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3202 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715023+0000", 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715023+0000", 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715023+0000", 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1699999999999998e-07 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715030+0000", 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.187e-06 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715037+0000", 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8530000000000003e-06 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715044+0000", 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9349999999999997e-06 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733233+0000", 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01818877 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733242+0000", 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5130000000000002e-06 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3204 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.715075+0000", 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.8335786760000001, 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018202200000000002, 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3204 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715075+0000", 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715075+0000", 2024-09-14T08:42:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715075+0000", 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1699999999999998e-07 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715078+0000", 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3209999999999999e-06 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715084+0000", 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5560000000000004e-06 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715089+0000", 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2599999999999996e-06 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733268+0000", 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018178155000000001 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733277+0000", 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3910000000000004e-06 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3208 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.715284+0000", 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.833369062, 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018021391000000001, 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3208 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715284+0000", 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715284+0000", 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715285+0000", 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4199999999999995e-07 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715302+0000", 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7022999999999999e-05 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715377+0000", 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4789000000000005e-05 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715399+0000", 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2116e-05 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733297+0000", 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017898038000000002 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733306+0000", 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7830000000000004e-06 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3210 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.715431+0000", 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.83322275, 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017907939000000001, 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3210 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715431+0000", 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715431+0000", 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715431+0000", 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715434+0000", 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715443+0000", 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9139999999999997e-06 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715448+0000", 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2530000000000004e-06 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733334+0000", 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017885555000000001 2024-09-14T08:42:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733339+0000", 2024-09-14T08:42:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:42:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:34.639 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:34.641 INFO:teuthology.orchestra.run.smithi188.stdout:5582 trunc from 0x81c2800 to 0xaf28600 2024-09-14T08:42:34.641 INFO:teuthology.orchestra.run.smithi188.stdout:5583 punch from 0xa24ac00 to 0xa256400, (0xb800 bytes) 2024-09-14T08:42:34.641 INFO:teuthology.orchestra.run.smithi188.stdout:5584 read 0x5fee600 thru 0x5ff271b (0x411c bytes) 2024-09-14T08:42:34.641 INFO:teuthology.orchestra.run.smithi188.stdout:5586 write 0xc5bba00 thru 0xc5c6bf9 (0xb1fa bytes) 2024-09-14T08:42:34.641 INFO:teuthology.orchestra.run.smithi188.stdout:5587 punch from 0x8a79000 to 0x8a81600, (0x8600 bytes) 2024-09-14T08:42:34.642 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:34.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:34.642 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:34.643 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:34.643 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:34.644 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:34.644 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:34.644 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:34.638+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:34.651 INFO:teuthology.orchestra.run.smithi188.stdout:5588 trunc from 0xc5c6c00 to 0x8f0a200 2024-09-14T08:42:34.724 INFO:teuthology.orchestra.run.smithi188.stdout:5589 read 0x4b65200 thru 0x4b6c129 (0x6f2a bytes) 2024-09-14T08:42:34.725 INFO:teuthology.orchestra.run.smithi188.stdout:5590 read 0x6db5400 thru 0x6db9b30 (0x4731 bytes) 2024-09-14T08:42:34.741 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:34.740+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:34.752 INFO:teuthology.orchestra.run.smithi188.stdout:5591 write 0xbcbf600 thru 0xbcc2824 (0x3225 bytes) 2024-09-14T08:42:34.758 INFO:teuthology.orchestra.run.smithi188.stdout:5598 trunc from 0xbcc2a00 to 0xa08dc00 2024-09-14T08:42:34.822 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:34.822 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:34.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:34.842 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:34.840+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:34.846 INFO:teuthology.orchestra.run.smithi188.stdout:5600 trunc from 0xa08dc00 to 0x5e50c00 2024-09-14T08:42:34.862 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:34.888 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:34.888 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:34.938 INFO:teuthology.orchestra.run.smithi188.stdout:5601 trunc from 0x5e50c00 to 0xb376e00 2024-09-14T08:42:34.955 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:34.954+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:34.961 INFO:teuthology.orchestra.run.smithi188.stdout:5603 read 0x544d800 thru 0x545a8f2 (0xd0f3 bytes) 2024-09-14T08:42:34.963 INFO:teuthology.orchestra.run.smithi188.stdout:5604 read 0x965ca00 thru 0x9662163 (0x5764 bytes) 2024-09-14T08:42:34.963 INFO:teuthology.orchestra.run.smithi188.stdout:5607 read 0x700a600 thru 0x700a66c (0x6d bytes) 2024-09-14T08:42:34.963 INFO:teuthology.orchestra.run.smithi188.stdout:5608 read 0x9b1c200 thru 0x9b263d0 (0xa1d1 bytes) 2024-09-14T08:42:34.968 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:34.968 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:34.982 INFO:teuthology.orchestra.run.smithi188.stdout:5609 trunc from 0xb376e00 to 0xd64c600 2024-09-14T08:42:34.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:35.028 INFO:teuthology.orchestra.run.smithi188.stdout:5611 trunc from 0xd64c600 to 0x839de00 2024-09-14T08:42:35.059 INFO:teuthology.orchestra.run.smithi188.stdout:5615 read 0x17b2e00 thru 0x17b6349 (0x354a bytes) 2024-09-14T08:42:35.062 INFO:teuthology.orchestra.run.smithi188.stdout:5616 read 0x79d7400 thru 0x79e711f (0xfd20 bytes) 2024-09-14T08:42:35.071 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:35.070+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:35.126 INFO:teuthology.orchestra.run.smithi188.stdout:5618 trunc from 0x839de00 to 0x162a600 2024-09-14T08:42:35.144 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:35.140+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:35.155 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:35.155 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:35.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:35.245 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:35.244+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:35.328 INFO:teuthology.orchestra.run.smithi188.stdout:5619 write 0x8a8f800 thru 0x8a9136a (0x1b6b bytes) 2024-09-14T08:42:35.330 INFO:teuthology.orchestra.run.smithi188.stdout:5623 punch from 0x5975a00 to 0x597ba00, (0x6000 bytes) 2024-09-14T08:42:35.346 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:35.342+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:35.374 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:35.374 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:35.384 INFO:teuthology.orchestra.run.smithi188.stdout:5624 write 0xd25b200 thru 0xd25b8d5 (0x6d6 bytes) 2024-09-14T08:42:35.385 INFO:teuthology.orchestra.run.smithi188.stdout:5625 read 0xcafe400 thru 0xcafe5d3 (0x1d4 bytes) 2024-09-14T08:42:35.386 INFO:teuthology.orchestra.run.smithi188.stdout:5626 read 0x1336e00 thru 0x133fde9 (0x8fea bytes) 2024-09-14T08:42:35.387 INFO:teuthology.orchestra.run.smithi188.stdout:5629 write 0xd1b7c00 thru 0xd1baea5 (0x32a6 bytes) 2024-09-14T08:42:35.388 INFO:teuthology.orchestra.run.smithi188.stdout:5630 punch from 0xce30e00 to 0xce35200, (0x4400 bytes) 2024-09-14T08:42:35.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:35.389 INFO:teuthology.orchestra.run.smithi188.stdout:5631 write 0x47b600 thru 0x481dce (0x67cf bytes) 2024-09-14T08:42:35.391 INFO:teuthology.orchestra.run.smithi188.stdout:5632 write 0x8e57600 thru 0x8e5d7b3 (0x61b4 bytes) 2024-09-14T08:42:35.392 INFO:teuthology.orchestra.run.smithi188.stdout:5633 read 0x92ec00 thru 0x93578f (0x6b90 bytes) 2024-09-14T08:42:35.397 INFO:teuthology.orchestra.run.smithi188.stdout:5634 trunc from 0xd25ba00 to 0xb5f0200 2024-09-14T08:42:35.447 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:35.444+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:35.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:42:35.548 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:35.544+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:35.608 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:35.608 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:35.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:35.651 INFO:teuthology.orchestra.run.smithi188.stdout:5635 write 0xb9b8000 thru 0xb9bb7b3 (0x37b4 bytes) 2024-09-14T08:42:35.652 INFO:teuthology.orchestra.run.smithi188.stdout:5638 read 0x2268800 thru 0x226d23d (0x4a3e bytes) 2024-09-14T08:42:35.652 INFO:teuthology.orchestra.run.smithi188.stdout:5640 read 0xb6a3000 thru 0xb6af87c (0xc87d bytes) 2024-09-14T08:42:35.652 INFO:teuthology.orchestra.run.smithi188.stdout:5641 read 0x5f75a00 thru 0x5f7f7bd (0x9dbe bytes) 2024-09-14T08:42:35.652 INFO:teuthology.orchestra.run.smithi188.stdout:5642 read 0x6a97200 thru 0x6a9ef7b (0x7d7c bytes) 2024-09-14T08:42:35.653 INFO:teuthology.orchestra.run.smithi188.stdout:5644 read 0x3741800 thru 0x375068e (0xee8f bytes) 2024-09-14T08:42:35.653 INFO:teuthology.orchestra.run.smithi188.stdout:5645 write 0x9872600 thru 0x9880d4c (0xe74d bytes) 2024-09-14T08:42:35.665 INFO:teuthology.orchestra.run.smithi188.stdout:5646 trunc from 0xb9bb800 to 0x5ff3800 2024-09-14T08:42:35.671 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:35.670+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:35.741 INFO:teuthology.orchestra.run.smithi188.stdout:5648 punch from 0x47f5800 to 0x47fd600, (0x7e00 bytes) 2024-09-14T08:42:35.750 INFO:teuthology.orchestra.run.smithi188.stdout:5649 trunc from 0x5ff3800 to 0x3fd5a00 2024-09-14T08:42:35.750 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:35.746+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:35.760 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:35.760 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:35.776 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:35.812 INFO:teuthology.orchestra.run.smithi188.stdout:5652 read 0x3663800 thru 0x3671e59 (0xe65a bytes) 2024-09-14T08:42:35.817 INFO:teuthology.orchestra.run.smithi188.stdout:5654 trunc from 0x3fd5a00 to 0x509f400 2024-09-14T08:42:35.832 INFO:teuthology.orchestra.run.smithi188.stdout:5655 read 0x358ce00 thru 0x359be6d (0xf06e bytes) 2024-09-14T08:42:35.832 INFO:teuthology.orchestra.run.smithi188.stdout:5656 trunc from 0x509f400 to 0x52c1000 2024-09-14T08:42:35.846 INFO:teuthology.orchestra.run.smithi188.stdout:5657 punch from 0xcf000 to 0xda800, (0xb800 bytes) 2024-09-14T08:42:35.848 INFO:teuthology.orchestra.run.smithi188.stdout:5658 write 0x49c2a00 thru 0x49c6966 (0x3f67 bytes) 2024-09-14T08:42:35.848 INFO:teuthology.orchestra.run.smithi188.stdout:5659 read 0x3d2c00 thru 0x3da8eb (0x7cec bytes) 2024-09-14T08:42:35.851 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:35.846+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:35.903 INFO:teuthology.orchestra.run.smithi188.stdout:5660 write 0x9a15e00 thru 0x9a1bf12 (0x6113 bytes) 2024-09-14T08:42:35.904 INFO:teuthology.orchestra.run.smithi188.stdout:5661 read 0x88b3c00 thru 0x88c37ca (0xfbcb bytes) 2024-09-14T08:42:35.906 INFO:teuthology.orchestra.run.smithi188.stdout:5663 trunc from 0x9a1c000 to 0xa674600 2024-09-14T08:42:35.916 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:35.916 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:35.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:35.944 INFO:teuthology.orchestra.run.smithi188.stdout:5664 read 0x9a43c00 thru 0x9a47dc1 (0x41c2 bytes) 2024-09-14T08:42:35.946 INFO:teuthology.orchestra.run.smithi188.stdout:5666 punch from 0x1d19400 to 0x1d1bc00, (0x2800 bytes) 2024-09-14T08:42:35.947 INFO:teuthology.orchestra.run.smithi188.stdout:5667 clone 35 order 25 su 16777216 sc 15 2024-09-14T08:42:35.951 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:35.950+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:36.053 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:36.050+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:36.057 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:36.057 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:36.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:36.153 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:36.152+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:36.196 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:36.196 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:36.210 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:36.254 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:36.250+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:36.354 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:36.352+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:36.374 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:36.375 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:36.389 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:36.455 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:36.454+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:36.500 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:42:36.556 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:36.552+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:36.562 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:36.562 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:36.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:36.669 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:36.668+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:36.733 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone34 from 0xa674600 (overlap 0x162a600) to 0x237600 2024-09-14T08:42:36.761 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:36.756+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:36.765 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:36.766 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:36.787 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:36.861 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:36.854+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:36.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:36.959 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:36.956+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:36.971 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:36.971 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:36.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:37.059 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:37.059 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:37.073 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:37.072+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:37.076 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:37.076 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:37.092 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:37.092 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:37.112 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:37.112 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:37.131 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:37.131 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:37.152 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:37.152 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:37.153 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:37.153 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:37.153 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:37.153 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:37.153 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:37.161 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:37.160+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:37.166 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:37.262 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:37.260+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:37.340 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:37.340 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 156.26257348199999, 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:37.341 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:42:37.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 156.26251627799999, 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:42:37.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:42:37.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 156.26245739399999, 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 156.262392468, 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:42:37.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:42:37.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:42:37.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:42:37.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 156.26233101700001, 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:42:37.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:42:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:37.362 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 156.26227148300001, 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:42:37.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:42:37.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 156.26221217299999, 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.367 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:37.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 156.262140141, 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:42:37.371 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:37.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.375 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 132.10743976399999, 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:37.376 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 132.10740833899999, 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.380 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:42:37.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.743544718999999, 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:37.385 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:42:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:42:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.743485368999998, 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:42:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:42:37.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.396 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.743445417000004, 2024-09-14T08:42:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:42:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:37.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.402 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.260022464000002, 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:42:37.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:37.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.253629898, 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:37.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.494040478000002, 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:37.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:37.421 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.453301076000002, 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:42:37.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:42:37.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:42:37.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.185729991999999, 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.428 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:42:37.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:42:37.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.434 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.121926098000003, 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.435 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:37.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:42:37.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.441 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.094454399999996, 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:37.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:42:37.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:42:37.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:37.449 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:37.449 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:37.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:37.450 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:37.448+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-14T08:42:37.548 INFO:teuthology.orchestra.run.smithi188.stdout:5669 write 0x8114200 thru 0x81149f6 (0x7f7 bytes) 2024-09-14T08:42:37.549 INFO:teuthology.orchestra.run.smithi188.stdout:5673 read 0x771400 thru 0x77c830 (0xb431 bytes) 2024-09-14T08:42:37.551 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:37.550+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:37.583 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:37.583 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:37.583 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:37.583 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:37.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:37.623 INFO:teuthology.orchestra.run.smithi188.stdout:5674 trunc from 0xa674600 to 0x421c400 2024-09-14T08:42:37.653 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:37.648+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:37.754 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:37.752+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:37.764 INFO:teuthology.orchestra.run.smithi188.stdout:5676 trunc from 0x421c400 to 0xe63de00 2024-09-14T08:42:37.770 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:37.770 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:37.770 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:37.770 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:37.770 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:37.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:37.792 INFO:teuthology.orchestra.run.smithi188.stdout:5678 write 0xdd0c600 thru 0xdd0dd19 (0x171a bytes) 2024-09-14T08:42:37.793 INFO:teuthology.orchestra.run.smithi188.stdout:5679 read 0xae63000 thru 0xae6cf1a (0x9f1b bytes) 2024-09-14T08:42:37.806 INFO:teuthology.orchestra.run.smithi188.stdout:5681 trunc from 0xe63de00 to 0x8fe6800 2024-09-14T08:42:37.840 INFO:teuthology.orchestra.run.smithi188.stdout:5682 write 0x6f46600 thru 0x6f4fee2 (0x98e3 bytes) 2024-09-14T08:42:37.844 INFO:teuthology.orchestra.run.smithi188.stdout:5683 trunc from 0x8fe6800 to 0x85c2e00 2024-09-14T08:42:37.854 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:37.850+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:37.897 INFO:teuthology.orchestra.run.smithi188.stdout:5684 write 0x99d9e00 thru 0x99e480d (0xaa0e bytes) 2024-09-14T08:42:37.899 INFO:teuthology.orchestra.run.smithi188.stdout:5688 write 0x3fe1600 thru 0x3ff0ab6 (0xf4b7 bytes) 2024-09-14T08:42:37.922 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.963256734000002, 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:37.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:42:37.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:42:37.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.962059648, 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:42:37.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.932 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.961996956, 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.961959209, 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.937 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:42:37.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.961862146000001, 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.942 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.961781298999998, 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.947 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:42:37.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.569774949999999, 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:42:37.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:42:37.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3187 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 557056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714670+0000", 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2080772890000002, 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018249897000000001, 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:37.958 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3187 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714670+0000", 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714670+0000", 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714671+0000", 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7800000000000001e-07 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714673+0000", 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1459999999999999e-06 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714679+0000", 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1009999999999997e-06 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714683+0000", 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4730000000000002e-06 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.731957+0000", 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017273147999999999 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732019+0000", 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2051999999999995e-05 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732920+0000", 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00090139899999999999 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3190 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:37.962 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714734+0000", 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2080133870000003, 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018244785999999999, 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3190 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714734+0000", 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714734+0000", 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714734+0000", 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9799999999999999e-07 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714741+0000", 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714747+0000", 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469999999999999e-06 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714753+0000", 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1669999999999998e-06 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732966+0000", 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018213000999999999 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732979+0000", 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3256e-05 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3191 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:37.966 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714760+0000", 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2079874359999998, 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018258124000000001, 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3191 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714760+0000", 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714760+0000", 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714760+0000", 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9499999999999998e-07 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714762+0000", 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0480000000000001e-06 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714769+0000", 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2419999999999997e-06 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714773+0000", 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.758e-06 2024-09-14T08:42:37.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733012+0000", 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018238780999999999 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733018+0000", 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9000000000000003e-06 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3192 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714780+0000", 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2079672239999999, 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018278793000000002, 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3192 2024-09-14T08:42:37.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714780+0000", 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714780+0000", 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714781+0000", 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6800000000000001e-07 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714783+0000", 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1100000000000001e-06 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714789+0000", 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3729999999999998e-06 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714795+0000", 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5140000000000001e-06 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733050+0000", 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018255052000000001 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733059+0000", 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3759999999999997e-06 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3193 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714802+0000", 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2079451969999999, 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018271716, 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3193 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.975 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714802+0000", 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714802+0000", 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714803+0000", 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2500000000000001e-07 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714805+0000", 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4430000000000002e-06 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714812+0000", 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5490000000000003e-06 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714817+0000", 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9520000000000002e-06 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733070+0000", 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018252877000000001 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733074+0000", 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4700000000000004e-06 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3194 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714825+0000", 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2079227379999997, 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018291040000000001, 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3194 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714825+0000", 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714825+0000", 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714825+0000", 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9500000000000002e-07 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714828+0000", 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4789999999999999e-06 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714834+0000", 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4200000000000004e-06 2024-09-14T08:42:37.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714839+0000", 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7029999999999997e-06 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733107+0000", 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018267945000000001 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733116+0000", 2024-09-14T08:42:37.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8980000000000002e-06 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3196 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:22 [read 1474560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714867+0000", 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2078805749999999, 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017712182, 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.983 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3196 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714867+0000", 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714867+0000", 2024-09-14T08:42:37.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714867+0000", 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4700000000000001e-07 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714870+0000", 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.43e-06 2024-09-14T08:42:37.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714876+0000", 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6039999999999998e-06 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714882+0000", 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1000000000000003e-06 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732429+0000", 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017547719 2024-09-14T08:42:37.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732493+0000", 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3689999999999995e-05 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.732579+0000", 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6092000000000002e-05 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3197 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714889+0000", 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2078583329999999, 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018261672999999999, 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3197 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.988 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714889+0000", 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714889+0000", 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714890+0000", 2024-09-14T08:42:37.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1100000000000001e-07 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714892+0000", 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3149999999999999e-06 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714898+0000", 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5390000000000004e-06 2024-09-14T08:42:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714905+0000", 2024-09-14T08:42:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6030000000000001e-06 2024-09-14T08:42:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733145+0000", 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018239671999999998 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733151+0000", 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1330000000000004e-06 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3199 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.714934+0000", 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2078134279999997, 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018263010999999999, 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3199 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714934+0000", 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714934+0000", 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714934+0000", 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2500000000000001e-07 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714937+0000", 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.452e-06 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714944+0000", 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6059999999999999e-06 2024-09-14T08:42:37.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.714948+0000", 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7389999999999999e-06 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733185+0000", 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018236669 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:37.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733197+0000", 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2119999999999999e-05 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3202 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.715023+0000", 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2077249529999996, 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018219775000000001, 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3202 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715023+0000", 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:37.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715023+0000", 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715023+0000", 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1699999999999998e-07 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715030+0000", 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.187e-06 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:37.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715037+0000", 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8530000000000003e-06 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715044+0000", 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9349999999999997e-06 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733233+0000", 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01818877 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733242+0000", 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5130000000000002e-06 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3204 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.715075+0000", 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2076726229999997, 2024-09-14T08:42:38.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018202200000000002, 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3204 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715075+0000", 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715075+0000", 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715075+0000", 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1699999999999998e-07 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715078+0000", 2024-09-14T08:42:38.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3209999999999999e-06 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715084+0000", 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5560000000000004e-06 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715089+0000", 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2599999999999996e-06 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733268+0000", 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018178155000000001 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733277+0000", 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3910000000000004e-06 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.005 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3208 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.715284+0000", 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2074630089999996, 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018021391000000001, 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3208 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715284+0000", 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715284+0000", 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715285+0000", 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4199999999999995e-07 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715302+0000", 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7022999999999999e-05 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715377+0000", 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4789000000000005e-05 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715399+0000", 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2116e-05 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733297+0000", 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017898038000000002 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733306+0000", 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7830000000000004e-06 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6255.0:3210 3.6 3.79ff6346 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e153)", 2024-09-14T08:42:38.009 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:32.715431+0000", 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2073166969999996, 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017907939000000001, 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6255", 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3242839375", 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3210 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715431+0000", 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715431+0000", 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715431+0000", 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-14T08:42:38.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715434+0000", 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715443+0000", 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9139999999999997e-06 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.715448+0000", 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2530000000000004e-06 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733334+0000", 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017885555000000001 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:32.733339+0000", 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:42:38.013 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.014 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.014 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.014 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.014 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.014 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:38.015 INFO:teuthology.orchestra.run.smithi188.stdout:5689 write 0xbe61800 thru 0xbe66f31 (0x5732 bytes) 2024-09-14T08:42:38.015 INFO:teuthology.orchestra.run.smithi188.stdout:5692 write 0x607dc00 thru 0x6087116 (0x9517 bytes) 2024-09-14T08:42:38.015 INFO:teuthology.orchestra.run.smithi188.stdout:5694 punch from 0x1f04c00 to 0x1f13400, (0xe800 bytes) 2024-09-14T08:42:38.016 INFO:teuthology.orchestra.run.smithi188.stdout:5698 write 0x44d3600 thru 0x44e2a77 (0xf478 bytes) 2024-09-14T08:42:38.016 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:38.014+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:38.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:38.080 INFO:teuthology.orchestra.run.smithi188.stdout:5700 write 0xd785000 thru 0xd78f9d4 (0xa9d5 bytes) 2024-09-14T08:42:38.113 INFO:teuthology.orchestra.run.smithi188.stdout:5702 trunc from 0xd78fa00 to 0x2cd0400 2024-09-14T08:42:38.116 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:38.112+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:38.190 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:38.190 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:38.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.190 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.6324.0:2250 3.6 e156/144 3:60f35f84:::rbd_object_map.10f16ef41219:head v 156'1987, mlcod=156'1985)", 2024-09-14T08:42:38.190 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.190783+0000", 2024-09-14T08:42:38.190 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021393409999999999, 2024-09-14T08:42:38.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021554719999999999, 2024-09-14T08:42:38.190 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.190 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.190783+0000", 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.190783+0000", 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.190785+0000", 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.683e-06 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.190796+0000", 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0890000000000001e-05 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.190822+0000", 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6333e-05 2024-09-14T08:42:38.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.190835+0000", 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2816000000000001e-05 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.190954+0000", 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119585 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.191004+0000", 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9348000000000003e-05 2024-09-14T08:42:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.194 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.194 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.194 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.194 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-14T08:42:38.194 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 1 2024-09-14T08:42:38.194 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:38.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:38.217 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:38.216+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:38.263 INFO:teuthology.orchestra.run.smithi188.stdout:5703 write 0xa787400 thru 0xa792fec (0xbbed bytes) 2024-09-14T08:42:38.265 INFO:teuthology.orchestra.run.smithi188.stdout:5705 read 0x953a200 thru 0x9544936 (0xa737 bytes) 2024-09-14T08:42:38.265 INFO:teuthology.orchestra.run.smithi188.stdout:5706 write 0x9ba0200 thru 0x9baeaf1 (0xe8f2 bytes) 2024-09-14T08:42:38.266 INFO:teuthology.orchestra.run.smithi188.stdout:5707 write 0x9a66e00 thru 0x9a733c2 (0xc5c3 bytes) 2024-09-14T08:42:38.266 INFO:teuthology.orchestra.run.smithi188.stdout:5708 write 0x9b44000 thru 0x9b4ee0c (0xae0d bytes) 2024-09-14T08:42:38.285 INFO:teuthology.orchestra.run.smithi188.stdout:5709 trunc from 0xa793000 to 0x32fd000 2024-09-14T08:42:38.318 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:38.316+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:38.338 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:38.338 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:38.338 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:38.338 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:38.338 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:38.349 INFO:teuthology.orchestra.run.smithi188.stdout:5711 trunc from 0x32fd000 to 0x26cfc00 2024-09-14T08:42:38.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:38.392 INFO:teuthology.orchestra.run.smithi188.stdout:5712 trunc from 0x26cfc00 to 0xd6f1000 2024-09-14T08:42:38.408 INFO:teuthology.orchestra.run.smithi188.stdout:5713 read 0x285f800 thru 0x286e2f5 (0xeaf6 bytes) 2024-09-14T08:42:38.411 INFO:teuthology.orchestra.run.smithi188.stdout:5716 read 0x38f9400 thru 0x38fc7db (0x33dc bytes) 2024-09-14T08:42:38.418 INFO:teuthology.orchestra.run.smithi188.stdout:5718 trunc from 0xd6f1000 to 0x9bb9e00 2024-09-14T08:42:38.419 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:38.416+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:38.439 INFO:teuthology.orchestra.run.smithi188.stdout:5719 read 0x93a3200 thru 0x93b00ca (0xcecb bytes) 2024-09-14T08:42:38.441 INFO:teuthology.orchestra.run.smithi188.stdout:5720 punch from 0x128b400 to 0x128fc00, (0x4800 bytes) 2024-09-14T08:42:38.447 INFO:teuthology.orchestra.run.smithi188.stdout:5721 trunc from 0x9bb9e00 to 0xc3f4600 2024-09-14T08:42:38.485 INFO:teuthology.orchestra.run.smithi188.stdout:5722 trunc from 0xc3f4600 to 0x277f600 2024-09-14T08:42:38.492 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 161.566670448, 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 161.56661567, 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:42:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:42:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 148.13884521099999, 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 125.146241144, 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:42:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 125.145402773, 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:42:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.126894672000006, 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:42:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:42:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.126580462999996, 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:42:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.124944137, 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.124726178000003, 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:42:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:42:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:42:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:42:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:42:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.124430775999997, 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:42:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.124159941000002, 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:42:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:42:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:42:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.912969259999997, 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:42:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.912949225999995, 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:42:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:42:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.912928148000006, 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:42:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.912908553999998, 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:42:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.9128884, 2024-09-14T08:42:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.912869004000001, 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:42:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.906339204000005, 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:42:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:42:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:42:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:42:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.906319318000001, 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:42:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:42:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:42:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:42:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.906299943999997, 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:42:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:38.589 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:38.590 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 4, 5, 0, 3] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:42:38.590 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T08:42:38.590 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:42:38.592 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:38.588+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:38.592 INFO:teuthology.orchestra.run.smithi188.stdout:5723 write 0x91ccc00 thru 0x91d3509 (0x690a bytes) 2024-09-14T08:42:38.592 INFO:teuthology.orchestra.run.smithi188.stdout:5725 write 0x9d92800 thru 0x9d9b774 (0x8f75 bytes) 2024-09-14T08:42:38.592 INFO:teuthology.orchestra.run.smithi188.stdout:5726 read 0x3305a00 thru 0x3309e13 (0x4414 bytes) 2024-09-14T08:42:38.593 INFO:teuthology.orchestra.run.smithi188.stdout:5727 trunc from 0x9d9b800 to 0x8fffa00 2024-09-14T08:42:38.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:38.604 INFO:teuthology.orchestra.run.smithi188.stdout:5731 read 0x7f2b000 thru 0x7f33043 (0x8044 bytes) 2024-09-14T08:42:38.607 INFO:teuthology.orchestra.run.smithi188.stdout:5732 trunc from 0x8fffa00 to 0x8730800 2024-09-14T08:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout:5735 write 0xe4a4600 thru 0xe4adbf0 (0x95f1 bytes) 2024-09-14T08:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout:5738 punch from 0x9d79000 to 0x9d88c00, (0xfc00 bytes) 2024-09-14T08:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout:5739 write 0x84c1000 thru 0x84ceb94 (0xdb95 bytes) 2024-09-14T08:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout:5744 write 0x13a00 thru 0x15197 (0x1798 bytes) 2024-09-14T08:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout:5745 trunc from 0xe4adc00 to 0x6167200 2024-09-14T08:42:38.735 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:38.726+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:38.793 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:38.792+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:38.871 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:38.871 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:38.871 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:38.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:38.894 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:38.896+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:38.995 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:38.990+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:39.041 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:39.041 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:39.041 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:39.041 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:39.041 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:39.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:39.095 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:39.094+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:39.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:39.215 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:39.214+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:39.217 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:39.217 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:39.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:39.217 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 148.913468255, 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:42:39.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 116.65135807599999, 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:42:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 116.651210905, 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:42:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:42:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 116.651069105, 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:42:39.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:39.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.087803338000001, 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:42:39.239 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:42:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.243 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.079512047999998, 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.079488806999997, 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:39.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:42:39.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:42:39.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.079469543000002, 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.252 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:42:39.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.079450266999999, 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:42:39.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.260 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.079237814000003, 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.264 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.072024720999998, 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.265 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.072003508999998, 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.269 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:42:39.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:42:39.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.071984159000003, 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.273 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:42:39.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.277 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.07195712, 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:42:39.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.07193797, 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.282 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:42:39.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.071916385999998, 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:42:39.286 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:42:39.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.290 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.071896977000002, 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.291 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.071878101000003, 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:42:39.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:39.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:39.299 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.063847265, 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:39.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:42:39.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:42:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:42:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:42:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:42:39.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 56.063820868999997, 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:39.309 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:39.309 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:39.310 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:39.311 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:39.308+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:39.314 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:39.314 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:39.331 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:39.331 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:39.348 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:39.372 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:39.372 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:39.391 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:39.408 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:39.408 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:39.410 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:39.408+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:39.443 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:39.444 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:39.459 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:39.486 INFO:teuthology.orchestra.run.smithi188.stdout:5746 write 0x6c3a200 thru 0x6c3efed (0x4dee bytes) 2024-09-14T08:42:39.488 INFO:teuthology.orchestra.run.smithi188.stdout:5749 punch from 0x1103400 to 0x1109800, (0x6400 bytes) 2024-09-14T08:42:39.489 INFO:teuthology.orchestra.run.smithi188.stdout:5751 punch from 0x471da00 to 0x4720400, (0x2a00 bytes) 2024-09-14T08:42:39.489 INFO:teuthology.orchestra.run.smithi188.stdout:5753 read 0x46a2c00 thru 0x46a5b7d (0x2f7e bytes) 2024-09-14T08:42:39.490 INFO:teuthology.orchestra.run.smithi188.stdout:5756 write 0x5b7ce00 thru 0x5b80418 (0x3619 bytes) 2024-09-14T08:42:39.490 INFO:teuthology.orchestra.run.smithi188.stdout:5759 read 0x5c60000 thru 0x5c648d5 (0x48d6 bytes) 2024-09-14T08:42:39.490 INFO:teuthology.orchestra.run.smithi188.stdout:5760 read 0x91d800 thru 0x92cd00 (0xf501 bytes) 2024-09-14T08:42:39.492 INFO:teuthology.orchestra.run.smithi188.stdout:5761 read 0x65b7200 thru 0x65b8386 (0x1187 bytes) 2024-09-14T08:42:39.492 INFO:teuthology.orchestra.run.smithi188.stdout:5764 write 0x359a600 thru 0x359c6aa (0x20ab bytes) 2024-09-14T08:42:39.492 INFO:teuthology.orchestra.run.smithi188.stdout:5767 read 0x41c1200 thru 0x41ccf56 (0xbd57 bytes) 2024-09-14T08:42:39.492 INFO:teuthology.orchestra.run.smithi188.stdout:5770 read 0x3267600 thru 0x326d3e3 (0x5de4 bytes) 2024-09-14T08:42:39.493 INFO:teuthology.orchestra.run.smithi188.stdout:5771 read 0x1632200 thru 0x163ef87 (0xcd88 bytes) 2024-09-14T08:42:39.503 INFO:teuthology.orchestra.run.smithi188.stdout:5772 trunc from 0x6c3f000 to 0x424ae00 2024-09-14T08:42:39.511 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:39.510+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:39.514 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T08:42:39.514 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:42:39.541 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T08:42:39.557 INFO:teuthology.orchestra.run.smithi188.stdout:5773 punch from 0x2fdd800 to 0x2feba00, (0xe200 bytes) 2024-09-14T08:42:39.559 INFO:teuthology.orchestra.run.smithi188.stdout:5776 punch from 0x1416e00 to 0x1417a00, (0xc00 bytes) 2024-09-14T08:42:39.560 INFO:teuthology.orchestra.run.smithi188.stdout:5782 read 0x1baba00 thru 0x1bb99e8 (0xdfe9 bytes) 2024-09-14T08:42:39.595 INFO:teuthology.orchestra.run.smithi188.stdout:5783 write 0xd1c9400 thru 0xd1cef07 (0x5b08 bytes) 2024-09-14T08:42:39.613 INFO:teuthology.orchestra.run.smithi188.stdout:5785 trunc from 0xd1cf000 to 0x5aac200 2024-09-14T08:42:39.625 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:39.625 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:39.635 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:39.634+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:39.641 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:39.681 INFO:teuthology.orchestra.run.smithi188.stdout:5789 write 0xe829600 thru 0xe83171a (0x811b bytes) 2024-09-14T08:42:39.682 INFO:teuthology.orchestra.run.smithi188.stdout:5791 write 0xdf6aa00 thru 0xdf6e594 (0x3b95 bytes) 2024-09-14T08:42:39.707 INFO:teuthology.orchestra.run.smithi188.stdout:5792 trunc from 0xe831800 to 0x31efa00 2024-09-14T08:42:39.712 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:39.710+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:39.756 INFO:teuthology.orchestra.run.smithi188.stdout:5794 punch from 0xfe7a00 to 0xff5e00, (0xe400 bytes) 2024-09-14T08:42:39.759 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:39.759 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:39.759 INFO:teuthology.orchestra.run.smithi188.stdout:5796 read 0x9b4600 thru 0x9b50d8 (0xad9 bytes) 2024-09-14T08:42:39.773 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:39.797 INFO:teuthology.orchestra.run.smithi188.stdout:5799 write 0xb47da00 thru 0xb48a6fb (0xccfc bytes) 2024-09-14T08:42:39.802 INFO:teuthology.orchestra.run.smithi188.stdout:5800 trunc from 0xb48a800 to 0x9e33800 2024-09-14T08:42:39.814 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:39.810+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:39.833 INFO:teuthology.orchestra.run.smithi188.stdout:5801 write 0x471fe00 thru 0x4728713 (0x8914 bytes) 2024-09-14T08:42:39.836 INFO:teuthology.orchestra.run.smithi188.stdout:5803 punch from 0x2080000 to 0x2086200, (0x6200 bytes) 2024-09-14T08:42:39.836 INFO:teuthology.orchestra.run.smithi188.stdout:5804 write 0x34d9800 thru 0x34e22bd (0x8abe bytes) 2024-09-14T08:42:39.837 INFO:teuthology.orchestra.run.smithi188.stdout:5807 read 0x8110200 thru 0x811a313 (0xa114 bytes) 2024-09-14T08:42:39.837 INFO:teuthology.orchestra.run.smithi188.stdout:5808 write 0x2b90800 thru 0x2b91bb5 (0x13b6 bytes) 2024-09-14T08:42:39.839 INFO:teuthology.orchestra.run.smithi188.stdout:5809 write 0x9797400 thru 0x979a243 (0x2e44 bytes) 2024-09-14T08:42:39.840 INFO:teuthology.orchestra.run.smithi188.stdout:5810 read 0x9409c00 thru 0x940bc8e (0x208f bytes) 2024-09-14T08:42:39.840 INFO:teuthology.orchestra.run.smithi188.stdout:5811 read 0x1590c00 thru 0x159ffc5 (0xf3c6 bytes) 2024-09-14T08:42:39.841 INFO:teuthology.orchestra.run.smithi188.stdout:5814 write 0x618c800 thru 0x618e65c (0x1e5d bytes) 2024-09-14T08:42:39.841 INFO:teuthology.orchestra.run.smithi188.stdout:5816 write 0x6440000 thru 0x6447333 (0x7334 bytes) 2024-09-14T08:42:39.841 INFO:teuthology.orchestra.run.smithi188.stdout:5821 write 0x37d6800 thru 0x37d71d5 (0x9d6 bytes) 2024-09-14T08:42:39.841 INFO:teuthology.orchestra.run.smithi188.stdout:5822 read 0x6c7bc00 thru 0x6c82b36 (0x6f37 bytes) 2024-09-14T08:42:39.842 INFO:teuthology.orchestra.run.smithi188.stdout:5823 read 0x1a29400 thru 0x1a2edce (0x59cf bytes) 2024-09-14T08:42:39.842 INFO:teuthology.orchestra.run.smithi188.stdout:5825 punch from 0x715de00 to 0x7161800, (0x3a00 bytes) 2024-09-14T08:42:39.843 INFO:teuthology.orchestra.run.smithi188.stdout:5827 punch from 0x4384400 to 0x4390400, (0xc000 bytes) 2024-09-14T08:42:39.843 INFO:teuthology.orchestra.run.smithi188.stdout:5828 read 0xaf4c00 thru 0xaf7a75 (0x2e76 bytes) 2024-09-14T08:42:39.844 INFO:teuthology.orchestra.run.smithi188.stdout:5830 read 0xd03800 thru 0xd0a062 (0x6863 bytes) 2024-09-14T08:42:39.853 INFO:teuthology.orchestra.run.smithi188.stdout:5832 trunc from 0x9e33800 to 0x5e10c00 2024-09-14T08:42:39.898 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:39.899 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:39.904 INFO:teuthology.orchestra.run.smithi188.stdout:5833 punch from 0x4817e00 to 0x481d600, (0x5800 bytes) 2024-09-14T08:42:39.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:39.917 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:39.914+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:39.937 INFO:teuthology.orchestra.run.smithi188.stdout:5834 write 0xa2fbe00 thru 0xa3085bf (0xc7c0 bytes) 2024-09-14T08:42:39.940 INFO:teuthology.orchestra.run.smithi188.stdout:5835 read 0x8fddc00 thru 0x8fe11e9 (0x35ea bytes) 2024-09-14T08:42:39.940 INFO:teuthology.orchestra.run.smithi188.stdout:5836 write 0x847f600 thru 0x8480e61 (0x1862 bytes) 2024-09-14T08:42:39.940 INFO:teuthology.orchestra.run.smithi188.stdout:5837 read 0x8729a00 thru 0x8738ba4 (0xf1a5 bytes) 2024-09-14T08:42:39.947 INFO:teuthology.orchestra.run.smithi188.stdout:5838 trunc from 0xa308600 to 0x7ba7c00 2024-09-14T08:42:39.987 INFO:teuthology.orchestra.run.smithi188.stdout:5843 write 0x3dcae00 thru 0x3dd977f (0xe980 bytes) 2024-09-14T08:42:39.990 INFO:teuthology.orchestra.run.smithi188.stdout:5844 read 0x24d8400 thru 0x24e2382 (0x9f83 bytes) 2024-09-14T08:42:39.993 INFO:teuthology.orchestra.run.smithi188.stdout:5845 trunc from 0x7ba7c00 to 0x6b74e00 2024-09-14T08:42:40.016 INFO:teuthology.orchestra.run.smithi188.stdout:5848 write 0xcbe600 thru 0xcc6422 (0x7e23 bytes) 2024-09-14T08:42:40.017 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:40.014+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:40.040 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:40.040 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:40.054 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:40.065 INFO:teuthology.orchestra.run.smithi188.stdout:5849 trunc from 0x6b74e00 to 0x117800 2024-09-14T08:42:40.118 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:40.116+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:40.179 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:40.180 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:40.193 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:40.199 INFO:teuthology.orchestra.run.smithi188.stdout:5850 trunc from 0x117800 to 0xde67800 2024-09-14T08:42:40.227 INFO:teuthology.orchestra.run.smithi188.stdout:5852 write 0x2bd3200 thru 0x2bd60b4 (0x2eb5 bytes) 2024-09-14T08:42:40.234 INFO:teuthology.orchestra.run.smithi188.stdout:5855 trunc from 0xde67800 to 0xb569400 2024-09-14T08:42:40.237 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:40.236+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:40.317 INFO:teuthology.orchestra.run.smithi188.stdout:5856 write 0xeca0e00 thru 0xeca5a6d (0x4c6e bytes) 2024-09-14T08:42:40.319 INFO:teuthology.orchestra.run.smithi188.stdout:5858 read 0x567b200 thru 0x56833e8 (0x81e9 bytes) 2024-09-14T08:42:40.319 INFO:teuthology.orchestra.run.smithi188.stdout:5859 punch from 0x3225000 to 0x3229600, (0x4600 bytes) 2024-09-14T08:42:40.319 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:40.316+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:40.320 INFO:teuthology.orchestra.run.smithi188.stdout:5860 read 0x78da000 thru 0x78db6c1 (0x16c2 bytes) 2024-09-14T08:42:40.320 INFO:teuthology.orchestra.run.smithi188.stdout:5861 write 0xa23800 thru 0xa2f934 (0xc135 bytes) 2024-09-14T08:42:40.324 INFO:teuthology.orchestra.run.smithi188.stdout:5862 write 0xdaf4800 thru 0xdaffeef (0xb6f0 bytes) 2024-09-14T08:42:40.324 INFO:teuthology.orchestra.run.smithi188.stdout:5863 punch from 0x36c3c00 to 0x36cc400, (0x8800 bytes) 2024-09-14T08:42:40.343 INFO:teuthology.orchestra.run.smithi188.stdout:5865 trunc from 0xeca5c00 to 0x575c000 2024-09-14T08:42:40.365 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:40.366 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:40.380 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:40.396 INFO:teuthology.orchestra.run.smithi188.stdout:5867 read 0x30b4e00 thru 0x30b56a9 (0x8aa bytes) 2024-09-14T08:42:40.401 INFO:teuthology.orchestra.run.smithi188.stdout:5869 read 0x42ece00 thru 0x42f3bd9 (0x6dda bytes) 2024-09-14T08:42:40.401 INFO:teuthology.orchestra.run.smithi188.stdout:5872 read 0x2f8800 thru 0x2fdbaf (0x53b0 bytes) 2024-09-14T08:42:40.404 INFO:teuthology.orchestra.run.smithi188.stdout:5874 read 0x2ee5a00 thru 0x2ee7db8 (0x23b9 bytes) 2024-09-14T08:42:40.405 INFO:teuthology.orchestra.run.smithi188.stdout:5875 read 0x5592a00 thru 0x55a18ab (0xeeac bytes) 2024-09-14T08:42:40.406 INFO:teuthology.orchestra.run.smithi188.stdout:5877 punch from 0x1988000 to 0x1994200, (0xc200 bytes) 2024-09-14T08:42:40.406 INFO:teuthology.orchestra.run.smithi188.stdout:5878 read 0x40a5400 thru 0x40ad568 (0x8169 bytes) 2024-09-14T08:42:40.406 INFO:teuthology.orchestra.run.smithi188.stdout:5880 read 0x394a000 thru 0x39503fe (0x63ff bytes) 2024-09-14T08:42:40.407 INFO:teuthology.orchestra.run.smithi188.stdout:5881 write 0x16d5000 thru 0x16df908 (0xa909 bytes) 2024-09-14T08:42:40.408 INFO:teuthology.orchestra.run.smithi188.stdout:5882 trunc from 0x575c000 to 0x5d6b200 2024-09-14T08:42:40.420 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:40.418+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:40.485 INFO:teuthology.orchestra.run.smithi188.stdout:5885 write 0xebf0e00 thru 0xec00bc4 (0xfdc5 bytes) 2024-09-14T08:42:40.487 INFO:teuthology.orchestra.run.smithi188.stdout:5886 punch from 0x792f000 to 0x793d200, (0xe200 bytes) 2024-09-14T08:42:40.488 INFO:teuthology.orchestra.run.smithi188.stdout:5891 punch from 0xa46f400 to 0xa477e00, (0x8a00 bytes) 2024-09-14T08:42:40.488 INFO:teuthology.orchestra.run.smithi188.stdout:5892 punch from 0x69c9600 to 0x69d8e00, (0xf800 bytes) 2024-09-14T08:42:40.489 INFO:teuthology.orchestra.run.smithi188.stdout:5894 write 0xae2b800 thru 0xae2c95c (0x115d bytes) 2024-09-14T08:42:40.489 INFO:teuthology.orchestra.run.smithi188.stdout:5895 read 0x7e69800 thru 0x7e69a63 (0x264 bytes) 2024-09-14T08:42:40.489 INFO:teuthology.orchestra.run.smithi188.stdout:5897 read 0x6473400 thru 0x6478353 (0x4f54 bytes) 2024-09-14T08:42:40.514 INFO:teuthology.orchestra.run.smithi188.stdout:5899 trunc from 0xec00c00 to 0xe7000 2024-09-14T08:42:40.521 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:40.518+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:40.523 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T08:42:40.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T08:42:40.553 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:40.553 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:40.568 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:40.608 INFO:teuthology.orchestra.run.smithi188.stdout:5900 read 0x49600 thru 0x52fea (0x99eb bytes) 2024-09-14T08:42:40.621 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:40.620+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:40.661 INFO:teuthology.orchestra.run.smithi188.stdout:5902 write 0xe7fc800 thru 0xe7fff71 (0x3772 bytes) 2024-09-14T08:42:40.664 INFO:teuthology.orchestra.run.smithi188.stdout:5903 write 0x2cf6800 thru 0x2cf68cf (0xd0 bytes) 2024-09-14T08:42:40.664 INFO:teuthology.orchestra.run.smithi188.stdout:5905 read 0x328b200 thru 0x3297537 (0xc338 bytes) 2024-09-14T08:42:40.665 INFO:teuthology.orchestra.run.smithi188.stdout:5908 punch from 0xc9c600 to 0xc9dc00, (0x1600 bytes) 2024-09-14T08:42:40.665 INFO:teuthology.orchestra.run.smithi188.stdout:5909 punch from 0x95db400 to 0x95dca00, (0x1600 bytes) 2024-09-14T08:42:40.665 INFO:teuthology.orchestra.run.smithi188.stdout:5910 write 0x72aec00 thru 0x72b295a (0x3d5b bytes) 2024-09-14T08:42:40.669 INFO:teuthology.orchestra.run.smithi188.stdout:5911 trunc from 0xe800000 to 0xca2ce00 2024-09-14T08:42:40.694 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:40.694 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:40.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:40.709 INFO:teuthology.orchestra.run.smithi188.stdout:5912 read 0x874f000 thru 0x8759bd8 (0xabd9 bytes) 2024-09-14T08:42:40.711 INFO:teuthology.orchestra.run.smithi188.stdout:5916 read 0x873e200 thru 0x8746b7f (0x8980 bytes) 2024-09-14T08:42:40.732 INFO:teuthology.orchestra.run.smithi188.stdout:5919 write 0xd0c4200 thru 0xd0d2861 (0xe662 bytes) 2024-09-14T08:42:40.733 INFO:teuthology.orchestra.run.smithi188.stdout:5921 write 0x1f2fa00 thru 0x1f2ffbf (0x5c0 bytes) 2024-09-14T08:42:40.733 INFO:teuthology.orchestra.run.smithi188.stdout:5924 read 0x8b94400 thru 0x8b9d71a (0x931b bytes) 2024-09-14T08:42:40.734 INFO:teuthology.orchestra.run.smithi188.stdout:5927 trunc from 0xd0d2a00 to 0xce8fe00 2024-09-14T08:42:40.757 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:40.756+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:40.764 INFO:teuthology.orchestra.run.smithi188.stdout:5928 read 0x9897c00 thru 0x9898400 (0x801 bytes) 2024-09-14T08:42:40.768 INFO:teuthology.orchestra.run.smithi188.stdout:5930 write 0xb3fae00 thru 0xb4024bc (0x76bd bytes) 2024-09-14T08:42:40.768 INFO:teuthology.orchestra.run.smithi188.stdout:5931 read 0xb14d200 thru 0xb14eaf9 (0x18fa bytes) 2024-09-14T08:42:40.797 INFO:teuthology.orchestra.run.smithi188.stdout:5932 trunc from 0xce8fe00 to 0xa02600 2024-09-14T08:42:40.822 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:40.818+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:40.841 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:40.841 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:40.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:40.868 INFO:teuthology.orchestra.run.smithi188.stdout:5933 punch from 0x209600 to 0x214c00, (0xb600 bytes) 2024-09-14T08:42:40.894 INFO:teuthology.orchestra.run.smithi188.stdout:5934 write 0x2fdc400 thru 0x2fe07a8 (0x43a9 bytes) 2024-09-14T08:42:40.923 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:40.924+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:40.946 INFO:teuthology.orchestra.run.smithi188.stdout:5935 write 0xd791400 thru 0xd794fd7 (0x3bd8 bytes) 2024-09-14T08:42:40.948 INFO:teuthology.orchestra.run.smithi188.stdout:5936 read 0x2d88400 thru 0x2d97017 (0xec18 bytes) 2024-09-14T08:42:40.949 INFO:teuthology.orchestra.run.smithi188.stdout:5937 clone 36 order 20 su 131072 sc 3 2024-09-14T08:42:41.021 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:41.021 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:41.024 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:41.022+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:41.035 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:41.125 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:41.122+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:41.195 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:41.196 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:41.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:41.226 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:41.228+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:41.326 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:41.328+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:41.372 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:41.373 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:41.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:41.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:41.427 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:41.424+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:41.511 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:41.511 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:41.527 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T08:42:41.528 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:41.524+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:41.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:41.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:42:41.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T08:42:41.589 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:41.590 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:41.622 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:41.622 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:41.629 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:41.628+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:41.655 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:41.655 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:41.690 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:41.690 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:41.701 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:41.701 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:41.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:41.701 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:41.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.701 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:41.701 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:41.702 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 164.77546035500001, 2024-09-14T08:42:41.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:42:41.702 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.702 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.702 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.702 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.702 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:41.702 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:41.702 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:42:41.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.703 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:41.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:41.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:42:41.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 164.77540557699999, 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.707 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:42:41.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:42:41.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:42:41.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:41.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:42:41.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:42:41.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:42:41.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:42:41.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:42:41.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:42:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:42:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 151.347635118, 2024-09-14T08:42:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:42:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:42:41.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 128.355031051, 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.717 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:41.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.721 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 128.35419268000001, 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:41.722 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:42:41.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:42:41.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:42:41.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:42:41.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.335684579000002, 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.335370370000007, 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:42:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.333734043999996, 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:41.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:41.740 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.333516084999999, 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:42:41.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:42:41.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.744 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.333220682999993, 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.745 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:41.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.332949847999998, 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:42:41.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.121759166999993, 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:41.758 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.121739133000005, 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:41.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.121718055000002, 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:42:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:41.767 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.121698460999994, 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:42:41.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.121678306999996, 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.776 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.121658910999997, 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.115129111000002, 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:42:41.781 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.115109224999998, 2024-09-14T08:42:41.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:42:41.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:42:41.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.115089850999993, 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.791 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:41.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:42:41.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:42:41.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.795 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:41.795 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:41.795 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:41.796 INFO:teuthology.orchestra.run.smithi188.stdout:truncating image image_client.0-clone35 from 0xd795000 (overlap 0xe7000) to 0x0 2024-09-14T08:42:41.797 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:41.797 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:41.798 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:41.798 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:41.799 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:41.799 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:41.794+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:41.897 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:41.896+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:41.957 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:41.957 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:41.957 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:41.957 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:41.971 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:42.015 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:42.014+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:42.088 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:42.088 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:42.088 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:42.088 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:42.088 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:42.099 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:42.096+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:42.101 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:42.200 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:42.198+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:42.269 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:42.269 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:42.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:42.269 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:42.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.269 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:42:42.269 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:42.269 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 151.96478290799999, 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:42.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:42:42.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:42:42.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:42.275 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 119.702672729, 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:42.280 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 119.702525558, 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:42:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:42:42.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 119.702383758, 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:42.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.290 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.139117990999999, 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:42:42.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.130826700999997, 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.295 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:42:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.130803460000003, 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.300 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.130784196, 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.304 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:42.308 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.130764919999997, 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:42:42.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.130552467000001, 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:42:42.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.123339373999997, 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:42.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.123318161999997, 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:42.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.123298812000002, 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:42:42.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:42.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.123271772999999, 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:42:42.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:42:42.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.123252622999999, 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.123231038999997, 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.339 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:42:42.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:42.343 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.12321163, 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:42.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.347 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.123192754000002, 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.348 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:42:42.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.115161917999998, 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.356 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 59.115135522000003, 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:42.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:42:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:42.360 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:42.361 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:42.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:42.364 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:42.358+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:42.463 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:42.460+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:42.497 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:42.498 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:42.498 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:42.513 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:42.513 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-14T08:42:42.542 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T08:42:42.542 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:42:42.576 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T08:42:42.601 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:42.600+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:42.634 INFO:teuthology.orchestra.run.smithi188.stdout:5939 read 0x5a83e00 thru 0x5a926bd (0xe8be bytes) 2024-09-14T08:42:42.635 INFO:teuthology.orchestra.run.smithi188.stdout:5941 punch from 0x347be00 to 0x3486200, (0xa400 bytes) 2024-09-14T08:42:42.651 INFO:teuthology.orchestra.run.smithi188.stdout:5943 write 0x8ba7000 thru 0x8bad4df (0x64e0 bytes) 2024-09-14T08:42:42.651 INFO:teuthology.orchestra.run.smithi188.stdout:5944 punch from 0xc494400 to 0xc4a0200, (0xbe00 bytes) 2024-09-14T08:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout:5945 read 0xd3a6a00 thru 0xd3af6b6 (0x8cb7 bytes) 2024-09-14T08:42:42.664 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:42.660+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout:5946 trunc from 0xd795000 to 0xdb92e00 2024-09-14T08:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout:5947 write 0x2d63000 thru 0x2d6c0f5 (0x90f6 bytes) 2024-09-14T08:42:42.685 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:42.685 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:42.685 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout:5950 punch from 0xae4a400 to 0xae55200, (0xae00 bytes) 2024-09-14T08:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout:5955 write 0x18e6400 thru 0x18f0280 (0x9e81 bytes) 2024-09-14T08:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout:5957 punch from 0x6357400 to 0x6365a00, (0xe600 bytes) 2024-09-14T08:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout:5960 write 0x919ca00 thru 0x91a2a2f (0x6030 bytes) 2024-09-14T08:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout:5961 write 0x6962400 thru 0x6963e42 (0x1a43 bytes) 2024-09-14T08:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout:5964 trunc from 0xdb92e00 to 0xd4cca00 2024-09-14T08:42:42.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout:5965 read 0x9bdaa00 thru 0x9bddfa2 (0x35a3 bytes) 2024-09-14T08:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout:5967 write 0x7ab3800 thru 0x7abdea3 (0xa6a4 bytes) 2024-09-14T08:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout:5969 write 0x643000 thru 0x64913b (0x613c bytes) 2024-09-14T08:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout:5973 write 0x8f25400 thru 0x8f2a721 (0x5322 bytes) 2024-09-14T08:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout:5974 write 0x8fbbe00 thru 0x8fcb1e8 (0xf3e9 bytes) 2024-09-14T08:42:42.776 INFO:teuthology.orchestra.run.smithi188.stdout:5977 trunc from 0xd4cca00 to 0x8871800 2024-09-14T08:42:42.793 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:42.792+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:42.818 INFO:teuthology.orchestra.run.smithi188.stdout:5979 read 0x3b44a00 thru 0x3b457a9 (0xdaa bytes) 2024-09-14T08:42:42.826 INFO:teuthology.orchestra.run.smithi188.stdout:5981 trunc from 0x8871800 to 0xb9f2000 2024-09-14T08:42:42.865 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:42.864+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:42.879 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:42.879 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:42.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:42.879 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:42.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.879 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.631361271, 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:42:42.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63129494099999, 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:42.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.888 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63123948099999, 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:42:42.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63117986099999, 2024-09-14T08:42:42.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:42.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.897 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.631098321, 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:42.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.902 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.631041993, 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:42.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:42:42.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63097049800001, 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.907 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:42:42.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.911 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.630897627, 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63085541500001, 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.917 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:42:42.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:42.921 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.630825585, 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:42:42.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:42:42.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.630797288, 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:42:42.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.930 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.630756193, 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:42:42.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:42:42.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63072716299999, 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63069867900001, 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.939 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:42.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:42:42.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:42:42.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63067053899999, 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.943 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:42:42.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:42:42.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.947 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63064184300001, 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.948 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63061308600001, 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.952 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:42:42.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63058503900001, 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:42:42.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:42:42.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.63055506200001, 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.961 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:42:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5914.0:814 3.f 3:f6536a47:::rbd_data.10f188ed37a0.000000000000005e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 430080~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.3049357320000006, 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.94391447500000003, 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5914", 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3720252961", 2024-09-14T08:42:42.966 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 814 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574373+0000", 2024-09-14T08:42:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574383+0000", 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0027000000000001e-05 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574405+0000", 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469000000000001e-05 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574419+0000", 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543999999999999e-05 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574489+0000", 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0178999999999993e-05 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574497+0000", 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6320000000000008e-06 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508185+0000", 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.93368827499999996 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508493+0000", 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030869300000000002 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508838+0000", 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034456200000000003 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.512327+0000", 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034889330000000001 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518113+0000", 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057857730000000001 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518217+0000", 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104319 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:42.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:42.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518285+0000", 2024-09-14T08:42:42.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8139000000000006e-05 2024-09-14T08:42:42.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.972 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:42.972 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:42.972 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:42.973 INFO:teuthology.orchestra.run.smithi188.stdout:5982 trunc from 0xb9f2000 to 0x1194c00 2024-09-14T08:42:42.973 INFO:teuthology.orchestra.run.smithi188.stdout:5983 read 0x5c3a00 thru 0x5cc68a (0x8c8b bytes) 2024-09-14T08:42:42.974 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:42.974 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:42.972+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:43.004 INFO:teuthology.orchestra.run.smithi188.stdout:5985 trunc from 0x1194c00 to 0xeb00a00 2024-09-14T08:42:43.031 INFO:teuthology.orchestra.run.smithi188.stdout:5988 write 0x9f18200 thru 0x9f28154 (0xff55 bytes) 2024-09-14T08:42:43.035 INFO:teuthology.orchestra.run.smithi188.stdout:5992 write 0x61b1800 thru 0x61ba9d1 (0x91d2 bytes) 2024-09-14T08:42:43.035 INFO:teuthology.orchestra.run.smithi188.stdout:5994 read 0x550fe00 thru 0x5518a19 (0x8c1a bytes) 2024-09-14T08:42:43.035 INFO:teuthology.orchestra.run.smithi188.stdout:5995 read 0xb1a2800 thru 0xb1adf15 (0xb716 bytes) 2024-09-14T08:42:43.036 INFO:teuthology.orchestra.run.smithi188.stdout:5996 read 0x9982c00 thru 0x998664d (0x3a4e bytes) 2024-09-14T08:42:43.036 INFO:teuthology.orchestra.run.smithi188.stdout:5997 write 0x1ac9600 thru 0x1ac9a3c (0x43d bytes) 2024-09-14T08:42:43.036 INFO:teuthology.orchestra.run.smithi188.stdout:5998 read 0x32ea000 thru 0x32f6cf9 (0xccfa bytes) 2024-09-14T08:42:43.036 INFO:teuthology.orchestra.run.smithi188.stdout:5999 write 0x1a26c00 thru 0x1a36bdc (0xffdd bytes) 2024-09-14T08:42:43.036 INFO:teuthology.orchestra.run.smithi188.stdout:6000 write 0x8559800 thru 0x8563d13 (0xa514 bytes) 2024-09-14T08:42:43.074 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:43.070+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:43.149 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:43.149 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:43.149 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:43.164 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:43.209 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:43.208+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:43.274 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:43.272+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:43.286 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:43.286 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:43.286 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:43.286 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:43.286 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:43.300 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:43.375 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:43.374+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:43.469 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:43.469 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:43.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:43.469 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:43.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.469 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:42:43.469 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:43.469 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 147.73562822700001, 2024-09-14T08:42:43.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:42:43.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:42:43.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:43.476 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 92.199874402000006, 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:42:43.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 92.165209517999998, 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:42:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:42:43.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:42:43.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 92.165008546999999, 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:43.487 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.264333157999999, 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.492 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:42:43.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.496 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.264298943, 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:42:43.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.264257454000003, 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:42:43.501 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:42:43.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.505 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.264198972000003, 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.506 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:42:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:42:43.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.264169292999995, 2024-09-14T08:42:43.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.514 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.264140084000005, 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.256533789000002, 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:42:43.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.256505798999996, 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.524 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:42:43.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.256477466999996, 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.529 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:42:43.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.533 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.256435707999998, 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.256406828999999, 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.538 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:42:43.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.256373019999998, 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:42:43.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.256340660999996, 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.248212858000002, 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.552 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:42:43.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:42:43.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.248181872999993, 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.556 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.560 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.248152966999996, 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:43.561 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:43.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:43.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:43.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:42:43.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:42:43.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.565 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:43.565 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:43.565 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:43.566 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T08:42:43.566 INFO:teuthology.orchestra.run.smithi188.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-14T08:42:43.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:43.567 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:43.564+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:43.569 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T08:42:43.667 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:43.666+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:43.746 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:43.746 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:43.746 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:43.746 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:43.761 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:43.768 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:43.766+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:43.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:43.868 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:43.864+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:43.885 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:43.885 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:43.885 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:43.886 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:43.886 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:43.899 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:43.937 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:43.937 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:43.953 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:43.954 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:43.970 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:43.970 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:43.985 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:43.984+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:43.990 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:43.990 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:44.008 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:44.008 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:44.026 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:44.026 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:44.063 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:44.063 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:44.069 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:44.068+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:44.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:44.171 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:44.168+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:44.200 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:44.200 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:44.214 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:44.272 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:44.270+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:44.338 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:44.338 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:44.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:44.372 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:44.368+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:44.473 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:44.470+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:44.517 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:44.517 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:44.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:44.565 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T08:42:44.574 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:44.572+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:44.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:42:44.592 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T08:42:44.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:42:44.676 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:44.672+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:44.701 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:44.701 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:44.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:44.811 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:44.810+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:44.877 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:44.874+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:44.879 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:44.879 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:44.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:44.953 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:42:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:42:44.971 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-14T08:42:44.564779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1167917281,"num_objects":2048,"num_object_clones":508,"num_object_copies":4096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2048,"num_whiteouts":914,"num_read":597864,"num_read_kb":1274350,"num_write":24584,"num_write_kb":296016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3900,"num_bytes_recovered":109904886,"num_keys_recovered":454,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20916,"ondisk_log_size":20916,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":603904,"kb_used_data":237348,"kb_used_omap":30,"kb_used_meta":348769,"kb_avail":565627136,"statfs":{"total":579820584960,"available":579202187264,"internally_reserved":0,"allocated":243044352,"data_stored":280524423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30725,"internal_metadata":357140475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":36011566,"num_objects":57,"num_object_clones":35,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":45,"num_read":13635,"num_read_kb":36888,"num_write":628,"num_write_kb":20670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039716"},"pg_stats":[{"pgid":"3.1f","version":"160'409","reported_seq":4480,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.799872+0000","last_change":"2024-09-14T08:42:25.418643+0000","last_active":"2024-09-14T08:42:42.799872+0000","last_peered":"2024-09-14T08:42:42.799872+0000","last_clean":"2024-09-14T08:42:42.799872+0000","last_became_active":"2024-09-14T08:42:25.417105+0000","last_became_peered":"2024-09-14T08:42:25.417105+0000","last_unstale":"2024-09-14T08:42:42.799872+0000","last_undegraded":"2024-09-14T08:42:42.799872+0000","last_fullsized":"2024-09-14T08:42:42.799872+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:17.233780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001451897,"stat_sum":{"num_bytes":19583615,"num_objects":59,"num_object_clones":12,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":31,"num_read":3865,"num_read_kb":17010,"num_write":461,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":260,"num_bytes_recovered":6338482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"158'336","reported_seq":29563,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524642+0000","last_change":"2024-09-14T08:42:26.420382+0000","last_active":"2024-09-14T08:42:40.524642+0000","last_peered":"2024-09-14T08:42:40.524642+0000","last_clean":"2024-09-14T08:42:40.524642+0000","last_became_active":"2024-09-14T08:42:26.418116+0000","last_became_peered":"2024-09-14T08:42:26.418116+0000","last_unstale":"2024-09-14T08:42:40.524642+0000","last_undegraded":"2024-09-14T08:42:40.524642+0000","last_fullsized":"2024-09-14T08:42:40.524642+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.568972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013459450000000001,"stat_sum":{"num_bytes":26364448,"num_objects":60,"num_object_clones":15,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":30,"num_read":28728,"num_read_kb":35041,"num_write":353,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":339488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"158'634","reported_seq":7761,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.556634+0000","last_change":"2024-09-14T08:40:16.727831+0000","last_active":"2024-09-14T08:42:40.556634+0000","last_peered":"2024-09-14T08:42:40.556634+0000","last_clean":"2024-09-14T08:42:40.556634+0000","last_became_active":"2024-09-14T08:40:16.726695+0000","last_became_peered":"2024-09-14T08:40:16.726695+0000","last_unstale":"2024-09-14T08:42:40.556634+0000","last_undegraded":"2024-09-14T08:42:40.556634+0000","last_fullsized":"2024-09-14T08:42:40.556634+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:04.233294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003027493,"stat_sum":{"num_bytes":19893345,"num_objects":67,"num_object_clones":16,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":30,"num_read":9628,"num_read_kb":39848,"num_write":664,"num_write_kb":5090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"158'637","reported_seq":8247,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.770837+0000","last_change":"2024-09-14T08:40:16.728168+0000","last_active":"2024-09-14T08:42:40.770837+0000","last_peered":"2024-09-14T08:42:40.770837+0000","last_clean":"2024-09-14T08:42:40.770837+0000","last_became_active":"2024-09-14T08:40:16.726971+0000","last_became_peered":"2024-09-14T08:40:16.726971+0000","last_unstale":"2024-09-14T08:42:40.770837+0000","last_undegraded":"2024-09-14T08:42:40.770837+0000","last_fullsized":"2024-09-14T08:42:40.770837+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:48.737137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001345691,"stat_sum":{"num_bytes":32867886,"num_objects":66,"num_object_clones":16,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":29,"num_read":8264,"num_read_kb":52558,"num_write":780,"num_write_kb":9359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"160'809","reported_seq":10548,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.711468+0000","last_change":"2024-09-14T08:42:22.390071+0000","last_active":"2024-09-14T08:42:42.711468+0000","last_peered":"2024-09-14T08:42:42.711468+0000","last_clean":"2024-09-14T08:42:42.711468+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:42:42.711468+0000","last_undegraded":"2024-09-14T08:42:42.711468+0000","last_fullsized":"2024-09-14T08:42:42.711468+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:45.072872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910279999999999,"stat_sum":{"num_bytes":23451315,"num_objects":55,"num_object_clones":12,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":22,"num_read":11297,"num_read_kb":55074,"num_write":881,"num_write_kb":5905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"156'417","reported_seq":11506,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.948516+0000","last_change":"2024-09-14T08:39:20.388365+0000","last_active":"2024-09-14T08:42:40.948516+0000","last_peered":"2024-09-14T08:42:40.948516+0000","last_clean":"2024-09-14T08:42:40.948516+0000","last_became_active":"2024-09-14T08:39:18.383879+0000","last_became_peered":"2024-09-14T08:39:18.383879+0000","last_unstale":"2024-09-14T08:42:40.948516+0000","last_undegraded":"2024-09-14T08:42:40.948516+0000","last_fullsized":"2024-09-14T08:42:40.948516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:05.137264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211712,"stat_sum":{"num_bytes":55502406,"num_objects":66,"num_object_clones":21,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":27,"num_read":11232,"num_read_kb":31063,"num_write":437,"num_write_kb":5331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"158'616","reported_seq":6086,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.681161+0000","last_change":"2024-09-14T08:39:20.386019+0000","last_active":"2024-09-14T08:42:40.681161+0000","last_peered":"2024-09-14T08:42:40.681161+0000","last_clean":"2024-09-14T08:42:40.681161+0000","last_became_active":"2024-09-14T08:39:18.384097+0000","last_became_peered":"2024-09-14T08:39:18.384097+0000","last_unstale":"2024-09-14T08:42:40.681161+0000","last_undegraded":"2024-09-14T08:42:40.681161+0000","last_fullsized":"2024-09-14T08:42:40.681161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:34.189321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014331750000000001,"stat_sum":{"num_bytes":15410951,"num_objects":71,"num_object_clones":15,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":32,"num_read":6836,"num_read_kb":21501,"num_write":658,"num_write_kb":7588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"156'524","reported_seq":7321,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523882+0000","last_change":"2024-09-14T08:42:21.376506+0000","last_active":"2024-09-14T08:42:40.523882+0000","last_peered":"2024-09-14T08:42:40.523882+0000","last_clean":"2024-09-14T08:42:40.523882+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:42:40.523882+0000","last_undegraded":"2024-09-14T08:42:40.523882+0000","last_fullsized":"2024-09-14T08:42:40.523882+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:32.819382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922599999999997,"stat_sum":{"num_bytes":32923426,"num_objects":67,"num_object_clones":15,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":35,"num_read":7548,"num_read_kb":29010,"num_write":448,"num_write_kb":3297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"160'717","reported_seq":6571,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.855540+0000","last_change":"2024-09-14T08:42:22.388207+0000","last_active":"2024-09-14T08:42:42.855540+0000","last_peered":"2024-09-14T08:42:42.855540+0000","last_clean":"2024-09-14T08:42:42.855540+0000","last_became_active":"2024-09-14T08:42:22.384895+0000","last_became_peered":"2024-09-14T08:42:22.384895+0000","last_unstale":"2024-09-14T08:42:42.855540+0000","last_undegraded":"2024-09-14T08:42:42.855540+0000","last_fullsized":"2024-09-14T08:42:42.855540+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:55.654705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862059999999999,"stat_sum":{"num_bytes":26836366,"num_objects":54,"num_object_clones":12,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":24,"num_read":7893,"num_read_kb":36467,"num_write":1019,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":3097246,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"156'575","reported_seq":6223,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.556812+0000","last_change":"2024-09-14T08:42:26.413532+0000","last_active":"2024-09-14T08:42:40.556812+0000","last_peered":"2024-09-14T08:42:40.556812+0000","last_clean":"2024-09-14T08:42:40.556812+0000","last_became_active":"2024-09-14T08:42:26.411760+0000","last_became_peered":"2024-09-14T08:42:26.411760+0000","last_unstale":"2024-09-14T08:42:40.556812+0000","last_undegraded":"2024-09-14T08:42:40.556812+0000","last_fullsized":"2024-09-14T08:42:40.556812+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:43.514543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029337040000000001,"stat_sum":{"num_bytes":16271693,"num_objects":65,"num_object_clones":19,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":31,"num_read":30608,"num_read_kb":35042,"num_write":626,"num_write_kb":6382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":2542413,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"158'1023","reported_seq":7453,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.995890+0000","last_change":"2024-09-14T08:42:28.417612+0000","last_active":"2024-09-14T08:42:40.995890+0000","last_peered":"2024-09-14T08:42:40.995890+0000","last_clean":"2024-09-14T08:42:40.995890+0000","last_became_active":"2024-09-14T08:42:28.415193+0000","last_became_peered":"2024-09-14T08:42:28.415193+0000","last_unstale":"2024-09-14T08:42:40.995890+0000","last_undegraded":"2024-09-14T08:42:40.995890+0000","last_fullsized":"2024-09-14T08:42:40.995890+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:46.890483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018449409999999999,"stat_sum":{"num_bytes":57025156,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":26,"num_read":11733,"num_read_kb":25591,"num_write":1250,"num_write_kb":10015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":11240906,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"156'351","reported_seq":32602,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523981+0000","last_change":"2024-09-14T08:42:25.420959+0000","last_active":"2024-09-14T08:42:40.523981+0000","last_peered":"2024-09-14T08:42:40.523981+0000","last_clean":"2024-09-14T08:42:40.523981+0000","last_became_active":"2024-09-14T08:42:25.417110+0000","last_became_peered":"2024-09-14T08:42:25.417110+0000","last_unstale":"2024-09-14T08:42:40.523981+0000","last_undegraded":"2024-09-14T08:42:40.523981+0000","last_fullsized":"2024-09-14T08:42:40.523981+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:17.407266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014343330000000001,"stat_sum":{"num_bytes":41546585,"num_objects":56,"num_object_clones":12,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":22,"num_read":32157,"num_read_kb":39287,"num_write":428,"num_write_kb":3424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":1573864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524868+0000","last_change":"2024-09-14T08:42:22.375924+0000","last_active":"2024-09-14T08:42:40.524868+0000","last_peered":"2024-09-14T08:42:40.524868+0000","last_clean":"2024-09-14T08:42:40.524868+0000","last_became_active":"2024-09-14T08:42:22.375477+0000","last_became_peered":"2024-09-14T08:42:22.375477+0000","last_unstale":"2024-09-14T08:42:40.524868+0000","last_undegraded":"2024-09-14T08:42:40.524868+0000","last_fullsized":"2024-09-14T08:42:40.524868+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:38.473011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"160'2251","reported_seq":57794,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:43.440369+0000","last_change":"2024-09-14T08:42:23.410902+0000","last_active":"2024-09-14T08:42:43.440369+0000","last_peered":"2024-09-14T08:42:43.440369+0000","last_clean":"2024-09-14T08:42:43.440369+0000","last_became_active":"2024-09-14T08:42:23.406044+0000","last_became_peered":"2024-09-14T08:42:23.406044+0000","last_unstale":"2024-09-14T08:42:43.440369+0000","last_undegraded":"2024-09-14T08:42:43.440369+0000","last_fullsized":"2024-09-14T08:42:43.440369+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:09.833227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484614,"stat_sum":{"num_bytes":53249285,"num_objects":70,"num_object_clones":17,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":29,"num_read":67066,"num_read_kb":67735,"num_write":3700,"num_write_kb":9118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":4685170,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":311,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.531196+0000","last_change":"2024-09-14T08:42:22.395872+0000","last_active":"2024-09-14T08:42:40.531196+0000","last_peered":"2024-09-14T08:42:40.531196+0000","last_clean":"2024-09-14T08:42:40.531196+0000","last_became_active":"2024-09-14T08:42:22.394945+0000","last_became_peered":"2024-09-14T08:42:22.394945+0000","last_unstale":"2024-09-14T08:42:40.531196+0000","last_undegraded":"2024-09-14T08:42:40.531196+0000","last_fullsized":"2024-09-14T08:42:40.531196+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:38.388505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"156'668","reported_seq":57866,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524189+0000","last_change":"2024-09-14T08:39:20.419181+0000","last_active":"2024-09-14T08:42:40.524189+0000","last_peered":"2024-09-14T08:42:40.524189+0000","last_clean":"2024-09-14T08:42:40.524189+0000","last_became_active":"2024-09-14T08:39:18.382867+0000","last_became_peered":"2024-09-14T08:39:18.382867+0000","last_unstale":"2024-09-14T08:42:40.524189+0000","last_undegraded":"2024-09-14T08:42:40.524189+0000","last_fullsized":"2024-09-14T08:42:40.524189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:58.798516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015322599999999999,"stat_sum":{"num_bytes":30865492,"num_objects":64,"num_object_clones":15,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":28,"num_read":51789,"num_read_kb":49661,"num_write":514,"num_write_kb":32313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523885+0000","last_change":"2024-09-14T08:42:22.382565+0000","last_active":"2024-09-14T08:42:40.523885+0000","last_peered":"2024-09-14T08:42:40.523885+0000","last_clean":"2024-09-14T08:42:40.523885+0000","last_became_active":"2024-09-14T08:42:22.382087+0000","last_became_peered":"2024-09-14T08:42:22.382087+0000","last_unstale":"2024-09-14T08:42:40.523885+0000","last_undegraded":"2024-09-14T08:42:40.523885+0000","last_fullsized":"2024-09-14T08:42:40.523885+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:39.458480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"155'557","reported_seq":6109,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.530794+0000","last_change":"2024-09-14T08:42:34.505245+0000","last_active":"2024-09-14T08:42:40.530794+0000","last_peered":"2024-09-14T08:42:40.530794+0000","last_clean":"2024-09-14T08:42:40.530794+0000","last_became_active":"2024-09-14T08:42:34.503993+0000","last_became_peered":"2024-09-14T08:42:34.503993+0000","last_unstale":"2024-09-14T08:42:40.530794+0000","last_undegraded":"2024-09-14T08:42:40.530794+0000","last_fullsized":"2024-09-14T08:42:40.530794+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:23.050686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010096059999999999,"stat_sum":{"num_bytes":43547834,"num_objects":71,"num_object_clones":19,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":38,"num_read":6243,"num_read_kb":17072,"num_write":583,"num_write_kb":20401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1981071,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":314,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.531100+0000","last_change":"2024-09-14T08:42:15.969580+0000","last_active":"2024-09-14T08:42:40.531100+0000","last_peered":"2024-09-14T08:42:40.531100+0000","last_clean":"2024-09-14T08:42:40.531100+0000","last_became_active":"2024-09-14T08:42:15.969363+0000","last_became_peered":"2024-09-14T08:42:15.969363+0000","last_unstale":"2024-09-14T08:42:40.531100+0000","last_undegraded":"2024-09-14T08:42:40.531100+0000","last_fullsized":"2024-09-14T08:42:40.531100+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:06.397778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"158'706","reported_seq":9715,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.985966+0000","last_change":"2024-09-14T08:40:16.717901+0000","last_active":"2024-09-14T08:42:40.985966+0000","last_peered":"2024-09-14T08:42:40.985966+0000","last_clean":"2024-09-14T08:42:40.985966+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:42:40.985966+0000","last_undegraded":"2024-09-14T08:42:40.985966+0000","last_fullsized":"2024-09-14T08:42:40.985966+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:21.220393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032365710000000002,"stat_sum":{"num_bytes":34967288,"num_objects":75,"num_object_clones":18,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":35,"num_read":10877,"num_read_kb":39932,"num_write":1014,"num_write_kb":21531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"156'1352","reported_seq":20767,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.556584+0000","last_change":"2024-09-14T08:42:22.393178+0000","last_active":"2024-09-14T08:42:40.556584+0000","last_peered":"2024-09-14T08:42:40.556584+0000","last_clean":"2024-09-14T08:42:40.556584+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:42:40.556584+0000","last_undegraded":"2024-09-14T08:42:40.556584+0000","last_fullsized":"2024-09-14T08:42:40.556584+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:40.382016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599846,"stat_sum":{"num_bytes":14359198,"num_objects":67,"num_object_clones":16,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":36,"num_read":24554,"num_read_kb":26602,"num_write":2235,"num_write_kb":4958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":232,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.531047+0000","last_change":"2024-09-14T08:40:16.717703+0000","last_active":"2024-09-14T08:42:40.531047+0000","last_peered":"2024-09-14T08:42:40.531047+0000","last_clean":"2024-09-14T08:42:40.531047+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:42:40.531047+0000","last_undegraded":"2024-09-14T08:42:40.531047+0000","last_fullsized":"2024-09-14T08:42:40.531047+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:18.988966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"157'397","reported_seq":27267,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.530845+0000","last_change":"2024-09-14T08:39:20.385113+0000","last_active":"2024-09-14T08:42:40.530845+0000","last_peered":"2024-09-14T08:42:40.530845+0000","last_clean":"2024-09-14T08:42:40.530845+0000","last_became_active":"2024-09-14T08:39:18.387585+0000","last_became_peered":"2024-09-14T08:39:18.387585+0000","last_unstale":"2024-09-14T08:42:40.530845+0000","last_undegraded":"2024-09-14T08:42:40.530845+0000","last_fullsized":"2024-09-14T08:42:40.530845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:45.782307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058750299999999996,"stat_sum":{"num_bytes":18876030,"num_objects":56,"num_object_clones":14,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":23,"num_read":26915,"num_read_kb":27555,"num_write":415,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":299,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523766+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:42:40.523766+0000","last_peered":"2024-09-14T08:42:40.523766+0000","last_clean":"2024-09-14T08:42:40.523766+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:42:40.523766+0000","last_undegraded":"2024-09-14T08:42:40.523766+0000","last_fullsized":"2024-09-14T08:42:40.523766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'377","reported_seq":8432,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.985562+0000","last_change":"2024-09-14T08:42:20.372704+0000","last_active":"2024-09-14T08:42:42.985562+0000","last_peered":"2024-09-14T08:42:42.985562+0000","last_clean":"2024-09-14T08:42:42.985562+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:42:42.985562+0000","last_undegraded":"2024-09-14T08:42:42.985562+0000","last_fullsized":"2024-09-14T08:42:42.985562+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:43.659952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047135900000000002,"stat_sum":{"num_bytes":70153253,"num_objects":56,"num_object_clones":19,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":27,"num_read":7742,"num_read_kb":16833,"num_write":413,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523706+0000","last_change":"2024-09-14T08:42:22.385567+0000","last_active":"2024-09-14T08:42:40.523706+0000","last_peered":"2024-09-14T08:42:40.523706+0000","last_clean":"2024-09-14T08:42:40.523706+0000","last_became_active":"2024-09-14T08:42:22.385172+0000","last_became_peered":"2024-09-14T08:42:22.385172+0000","last_unstale":"2024-09-14T08:42:40.523706+0000","last_undegraded":"2024-09-14T08:42:40.523706+0000","last_fullsized":"2024-09-14T08:42:40.523706+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:35.370480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"156'465","reported_seq":17703,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.531008+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:42:40.531008+0000","last_peered":"2024-09-14T08:42:40.531008+0000","last_clean":"2024-09-14T08:42:40.531008+0000","last_became_active":"2024-09-14T08:39:18.387242+0000","last_became_peered":"2024-09-14T08:39:18.387242+0000","last_unstale":"2024-09-14T08:42:40.531008+0000","last_undegraded":"2024-09-14T08:42:40.531008+0000","last_fullsized":"2024-09-14T08:42:40.531008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:54.456941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332069,"stat_sum":{"num_bytes":41032018,"num_objects":52,"num_object_clones":13,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":21,"num_read":17746,"num_read_kb":57232,"num_write":575,"num_write_kb":6768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":217,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523853+0000","last_change":"2024-09-14T08:40:16.718478+0000","last_active":"2024-09-14T08:42:40.523853+0000","last_peered":"2024-09-14T08:42:40.523853+0000","last_clean":"2024-09-14T08:42:40.523853+0000","last_became_active":"2024-09-14T08:40:16.717575+0000","last_became_peered":"2024-09-14T08:40:16.717575+0000","last_unstale":"2024-09-14T08:42:40.523853+0000","last_undegraded":"2024-09-14T08:42:40.523853+0000","last_fullsized":"2024-09-14T08:42:40.523853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:50.808473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":45,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523757+0000","last_change":"2024-09-14T08:42:22.399938+0000","last_active":"2024-09-14T08:42:40.523757+0000","last_peered":"2024-09-14T08:42:40.523757+0000","last_clean":"2024-09-14T08:42:40.523757+0000","last_became_active":"2024-09-14T08:42:22.385069+0000","last_became_peered":"2024-09-14T08:42:22.385069+0000","last_unstale":"2024-09-14T08:42:40.523757+0000","last_undegraded":"2024-09-14T08:42:40.523757+0000","last_fullsized":"2024-09-14T08:42:40.523757+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:01.403929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"156'504","reported_seq":34587,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524230+0000","last_change":"2024-09-14T08:39:20.418935+0000","last_active":"2024-09-14T08:42:40.524230+0000","last_peered":"2024-09-14T08:42:40.524230+0000","last_clean":"2024-09-14T08:42:40.524230+0000","last_became_active":"2024-09-14T08:39:18.382844+0000","last_became_peered":"2024-09-14T08:39:18.382844+0000","last_unstale":"2024-09-14T08:42:40.524230+0000","last_undegraded":"2024-09-14T08:42:40.524230+0000","last_fullsized":"2024-09-14T08:42:40.524230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:29.271647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013334390000000001,"stat_sum":{"num_bytes":25665667,"num_objects":65,"num_object_clones":14,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":28,"num_read":33067,"num_read_kb":35499,"num_write":417,"num_write_kb":3415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"156'915","reported_seq":16070,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.556364+0000","last_change":"2024-09-14T08:41:11.611116+0000","last_active":"2024-09-14T08:42:40.556364+0000","last_peered":"2024-09-14T08:42:40.556364+0000","last_clean":"2024-09-14T08:42:40.556364+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:42:40.556364+0000","last_undegraded":"2024-09-14T08:42:40.556364+0000","last_fullsized":"2024-09-14T08:42:40.556364+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:46.762077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011980249999999999,"stat_sum":{"num_bytes":37347765,"num_objects":75,"num_object_clones":17,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":30,"num_read":15482,"num_read_kb":32299,"num_write":768,"num_write_kb":8901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"156'556","reported_seq":13596,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523924+0000","last_change":"2024-09-14T08:40:36.360897+0000","last_active":"2024-09-14T08:42:40.523924+0000","last_peered":"2024-09-14T08:42:40.523924+0000","last_clean":"2024-09-14T08:42:40.523924+0000","last_became_active":"2024-09-14T08:40:36.358876+0000","last_became_peered":"2024-09-14T08:40:36.358876+0000","last_unstale":"2024-09-14T08:42:40.523924+0000","last_undegraded":"2024-09-14T08:42:40.523924+0000","last_fullsized":"2024-09-14T08:42:40.523924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:49.109029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002911753,"stat_sum":{"num_bytes":65259073,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":23,"num_read":14420,"num_read_kb":83621,"num_write":570,"num_write_kb":41438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":5746688,"num_keys_recovered":33,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"156'582","reported_seq":5238,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.530810+0000","last_change":"2024-09-14T08:42:21.377182+0000","last_active":"2024-09-14T08:42:40.530810+0000","last_peered":"2024-09-14T08:42:40.530810+0000","last_clean":"2024-09-14T08:42:40.530810+0000","last_became_active":"2024-09-14T08:42:21.376327+0000","last_became_peered":"2024-09-14T08:42:21.376327+0000","last_unstale":"2024-09-14T08:42:40.530810+0000","last_undegraded":"2024-09-14T08:42:40.530810+0000","last_fullsized":"2024-09-14T08:42:40.530810+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:00.475198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013500459999999999,"stat_sum":{"num_bytes":18505833,"num_objects":53,"num_object_clones":11,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":21,"num_read":5875,"num_read_kb":21567,"num_write":771,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":3660900,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"160'850","reported_seq":43584,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.709455+0000","last_change":"2024-09-14T08:42:20.377085+0000","last_active":"2024-09-14T08:42:42.709455+0000","last_peered":"2024-09-14T08:42:42.709455+0000","last_clean":"2024-09-14T08:42:42.709455+0000","last_became_active":"2024-09-14T08:42:20.373418+0000","last_became_peered":"2024-09-14T08:42:20.373418+0000","last_unstale":"2024-09-14T08:42:42.709455+0000","last_undegraded":"2024-09-14T08:42:42.709455+0000","last_fullsized":"2024-09-14T08:42:42.709455+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:00.272278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652499,"stat_sum":{"num_bytes":35178535,"num_objects":72,"num_object_clones":17,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":34,"num_read":48340,"num_read_kb":102090,"num_write":689,"num_write_kb":9595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":6565966,"num_keys_recovered":104,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"156'618","reported_seq":7558,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524111+0000","last_change":"2024-09-14T08:42:27.418543+0000","last_active":"2024-09-14T08:42:40.524111+0000","last_peered":"2024-09-14T08:42:40.524111+0000","last_clean":"2024-09-14T08:42:40.524111+0000","last_became_active":"2024-09-14T08:42:27.414699+0000","last_became_peered":"2024-09-14T08:42:27.414699+0000","last_unstale":"2024-09-14T08:42:40.524111+0000","last_undegraded":"2024-09-14T08:42:40.524111+0000","last_fullsized":"2024-09-14T08:42:40.524111+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:46:31.476400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024901429999999998,"stat_sum":{"num_bytes":28151824,"num_objects":57,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":20,"num_read":8984,"num_read_kb":22536,"num_write":487,"num_write_kb":7300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":4142592,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"157'269","reported_seq":7003,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.556894+0000","last_change":"2024-09-14T08:40:16.728183+0000","last_active":"2024-09-14T08:42:40.556894+0000","last_peered":"2024-09-14T08:42:40.556894+0000","last_clean":"2024-09-14T08:42:40.556894+0000","last_became_active":"2024-09-14T08:40:16.727022+0000","last_became_peered":"2024-09-14T08:40:16.727022+0000","last_unstale":"2024-09-14T08:42:40.556894+0000","last_undegraded":"2024-09-14T08:42:40.556894+0000","last_fullsized":"2024-09-14T08:42:40.556894+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:24:21.909932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002389113,"stat_sum":{"num_bytes":28541062,"num_objects":63,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":30,"num_read":6522,"num_read_kb":21411,"num_write":267,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"156'504","reported_seq":9022,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524456+0000","last_change":"2024-09-14T08:42:34.510404+0000","last_active":"2024-09-14T08:42:40.524456+0000","last_peered":"2024-09-14T08:42:40.524456+0000","last_clean":"2024-09-14T08:42:40.524456+0000","last_became_active":"2024-09-14T08:42:34.505471+0000","last_became_peered":"2024-09-14T08:42:34.505471+0000","last_unstale":"2024-09-14T08:42:40.524456+0000","last_undegraded":"2024-09-14T08:42:40.524456+0000","last_fullsized":"2024-09-14T08:42:40.524456+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:24.805501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023917970000000002,"stat_sum":{"num_bytes":67330096,"num_objects":80,"num_object_clones":21,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":33,"num_read":7823,"num_read_kb":43790,"num_write":471,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":348,"num_bytes_recovered":15889488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"156'404","reported_seq":19246,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523459+0000","last_change":"2024-09-14T08:42:23.391779+0000","last_active":"2024-09-14T08:42:40.523459+0000","last_peered":"2024-09-14T08:42:40.523459+0000","last_clean":"2024-09-14T08:42:40.523459+0000","last_became_active":"2024-09-14T08:42:23.389353+0000","last_became_peered":"2024-09-14T08:42:23.389353+0000","last_unstale":"2024-09-14T08:42:40.523459+0000","last_undegraded":"2024-09-14T08:42:40.523459+0000","last_fullsized":"2024-09-14T08:42:40.523459+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:35:16.541594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024547029999999999,"stat_sum":{"num_bytes":74179742,"num_objects":76,"num_object_clones":22,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":29,"num_read":19941,"num_read_kb":55689,"num_write":427,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":1554330,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"158'458","reported_seq":43364,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.686983+0000","last_change":"2024-09-14T08:42:27.415099+0000","last_active":"2024-09-14T08:42:40.686983+0000","last_peered":"2024-09-14T08:42:40.686983+0000","last_clean":"2024-09-14T08:42:40.686983+0000","last_became_active":"2024-09-14T08:42:27.413056+0000","last_became_peered":"2024-09-14T08:42:27.413056+0000","last_unstale":"2024-09-14T08:42:40.686983+0000","last_undegraded":"2024-09-14T08:42:40.686983+0000","last_fullsized":"2024-09-14T08:42:40.686983+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:35.135246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001362044,"stat_sum":{"num_bytes":64341583,"num_objects":66,"num_object_clones":19,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":43583,"num_read_kb":101240,"num_write":387,"num_write_kb":14195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":13487774,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"156'542","reported_seq":6164,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.576248+0000","last_change":"2024-09-14T08:42:26.422171+0000","last_active":"2024-09-14T08:42:42.576248+0000","last_peered":"2024-09-14T08:42:42.576248+0000","last_clean":"2024-09-14T08:42:42.576248+0000","last_became_active":"2024-09-14T08:42:26.414400+0000","last_became_peered":"2024-09-14T08:42:26.414400+0000","last_unstale":"2024-09-14T08:42:42.576248+0000","last_undegraded":"2024-09-14T08:42:42.576248+0000","last_fullsized":"2024-09-14T08:42:42.576248+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:14.548842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013117140000000001,"stat_sum":{"num_bytes":22833825,"num_objects":63,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":26,"num_read":5517,"num_read_kb":20665,"num_write":563,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":13958088,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"156'818","reported_seq":3530,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523876+0000","last_change":"2024-09-14T08:42:27.415786+0000","last_active":"2024-09-14T08:42:40.523876+0000","last_peered":"2024-09-14T08:42:40.523876+0000","last_clean":"2024-09-14T08:42:40.523876+0000","last_became_active":"2024-09-14T08:42:27.413923+0000","last_became_peered":"2024-09-14T08:42:27.413923+0000","last_unstale":"2024-09-14T08:42:40.523876+0000","last_undegraded":"2024-09-14T08:42:40.523876+0000","last_fullsized":"2024-09-14T08:42:40.523876+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:53:02.744445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018326740000000001,"stat_sum":{"num_bytes":25264299,"num_objects":64,"num_object_clones":13,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":31,"num_read":5523,"num_read_kb":13774,"num_write":1210,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":2328801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1167326894,"num_objects":2044,"num_object_clones":508,"num_object_copies":4088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2044,"num_whiteouts":914,"num_read":597798,"num_read_kb":1274295,"num_write":24481,"num_write_kb":294386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3890,"num_bytes_recovered":106953046,"num_keys_recovered":454,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":215846912,"data_stored":259920740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},"log_size":20841,"ondisk_log_size":20841,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105984,"kb_used_data":42856,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94265856,"statfs":{"total":96636764160,"available":96528236544,"internally_reserved":0,"allocated":43884544,"data_stored":53487551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77388,"kb_used_data":43184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294452,"statfs":{"total":96636764160,"available":96557518848,"internally_reserved":0,"allocated":44220416,"data_stored":56036160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101040,"kb_used_data":28872,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94270800,"statfs":{"total":96636764160,"available":96533299200,"internally_reserved":0,"allocated":29564928,"data_stored":32150384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99976,"kb_used_data":28532,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94271864,"statfs":{"total":96636764160,"available":96534388736,"internally_reserved":0,"allocated":29216768,"data_stored":31717233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607600,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136488,"kb_used_data":56724,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94235352,"statfs":{"total":96636764160,"available":96497000448,"internally_reserved":0,"allocated":58085376,"data_stored":66040953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846603,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83028,"kb_used_data":37180,"kb_used_omap":22,"kb_used_meta":45801,"kb_avail":94288812,"statfs":{"total":96636764160,"available":96551743488,"internally_reserved":0,"allocated":38072320,"data_stored":41092142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":46901024},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35336192,"data_stored":39480829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27324416,"data_stored":30926884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27725824,"data_stored":31406643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41766912,"data_stored":54675876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41996288,"data_stored":52697218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41697280,"data_stored":50733290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:42:44.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:42:44.977 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:44.976+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:45.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:45.078 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:45.076+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:45.180 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:45.176+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:45.223 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:45.224 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:45.237 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:45.283 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:45.282+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:42:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:42:45.317 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-14T08:42:44.564779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1167917281,"num_objects":2048,"num_object_clones":508,"num_object_copies":4096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2048,"num_whiteouts":914,"num_read":597864,"num_read_kb":1274350,"num_write":24584,"num_write_kb":296016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3900,"num_bytes_recovered":109904886,"num_keys_recovered":454,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20916,"ondisk_log_size":20916,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":603904,"kb_used_data":237348,"kb_used_omap":30,"kb_used_meta":348769,"kb_avail":565627136,"statfs":{"total":579820584960,"available":579202187264,"internally_reserved":0,"allocated":243044352,"data_stored":280524423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30725,"internal_metadata":357140475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":36011566,"num_objects":57,"num_object_clones":35,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":45,"num_read":13635,"num_read_kb":36888,"num_write":628,"num_write_kb":20670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039716"},"pg_stats":[{"pgid":"3.1f","version":"160'409","reported_seq":4480,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.799872+0000","last_change":"2024-09-14T08:42:25.418643+0000","last_active":"2024-09-14T08:42:42.799872+0000","last_peered":"2024-09-14T08:42:42.799872+0000","last_clean":"2024-09-14T08:42:42.799872+0000","last_became_active":"2024-09-14T08:42:25.417105+0000","last_became_peered":"2024-09-14T08:42:25.417105+0000","last_unstale":"2024-09-14T08:42:42.799872+0000","last_undegraded":"2024-09-14T08:42:42.799872+0000","last_fullsized":"2024-09-14T08:42:42.799872+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:17.233780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001451897,"stat_sum":{"num_bytes":19583615,"num_objects":59,"num_object_clones":12,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":31,"num_read":3865,"num_read_kb":17010,"num_write":461,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":260,"num_bytes_recovered":6338482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"158'336","reported_seq":29563,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524642+0000","last_change":"2024-09-14T08:42:26.420382+0000","last_active":"2024-09-14T08:42:40.524642+0000","last_peered":"2024-09-14T08:42:40.524642+0000","last_clean":"2024-09-14T08:42:40.524642+0000","last_became_active":"2024-09-14T08:42:26.418116+0000","last_became_peered":"2024-09-14T08:42:26.418116+0000","last_unstale":"2024-09-14T08:42:40.524642+0000","last_undegraded":"2024-09-14T08:42:40.524642+0000","last_fullsized":"2024-09-14T08:42:40.524642+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.568972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013459450000000001,"stat_sum":{"num_bytes":26364448,"num_objects":60,"num_object_clones":15,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":30,"num_read":28728,"num_read_kb":35041,"num_write":353,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":339488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"158'634","reported_seq":7761,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.556634+0000","last_change":"2024-09-14T08:40:16.727831+0000","last_active":"2024-09-14T08:42:40.556634+0000","last_peered":"2024-09-14T08:42:40.556634+0000","last_clean":"2024-09-14T08:42:40.556634+0000","last_became_active":"2024-09-14T08:40:16.726695+0000","last_became_peered":"2024-09-14T08:40:16.726695+0000","last_unstale":"2024-09-14T08:42:40.556634+0000","last_undegraded":"2024-09-14T08:42:40.556634+0000","last_fullsized":"2024-09-14T08:42:40.556634+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:04.233294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003027493,"stat_sum":{"num_bytes":19893345,"num_objects":67,"num_object_clones":16,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":30,"num_read":9628,"num_read_kb":39848,"num_write":664,"num_write_kb":5090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"158'637","reported_seq":8247,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.770837+0000","last_change":"2024-09-14T08:40:16.728168+0000","last_active":"2024-09-14T08:42:40.770837+0000","last_peered":"2024-09-14T08:42:40.770837+0000","last_clean":"2024-09-14T08:42:40.770837+0000","last_became_active":"2024-09-14T08:40:16.726971+0000","last_became_peered":"2024-09-14T08:40:16.726971+0000","last_unstale":"2024-09-14T08:42:40.770837+0000","last_undegraded":"2024-09-14T08:42:40.770837+0000","last_fullsized":"2024-09-14T08:42:40.770837+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:48.737137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001345691,"stat_sum":{"num_bytes":32867886,"num_objects":66,"num_object_clones":16,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":29,"num_read":8264,"num_read_kb":52558,"num_write":780,"num_write_kb":9359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"160'809","reported_seq":10548,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.711468+0000","last_change":"2024-09-14T08:42:22.390071+0000","last_active":"2024-09-14T08:42:42.711468+0000","last_peered":"2024-09-14T08:42:42.711468+0000","last_clean":"2024-09-14T08:42:42.711468+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:42:42.711468+0000","last_undegraded":"2024-09-14T08:42:42.711468+0000","last_fullsized":"2024-09-14T08:42:42.711468+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:45.072872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910279999999999,"stat_sum":{"num_bytes":23451315,"num_objects":55,"num_object_clones":12,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":22,"num_read":11297,"num_read_kb":55074,"num_write":881,"num_write_kb":5905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"156'417","reported_seq":11506,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.948516+0000","last_change":"2024-09-14T08:39:20.388365+0000","last_active":"2024-09-14T08:42:40.948516+0000","last_peered":"2024-09-14T08:42:40.948516+0000","last_clean":"2024-09-14T08:42:40.948516+0000","last_became_active":"2024-09-14T08:39:18.383879+0000","last_became_peered":"2024-09-14T08:39:18.383879+0000","last_unstale":"2024-09-14T08:42:40.948516+0000","last_undegraded":"2024-09-14T08:42:40.948516+0000","last_fullsized":"2024-09-14T08:42:40.948516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:05.137264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211712,"stat_sum":{"num_bytes":55502406,"num_objects":66,"num_object_clones":21,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":27,"num_read":11232,"num_read_kb":31063,"num_write":437,"num_write_kb":5331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"158'616","reported_seq":6086,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.681161+0000","last_change":"2024-09-14T08:39:20.386019+0000","last_active":"2024-09-14T08:42:40.681161+0000","last_peered":"2024-09-14T08:42:40.681161+0000","last_clean":"2024-09-14T08:42:40.681161+0000","last_became_active":"2024-09-14T08:39:18.384097+0000","last_became_peered":"2024-09-14T08:39:18.384097+0000","last_unstale":"2024-09-14T08:42:40.681161+0000","last_undegraded":"2024-09-14T08:42:40.681161+0000","last_fullsized":"2024-09-14T08:42:40.681161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:34.189321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014331750000000001,"stat_sum":{"num_bytes":15410951,"num_objects":71,"num_object_clones":15,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":32,"num_read":6836,"num_read_kb":21501,"num_write":658,"num_write_kb":7588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"156'524","reported_seq":7321,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523882+0000","last_change":"2024-09-14T08:42:21.376506+0000","last_active":"2024-09-14T08:42:40.523882+0000","last_peered":"2024-09-14T08:42:40.523882+0000","last_clean":"2024-09-14T08:42:40.523882+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:42:40.523882+0000","last_undegraded":"2024-09-14T08:42:40.523882+0000","last_fullsized":"2024-09-14T08:42:40.523882+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:32.819382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922599999999997,"stat_sum":{"num_bytes":32923426,"num_objects":67,"num_object_clones":15,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":35,"num_read":7548,"num_read_kb":29010,"num_write":448,"num_write_kb":3297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"160'717","reported_seq":6571,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.855540+0000","last_change":"2024-09-14T08:42:22.388207+0000","last_active":"2024-09-14T08:42:42.855540+0000","last_peered":"2024-09-14T08:42:42.855540+0000","last_clean":"2024-09-14T08:42:42.855540+0000","last_became_active":"2024-09-14T08:42:22.384895+0000","last_became_peered":"2024-09-14T08:42:22.384895+0000","last_unstale":"2024-09-14T08:42:42.855540+0000","last_undegraded":"2024-09-14T08:42:42.855540+0000","last_fullsized":"2024-09-14T08:42:42.855540+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:55.654705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862059999999999,"stat_sum":{"num_bytes":26836366,"num_objects":54,"num_object_clones":12,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":24,"num_read":7893,"num_read_kb":36467,"num_write":1019,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":3097246,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"156'575","reported_seq":6223,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.556812+0000","last_change":"2024-09-14T08:42:26.413532+0000","last_active":"2024-09-14T08:42:40.556812+0000","last_peered":"2024-09-14T08:42:40.556812+0000","last_clean":"2024-09-14T08:42:40.556812+0000","last_became_active":"2024-09-14T08:42:26.411760+0000","last_became_peered":"2024-09-14T08:42:26.411760+0000","last_unstale":"2024-09-14T08:42:40.556812+0000","last_undegraded":"2024-09-14T08:42:40.556812+0000","last_fullsized":"2024-09-14T08:42:40.556812+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:43.514543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029337040000000001,"stat_sum":{"num_bytes":16271693,"num_objects":65,"num_object_clones":19,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":31,"num_read":30608,"num_read_kb":35042,"num_write":626,"num_write_kb":6382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":2542413,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"158'1023","reported_seq":7453,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.995890+0000","last_change":"2024-09-14T08:42:28.417612+0000","last_active":"2024-09-14T08:42:40.995890+0000","last_peered":"2024-09-14T08:42:40.995890+0000","last_clean":"2024-09-14T08:42:40.995890+0000","last_became_active":"2024-09-14T08:42:28.415193+0000","last_became_peered":"2024-09-14T08:42:28.415193+0000","last_unstale":"2024-09-14T08:42:40.995890+0000","last_undegraded":"2024-09-14T08:42:40.995890+0000","last_fullsized":"2024-09-14T08:42:40.995890+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:46.890483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018449409999999999,"stat_sum":{"num_bytes":57025156,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":26,"num_read":11733,"num_read_kb":25591,"num_write":1250,"num_write_kb":10015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":11240906,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"156'351","reported_seq":32602,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523981+0000","last_change":"2024-09-14T08:42:25.420959+0000","last_active":"2024-09-14T08:42:40.523981+0000","last_peered":"2024-09-14T08:42:40.523981+0000","last_clean":"2024-09-14T08:42:40.523981+0000","last_became_active":"2024-09-14T08:42:25.417110+0000","last_became_peered":"2024-09-14T08:42:25.417110+0000","last_unstale":"2024-09-14T08:42:40.523981+0000","last_undegraded":"2024-09-14T08:42:40.523981+0000","last_fullsized":"2024-09-14T08:42:40.523981+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:17.407266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014343330000000001,"stat_sum":{"num_bytes":41546585,"num_objects":56,"num_object_clones":12,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":22,"num_read":32157,"num_read_kb":39287,"num_write":428,"num_write_kb":3424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":1573864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524868+0000","last_change":"2024-09-14T08:42:22.375924+0000","last_active":"2024-09-14T08:42:40.524868+0000","last_peered":"2024-09-14T08:42:40.524868+0000","last_clean":"2024-09-14T08:42:40.524868+0000","last_became_active":"2024-09-14T08:42:22.375477+0000","last_became_peered":"2024-09-14T08:42:22.375477+0000","last_unstale":"2024-09-14T08:42:40.524868+0000","last_undegraded":"2024-09-14T08:42:40.524868+0000","last_fullsized":"2024-09-14T08:42:40.524868+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:38.473011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"160'2251","reported_seq":57794,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:43.440369+0000","last_change":"2024-09-14T08:42:23.410902+0000","last_active":"2024-09-14T08:42:43.440369+0000","last_peered":"2024-09-14T08:42:43.440369+0000","last_clean":"2024-09-14T08:42:43.440369+0000","last_became_active":"2024-09-14T08:42:23.406044+0000","last_became_peered":"2024-09-14T08:42:23.406044+0000","last_unstale":"2024-09-14T08:42:43.440369+0000","last_undegraded":"2024-09-14T08:42:43.440369+0000","last_fullsized":"2024-09-14T08:42:43.440369+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:09.833227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484614,"stat_sum":{"num_bytes":53249285,"num_objects":70,"num_object_clones":17,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":29,"num_read":67066,"num_read_kb":67735,"num_write":3700,"num_write_kb":9118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":4685170,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":311,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.531196+0000","last_change":"2024-09-14T08:42:22.395872+0000","last_active":"2024-09-14T08:42:40.531196+0000","last_peered":"2024-09-14T08:42:40.531196+0000","last_clean":"2024-09-14T08:42:40.531196+0000","last_became_active":"2024-09-14T08:42:22.394945+0000","last_became_peered":"2024-09-14T08:42:22.394945+0000","last_unstale":"2024-09-14T08:42:40.531196+0000","last_undegraded":"2024-09-14T08:42:40.531196+0000","last_fullsized":"2024-09-14T08:42:40.531196+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:38.388505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"156'668","reported_seq":57866,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524189+0000","last_change":"2024-09-14T08:39:20.419181+0000","last_active":"2024-09-14T08:42:40.524189+0000","last_peered":"2024-09-14T08:42:40.524189+0000","last_clean":"2024-09-14T08:42:40.524189+0000","last_became_active":"2024-09-14T08:39:18.382867+0000","last_became_peered":"2024-09-14T08:39:18.382867+0000","last_unstale":"2024-09-14T08:42:40.524189+0000","last_undegraded":"2024-09-14T08:42:40.524189+0000","last_fullsized":"2024-09-14T08:42:40.524189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:58.798516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015322599999999999,"stat_sum":{"num_bytes":30865492,"num_objects":64,"num_object_clones":15,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":28,"num_read":51789,"num_read_kb":49661,"num_write":514,"num_write_kb":32313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523885+0000","last_change":"2024-09-14T08:42:22.382565+0000","last_active":"2024-09-14T08:42:40.523885+0000","last_peered":"2024-09-14T08:42:40.523885+0000","last_clean":"2024-09-14T08:42:40.523885+0000","last_became_active":"2024-09-14T08:42:22.382087+0000","last_became_peered":"2024-09-14T08:42:22.382087+0000","last_unstale":"2024-09-14T08:42:40.523885+0000","last_undegraded":"2024-09-14T08:42:40.523885+0000","last_fullsized":"2024-09-14T08:42:40.523885+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:39.458480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"155'557","reported_seq":6109,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.530794+0000","last_change":"2024-09-14T08:42:34.505245+0000","last_active":"2024-09-14T08:42:40.530794+0000","last_peered":"2024-09-14T08:42:40.530794+0000","last_clean":"2024-09-14T08:42:40.530794+0000","last_became_active":"2024-09-14T08:42:34.503993+0000","last_became_peered":"2024-09-14T08:42:34.503993+0000","last_unstale":"2024-09-14T08:42:40.530794+0000","last_undegraded":"2024-09-14T08:42:40.530794+0000","last_fullsized":"2024-09-14T08:42:40.530794+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:23.050686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010096059999999999,"stat_sum":{"num_bytes":43547834,"num_objects":71,"num_object_clones":19,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":38,"num_read":6243,"num_read_kb":17072,"num_write":583,"num_write_kb":20401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1981071,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":314,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.531100+0000","last_change":"2024-09-14T08:42:15.969580+0000","last_active":"2024-09-14T08:42:40.531100+0000","last_peered":"2024-09-14T08:42:40.531100+0000","last_clean":"2024-09-14T08:42:40.531100+0000","last_became_active":"2024-09-14T08:42:15.969363+0000","last_became_peered":"2024-09-14T08:42:15.969363+0000","last_unstale":"2024-09-14T08:42:40.531100+0000","last_undegraded":"2024-09-14T08:42:40.531100+0000","last_fullsized":"2024-09-14T08:42:40.531100+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:06.397778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"158'706","reported_seq":9715,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.985966+0000","last_change":"2024-09-14T08:40:16.717901+0000","last_active":"2024-09-14T08:42:40.985966+0000","last_peered":"2024-09-14T08:42:40.985966+0000","last_clean":"2024-09-14T08:42:40.985966+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:42:40.985966+0000","last_undegraded":"2024-09-14T08:42:40.985966+0000","last_fullsized":"2024-09-14T08:42:40.985966+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:21.220393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032365710000000002,"stat_sum":{"num_bytes":34967288,"num_objects":75,"num_object_clones":18,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":35,"num_read":10877,"num_read_kb":39932,"num_write":1014,"num_write_kb":21531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"156'1352","reported_seq":20767,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.556584+0000","last_change":"2024-09-14T08:42:22.393178+0000","last_active":"2024-09-14T08:42:40.556584+0000","last_peered":"2024-09-14T08:42:40.556584+0000","last_clean":"2024-09-14T08:42:40.556584+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:42:40.556584+0000","last_undegraded":"2024-09-14T08:42:40.556584+0000","last_fullsized":"2024-09-14T08:42:40.556584+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:40.382016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599846,"stat_sum":{"num_bytes":14359198,"num_objects":67,"num_object_clones":16,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":36,"num_read":24554,"num_read_kb":26602,"num_write":2235,"num_write_kb":4958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":232,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.531047+0000","last_change":"2024-09-14T08:40:16.717703+0000","last_active":"2024-09-14T08:42:40.531047+0000","last_peered":"2024-09-14T08:42:40.531047+0000","last_clean":"2024-09-14T08:42:40.531047+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:42:40.531047+0000","last_undegraded":"2024-09-14T08:42:40.531047+0000","last_fullsized":"2024-09-14T08:42:40.531047+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:18.988966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"157'397","reported_seq":27267,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.530845+0000","last_change":"2024-09-14T08:39:20.385113+0000","last_active":"2024-09-14T08:42:40.530845+0000","last_peered":"2024-09-14T08:42:40.530845+0000","last_clean":"2024-09-14T08:42:40.530845+0000","last_became_active":"2024-09-14T08:39:18.387585+0000","last_became_peered":"2024-09-14T08:39:18.387585+0000","last_unstale":"2024-09-14T08:42:40.530845+0000","last_undegraded":"2024-09-14T08:42:40.530845+0000","last_fullsized":"2024-09-14T08:42:40.530845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:45.782307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058750299999999996,"stat_sum":{"num_bytes":18876030,"num_objects":56,"num_object_clones":14,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":23,"num_read":26915,"num_read_kb":27555,"num_write":415,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":299,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523766+0000","last_change":"2024-09-14T08:39:10.688857+0000","last_active":"2024-09-14T08:42:40.523766+0000","last_peered":"2024-09-14T08:42:40.523766+0000","last_clean":"2024-09-14T08:42:40.523766+0000","last_became_active":"2024-09-14T08:39:08.128475+0000","last_became_peered":"2024-09-14T08:39:08.128475+0000","last_unstale":"2024-09-14T08:42:40.523766+0000","last_undegraded":"2024-09-14T08:42:40.523766+0000","last_fullsized":"2024-09-14T08:42:40.523766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:01.894776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'377","reported_seq":8432,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.985562+0000","last_change":"2024-09-14T08:42:20.372704+0000","last_active":"2024-09-14T08:42:42.985562+0000","last_peered":"2024-09-14T08:42:42.985562+0000","last_clean":"2024-09-14T08:42:42.985562+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:42:42.985562+0000","last_undegraded":"2024-09-14T08:42:42.985562+0000","last_fullsized":"2024-09-14T08:42:42.985562+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:43.659952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047135900000000002,"stat_sum":{"num_bytes":70153253,"num_objects":56,"num_object_clones":19,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":27,"num_read":7742,"num_read_kb":16833,"num_write":413,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523706+0000","last_change":"2024-09-14T08:42:22.385567+0000","last_active":"2024-09-14T08:42:40.523706+0000","last_peered":"2024-09-14T08:42:40.523706+0000","last_clean":"2024-09-14T08:42:40.523706+0000","last_became_active":"2024-09-14T08:42:22.385172+0000","last_became_peered":"2024-09-14T08:42:22.385172+0000","last_unstale":"2024-09-14T08:42:40.523706+0000","last_undegraded":"2024-09-14T08:42:40.523706+0000","last_fullsized":"2024-09-14T08:42:40.523706+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:35.370480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"156'465","reported_seq":17703,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.531008+0000","last_change":"2024-09-14T08:39:20.386320+0000","last_active":"2024-09-14T08:42:40.531008+0000","last_peered":"2024-09-14T08:42:40.531008+0000","last_clean":"2024-09-14T08:42:40.531008+0000","last_became_active":"2024-09-14T08:39:18.387242+0000","last_became_peered":"2024-09-14T08:39:18.387242+0000","last_unstale":"2024-09-14T08:42:40.531008+0000","last_undegraded":"2024-09-14T08:42:40.531008+0000","last_fullsized":"2024-09-14T08:42:40.531008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:54.456941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332069,"stat_sum":{"num_bytes":41032018,"num_objects":52,"num_object_clones":13,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":21,"num_read":17746,"num_read_kb":57232,"num_write":575,"num_write_kb":6768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":217,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523853+0000","last_change":"2024-09-14T08:40:16.718478+0000","last_active":"2024-09-14T08:42:40.523853+0000","last_peered":"2024-09-14T08:42:40.523853+0000","last_clean":"2024-09-14T08:42:40.523853+0000","last_became_active":"2024-09-14T08:40:16.717575+0000","last_became_peered":"2024-09-14T08:40:16.717575+0000","last_unstale":"2024-09-14T08:42:40.523853+0000","last_undegraded":"2024-09-14T08:42:40.523853+0000","last_fullsized":"2024-09-14T08:42:40.523853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:50.808473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":45,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523757+0000","last_change":"2024-09-14T08:42:22.399938+0000","last_active":"2024-09-14T08:42:40.523757+0000","last_peered":"2024-09-14T08:42:40.523757+0000","last_clean":"2024-09-14T08:42:40.523757+0000","last_became_active":"2024-09-14T08:42:22.385069+0000","last_became_peered":"2024-09-14T08:42:22.385069+0000","last_unstale":"2024-09-14T08:42:40.523757+0000","last_undegraded":"2024-09-14T08:42:40.523757+0000","last_fullsized":"2024-09-14T08:42:40.523757+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:01.403929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"156'504","reported_seq":34587,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524230+0000","last_change":"2024-09-14T08:39:20.418935+0000","last_active":"2024-09-14T08:42:40.524230+0000","last_peered":"2024-09-14T08:42:40.524230+0000","last_clean":"2024-09-14T08:42:40.524230+0000","last_became_active":"2024-09-14T08:39:18.382844+0000","last_became_peered":"2024-09-14T08:39:18.382844+0000","last_unstale":"2024-09-14T08:42:40.524230+0000","last_undegraded":"2024-09-14T08:42:40.524230+0000","last_fullsized":"2024-09-14T08:42:40.524230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:29.271647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013334390000000001,"stat_sum":{"num_bytes":25665667,"num_objects":65,"num_object_clones":14,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":28,"num_read":33067,"num_read_kb":35499,"num_write":417,"num_write_kb":3415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"156'915","reported_seq":16070,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.556364+0000","last_change":"2024-09-14T08:41:11.611116+0000","last_active":"2024-09-14T08:42:40.556364+0000","last_peered":"2024-09-14T08:42:40.556364+0000","last_clean":"2024-09-14T08:42:40.556364+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:42:40.556364+0000","last_undegraded":"2024-09-14T08:42:40.556364+0000","last_fullsized":"2024-09-14T08:42:40.556364+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:46.762077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011980249999999999,"stat_sum":{"num_bytes":37347765,"num_objects":75,"num_object_clones":17,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":30,"num_read":15482,"num_read_kb":32299,"num_write":768,"num_write_kb":8901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"156'556","reported_seq":13596,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523924+0000","last_change":"2024-09-14T08:40:36.360897+0000","last_active":"2024-09-14T08:42:40.523924+0000","last_peered":"2024-09-14T08:42:40.523924+0000","last_clean":"2024-09-14T08:42:40.523924+0000","last_became_active":"2024-09-14T08:40:36.358876+0000","last_became_peered":"2024-09-14T08:40:36.358876+0000","last_unstale":"2024-09-14T08:42:40.523924+0000","last_undegraded":"2024-09-14T08:42:40.523924+0000","last_fullsized":"2024-09-14T08:42:40.523924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:49.109029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002911753,"stat_sum":{"num_bytes":65259073,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":23,"num_read":14420,"num_read_kb":83621,"num_write":570,"num_write_kb":41438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":5746688,"num_keys_recovered":33,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"156'582","reported_seq":5238,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.530810+0000","last_change":"2024-09-14T08:42:21.377182+0000","last_active":"2024-09-14T08:42:40.530810+0000","last_peered":"2024-09-14T08:42:40.530810+0000","last_clean":"2024-09-14T08:42:40.530810+0000","last_became_active":"2024-09-14T08:42:21.376327+0000","last_became_peered":"2024-09-14T08:42:21.376327+0000","last_unstale":"2024-09-14T08:42:40.530810+0000","last_undegraded":"2024-09-14T08:42:40.530810+0000","last_fullsized":"2024-09-14T08:42:40.530810+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:00.475198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013500459999999999,"stat_sum":{"num_bytes":18505833,"num_objects":53,"num_object_clones":11,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":21,"num_read":5875,"num_read_kb":21567,"num_write":771,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":3660900,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"160'850","reported_seq":43584,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.709455+0000","last_change":"2024-09-14T08:42:20.377085+0000","last_active":"2024-09-14T08:42:42.709455+0000","last_peered":"2024-09-14T08:42:42.709455+0000","last_clean":"2024-09-14T08:42:42.709455+0000","last_became_active":"2024-09-14T08:42:20.373418+0000","last_became_peered":"2024-09-14T08:42:20.373418+0000","last_unstale":"2024-09-14T08:42:42.709455+0000","last_undegraded":"2024-09-14T08:42:42.709455+0000","last_fullsized":"2024-09-14T08:42:42.709455+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:00.272278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652499,"stat_sum":{"num_bytes":35178535,"num_objects":72,"num_object_clones":17,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":34,"num_read":48340,"num_read_kb":102090,"num_write":689,"num_write_kb":9595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":6565966,"num_keys_recovered":104,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"156'618","reported_seq":7558,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524111+0000","last_change":"2024-09-14T08:42:27.418543+0000","last_active":"2024-09-14T08:42:40.524111+0000","last_peered":"2024-09-14T08:42:40.524111+0000","last_clean":"2024-09-14T08:42:40.524111+0000","last_became_active":"2024-09-14T08:42:27.414699+0000","last_became_peered":"2024-09-14T08:42:27.414699+0000","last_unstale":"2024-09-14T08:42:40.524111+0000","last_undegraded":"2024-09-14T08:42:40.524111+0000","last_fullsized":"2024-09-14T08:42:40.524111+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:46:31.476400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024901429999999998,"stat_sum":{"num_bytes":28151824,"num_objects":57,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":20,"num_read":8984,"num_read_kb":22536,"num_write":487,"num_write_kb":7300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":4142592,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"157'269","reported_seq":7003,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.556894+0000","last_change":"2024-09-14T08:40:16.728183+0000","last_active":"2024-09-14T08:42:40.556894+0000","last_peered":"2024-09-14T08:42:40.556894+0000","last_clean":"2024-09-14T08:42:40.556894+0000","last_became_active":"2024-09-14T08:40:16.727022+0000","last_became_peered":"2024-09-14T08:40:16.727022+0000","last_unstale":"2024-09-14T08:42:40.556894+0000","last_undegraded":"2024-09-14T08:42:40.556894+0000","last_fullsized":"2024-09-14T08:42:40.556894+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:24:21.909932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002389113,"stat_sum":{"num_bytes":28541062,"num_objects":63,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":30,"num_read":6522,"num_read_kb":21411,"num_write":267,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"156'504","reported_seq":9022,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.524456+0000","last_change":"2024-09-14T08:42:34.510404+0000","last_active":"2024-09-14T08:42:40.524456+0000","last_peered":"2024-09-14T08:42:40.524456+0000","last_clean":"2024-09-14T08:42:40.524456+0000","last_became_active":"2024-09-14T08:42:34.505471+0000","last_became_peered":"2024-09-14T08:42:34.505471+0000","last_unstale":"2024-09-14T08:42:40.524456+0000","last_undegraded":"2024-09-14T08:42:40.524456+0000","last_fullsized":"2024-09-14T08:42:40.524456+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:24.805501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023917970000000002,"stat_sum":{"num_bytes":67330096,"num_objects":80,"num_object_clones":21,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":33,"num_read":7823,"num_read_kb":43790,"num_write":471,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":348,"num_bytes_recovered":15889488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"156'404","reported_seq":19246,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523459+0000","last_change":"2024-09-14T08:42:23.391779+0000","last_active":"2024-09-14T08:42:40.523459+0000","last_peered":"2024-09-14T08:42:40.523459+0000","last_clean":"2024-09-14T08:42:40.523459+0000","last_became_active":"2024-09-14T08:42:23.389353+0000","last_became_peered":"2024-09-14T08:42:23.389353+0000","last_unstale":"2024-09-14T08:42:40.523459+0000","last_undegraded":"2024-09-14T08:42:40.523459+0000","last_fullsized":"2024-09-14T08:42:40.523459+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:35:16.541594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024547029999999999,"stat_sum":{"num_bytes":74179742,"num_objects":76,"num_object_clones":22,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":29,"num_read":19941,"num_read_kb":55689,"num_write":427,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":1554330,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"158'458","reported_seq":43364,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.686983+0000","last_change":"2024-09-14T08:42:27.415099+0000","last_active":"2024-09-14T08:42:40.686983+0000","last_peered":"2024-09-14T08:42:40.686983+0000","last_clean":"2024-09-14T08:42:40.686983+0000","last_became_active":"2024-09-14T08:42:27.413056+0000","last_became_peered":"2024-09-14T08:42:27.413056+0000","last_unstale":"2024-09-14T08:42:40.686983+0000","last_undegraded":"2024-09-14T08:42:40.686983+0000","last_fullsized":"2024-09-14T08:42:40.686983+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:35.135246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001362044,"stat_sum":{"num_bytes":64341583,"num_objects":66,"num_object_clones":19,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":43583,"num_read_kb":101240,"num_write":387,"num_write_kb":14195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":13487774,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"156'542","reported_seq":6164,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-14T08:42:42.576248+0000","last_change":"2024-09-14T08:42:26.422171+0000","last_active":"2024-09-14T08:42:42.576248+0000","last_peered":"2024-09-14T08:42:42.576248+0000","last_clean":"2024-09-14T08:42:42.576248+0000","last_became_active":"2024-09-14T08:42:26.414400+0000","last_became_peered":"2024-09-14T08:42:26.414400+0000","last_unstale":"2024-09-14T08:42:42.576248+0000","last_undegraded":"2024-09-14T08:42:42.576248+0000","last_fullsized":"2024-09-14T08:42:42.576248+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:14.548842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013117140000000001,"stat_sum":{"num_bytes":22833825,"num_objects":63,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":26,"num_read":5517,"num_read_kb":20665,"num_write":563,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":13958088,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"156'818","reported_seq":3530,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-14T08:42:40.523876+0000","last_change":"2024-09-14T08:42:27.415786+0000","last_active":"2024-09-14T08:42:40.523876+0000","last_peered":"2024-09-14T08:42:40.523876+0000","last_clean":"2024-09-14T08:42:40.523876+0000","last_became_active":"2024-09-14T08:42:27.413923+0000","last_became_peered":"2024-09-14T08:42:27.413923+0000","last_unstale":"2024-09-14T08:42:40.523876+0000","last_undegraded":"2024-09-14T08:42:40.523876+0000","last_fullsized":"2024-09-14T08:42:40.523876+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:53:02.744445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018326740000000001,"stat_sum":{"num_bytes":25264299,"num_objects":64,"num_object_clones":13,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":31,"num_read":5523,"num_read_kb":13774,"num_write":1210,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":2328801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1167326894,"num_objects":2044,"num_object_clones":508,"num_object_copies":4088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2044,"num_whiteouts":914,"num_read":597798,"num_read_kb":1274295,"num_write":24481,"num_write_kb":294386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3890,"num_bytes_recovered":106953046,"num_keys_recovered":454,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":215846912,"data_stored":259920740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},"log_size":20841,"ondisk_log_size":20841,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105984,"kb_used_data":42856,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94265856,"statfs":{"total":96636764160,"available":96528236544,"internally_reserved":0,"allocated":43884544,"data_stored":53487551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77388,"kb_used_data":43184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294452,"statfs":{"total":96636764160,"available":96557518848,"internally_reserved":0,"allocated":44220416,"data_stored":56036160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101040,"kb_used_data":28872,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94270800,"statfs":{"total":96636764160,"available":96533299200,"internally_reserved":0,"allocated":29564928,"data_stored":32150384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99976,"kb_used_data":28532,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94271864,"statfs":{"total":96636764160,"available":96534388736,"internally_reserved":0,"allocated":29216768,"data_stored":31717233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607600,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136488,"kb_used_data":56724,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94235352,"statfs":{"total":96636764160,"available":96497000448,"internally_reserved":0,"allocated":58085376,"data_stored":66040953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846603,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83028,"kb_used_data":37180,"kb_used_omap":22,"kb_used_meta":45801,"kb_avail":94288812,"statfs":{"total":96636764160,"available":96551743488,"internally_reserved":0,"allocated":38072320,"data_stored":41092142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":46901024},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35336192,"data_stored":39480829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27324416,"data_stored":30926884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27725824,"data_stored":31406643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41766912,"data_stored":54675876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41996288,"data_stored":52697218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41697280,"data_stored":50733290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:42:45.318 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T08:42:45.319 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:42:45.319 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [1, 2, 4, 5, 0, 3] 2024-09-14T08:42:45.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2024-09-14T08:42:45.348 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:45.349 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:45.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:45.407 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:45.406+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:45.482 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:45.478+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:45.514 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:45.514 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:45.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:45.578 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:42:45.584 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:45.582+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:45.674 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-14T08:42:45.670+0000 7f7148add640 -1 mon.a@0(leader).osd e163 definitely_dead 0 2024-09-14T08:42:45.680 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:45.680 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:45.684 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:45.680+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:45.697 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:45.785 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:45.782+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:45.868 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:45.868 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:45.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:45.886 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:45.882+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:45.986 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:45.982+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:46.004 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:46.004 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:46.019 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:46.043 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:46.087 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:46.084+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:46.142 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:46.142 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:46.155 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:46.192 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:46.192 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:46.197 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:46.196+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:46.208 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:46.208 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:46.224 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:46.224 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:46.244 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:46.244 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:46.264 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:46.284 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:46.284 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:46.289 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:46.286+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:46.321 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:46.321 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:46.336 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:46.390 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:46.386+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:46.457 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:46.457 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:46.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:46.457 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 150.725396066, 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:42:46.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:42:46.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:42:46.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:42:46.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:42:46.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:42:46.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.189642241000001, 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.465 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:42:46.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:42:46.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.470 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.471 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:46.471 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:46.471 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.154977357000007, 2024-09-14T08:42:46.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:42:46.471 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.471 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.472 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:46.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:46.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:46.472 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:42:46.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.472 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:42:46.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:42:46.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:42:46.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:42:46.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:42:46.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:42:46.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 95.154776385999995, 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.478 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:42:46.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:42:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.254100996999995, 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:42:46.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:46.487 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.254066781999995, 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:46.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.254025292999998, 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.493 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:42:46.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:46.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.253966810999998, 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:42:46.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.253937132000004, 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:46.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.253907923, 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:42:46.506 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:42:46.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.246301627999998, 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.511 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:42:46.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:42:46.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.246273638000005, 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.246245306000006, 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.523 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.246203546999993, 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:42:46.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:42:46.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:42:46.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.246174667999995, 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.246140858999993, 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.533 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:42:46.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:42:46.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:46.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.246108500000005, 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:46.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.541 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.237980696999998, 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:42:46.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:46.546 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.237949712000002, 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:46.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:42:46.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.237920806000005, 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.551 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.555 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:46.557 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:46.557 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:46.558+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:46.587 INFO:teuthology.orchestra.run.smithi089.stderr:marked out osd.1. 2024-09-14T08:42:46.667 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:46.666+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:46.696 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:46.696 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:46.696 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:46.696 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:46.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:46.758 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:46.754+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:46.831 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:46.831 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:46.831 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:46.831 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:46.832 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:46.845 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:46.859 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:46.858+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:46.960 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:46.956+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:46.965 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:46.965 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:46.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 165.88689838400001, 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:46.966 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:42:46.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:46.970 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 165.88684118, 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:42:46.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 165.88678229600001, 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.975 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:42:46.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:42:46.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 165.88671737000001, 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:42:46.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 165.88665591899999, 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:42:46.984 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 165.88659638499999, 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.989 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:42:46.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 165.88653707500001, 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.994 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:46.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:46.998 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 165.88646504299999, 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:46.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:42:47.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:42:47.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:47.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:42:47.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:47.003 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.731764666, 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:47.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 141.731733241, 2024-09-14T08:42:47.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:47.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:42:47.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 97.367869620999997, 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.013 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:42:47.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 97.367810270999996, 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 97.367770319000002, 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:42:47.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:42:47.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.031 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.884347366, 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:42:47.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:42:47.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:42:47.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:42:47.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.877954799999998, 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:47.039 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:42:47.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:42:47.045 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 65.11836538, 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:47.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:42:47.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:42:47.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.052 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 65.077625978, 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:42:47.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:42:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:47.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.810054894000004, 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:47.060 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:42:47.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.061 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:47.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:42:47.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.746251000000001, 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.067 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:42:47.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:42:47.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.718779302000002, 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:47.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:47.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:42:47.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:42:47.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:42:47.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:42:47.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.081 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:47.081 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:47.081 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:47.082 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:47.083 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:47.080+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:47.184 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:47.182+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:47.216 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:47.217 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:47.217 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:47.217 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:47.230 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:47.319 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:47.318+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:47.386 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:47.382+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:47.401 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:47.401 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:47.401 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:47.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:47.503 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:47.502+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:47.581 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.622063281000003, 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:47.582 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:42:47.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.620866194999998, 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:47.588 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:47.588 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:42:47.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.588 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:47.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:42:47.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.620803502999998, 2024-09-14T08:42:47.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:42:47.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.620765755999997, 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:42:47.597 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:42:47.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:42:47.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:42:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.620668692999999, 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.602 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:47.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:42:47.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:42:47.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.620587845999999, 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:47.607 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:42:47.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.228581497, 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.612 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:42:47.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.617 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8998313620000005, 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.057207060999999997, 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681724+0000", 2024-09-14T08:42:47.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.804e-06 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681734+0000", 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6490000000000003e-06 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681751+0000", 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7176999999999998e-05 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681760+0000", 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681849+0000", 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8837000000000003e-05 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681981+0000", 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013216700000000001 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.685622+0000", 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003641483 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.690759+0000", 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051364820000000004 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738832+0000", 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.048073087 2024-09-14T08:42:47.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738883+0000", 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1428000000000003e-05 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738930+0000", 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6471000000000003e-05 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8753594800000002, 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032695727000000001, 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for ondisk", 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:42:47.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:42:47.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706196+0000", 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.387e-06 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706206+0000", 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706218+0000", 2024-09-14T08:42:47.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2092e-05 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706227+0000", 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6549999999999993e-06 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706292+0000", 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5571e-05 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for ondisk", 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706626+0000", 2024-09-14T08:42:47.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033403600000000001 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738890+0000", 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032263888999999997 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6051 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4012032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:42:47.628 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8069226739999991, 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030933603, 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6051 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774632+0000", 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774634+0000", 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774640+0000", 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9689999999999999e-06 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774645+0000", 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7359999999999998e-06 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805487+0000", 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030841179 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805527+0000", 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0442999999999999e-05 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805565+0000", 2024-09-14T08:42:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7854e-05 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6052 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3667968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8069019019999999, 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031002565999999999, 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6052 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774653+0000", 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.39e-07 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774655+0000", 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1560000000000002e-06 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774660+0000", 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774665+0000", 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805581+0000", 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030915857000000001 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805617+0000", 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5985999999999997e-05 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805655+0000", 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7771000000000001e-05 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.637 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6053 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3790848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8068815620000009, 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031072499, 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6053 2024-09-14T08:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774673+0000", 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774675+0000", 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0729999999999999e-06 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774679+0000", 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1840000000000001e-06 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774682+0000", 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805671+0000", 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030988430000000001 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805706+0000", 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5685999999999997e-05 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805745+0000", 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8637000000000003e-05 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6054 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3446784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8068678479999996, 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031147358, 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6054 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774688+0000", 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.378e-06 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774692+0000", 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0249999999999996e-06 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774695+0000", 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8289999999999999e-06 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805761+0000", 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031066142000000001 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805797+0000", 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5942000000000002e-05 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805834+0000", 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6789999999999998e-05 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6055 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4134912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.646 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.806855809, 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031224526999999998, 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6055 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774699+0000", 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774700+0000", 2024-09-14T08:42:47.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2440000000000001e-06 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774704+0000", 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6120000000000001e-06 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774707+0000", 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8940000000000002e-06 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805849+0000", 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031141629000000001 2024-09-14T08:42:47.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805887+0000", 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579000000000001e-05 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805923+0000", 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6207000000000001e-05 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.650 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6056 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3569664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.806843142, 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031298725999999999, 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6056 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.65e-07 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774712+0000", 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.238e-06 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774716+0000", 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.326e-06 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774719+0000", 2024-09-14T08:42:47.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8380000000000002e-06 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805938+0000", 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031219757000000001 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805973+0000", 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4999999999999997e-05 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806010+0000", 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6301999999999999e-05 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6057 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3913728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8068319309999996, 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031394058000000002, 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.655 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6057 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774723+0000", 2024-09-14T08:42:47.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.175e-06 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774727+0000", 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8979999999999998e-06 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774731+0000", 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8870000000000002e-06 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806036+0000", 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031304473999999999 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806076+0000", 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0037999999999999e-05 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806116+0000", 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0363e-05 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.659 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6058 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4036608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8068191369999997, 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031564481999999998, 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6058 2024-09-14T08:42:47.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3900000000000001e-07 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774736+0000", 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.204e-06 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774740+0000", 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3589999999999999e-06 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774742+0000", 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806144+0000", 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031401815999999999 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806220+0000", 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5556999999999995e-05 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806299+0000", 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9534000000000001e-05 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6059 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3692544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8068079069999996, 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031762410999999997, 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.664 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6059 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774748+0000", 2024-09-14T08:42:47.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2109999999999999e-06 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774751+0000", 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4060000000000001e-06 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774754+0000", 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806358+0000", 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031604039 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806434+0000", 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6068000000000004e-05 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806509+0000", 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4629000000000007e-05 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6060 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3471360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8067958579999992, 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031873437999999997, 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6060 2024-09-14T08:42:47.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774759+0000", 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3200000000000005e-07 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774761+0000", 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774767+0000", 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4280000000000001e-06 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774773+0000", 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2020000000000001e-06 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806543+0000", 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031769144999999999 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806589+0000", 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6119999999999999e-05 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806632+0000", 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2852000000000002e-05 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6061 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3815424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8067737899999994, 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032027014999999999, 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:47.673 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6061 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:47.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782424+0000", 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0076440379999999997 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782439+0000", 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4362000000000001e-05 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:47.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782448+0000", 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3929999999999997e-06 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782454+0000", 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9900000000000002e-06 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806671+0000", 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024216615 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806739+0000", 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8272e-05 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806807+0000", 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8344999999999997e-05 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:47.677 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:47.678 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:42:47.679 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:47.678+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:47.680 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:47.779 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:47.778+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:47.842 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:47.842 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:47.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:47.880 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:47.880+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:47.981 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:47.980+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:48.017 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:48.017 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:48.017 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:48.017 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:48.017 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:48.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:48.082 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:48.078+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:48.151 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:48.151 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 171.225336841, 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.156 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 171.22528206300001, 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:42:48.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 157.79751160399999, 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:48.161 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:42:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:42:48.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:42:48.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:48.165 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 134.80490753699999, 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:42:48.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:42:48.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 134.804069166, 2024-09-14T08:42:48.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:42:48.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:42:48.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.785561064999996, 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.175 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:48.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:42:48.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:42:48.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.785246856000001, 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.179 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:42:48.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.783610530000004, 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:42:48.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.783392570999993, 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:42:48.188 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.192 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.783097169000001, 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:48.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.782826334000006, 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:42:48.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:42:48.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:42:48.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.571635653000001, 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.201 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:48.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.205 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.571615618999999, 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.206 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:42:48.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.571594540999996, 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.210 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:42:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:42:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.571574947000002, 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:42:48.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.571554793000004, 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.219 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.571535397000005, 2024-09-14T08:42:48.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:42:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.565005596999995, 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:42:48.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.232 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.564985711000006, 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:48.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:42:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.564966337000001, 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.237 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:42:48.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:48.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:42:48.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:42:48.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.241 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:48.241 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:48.241 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:48.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:48.243 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:48.244+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:48.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:48.343 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:48.344+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:48.415 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:48.415 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:48.415 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:48.415 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:48.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:48.476 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:48.477 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:48.477 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:48.474+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:48.494 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:48.511 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:48.511 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:48.531 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:48.531 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:48.545 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:48.544+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:48.552 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:48.552 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:48.558 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:48.558 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:48.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:48.574 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:48.574 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:48.602 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:42:48.687 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:48.686+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:48.716 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:48.716 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:48.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:48.775 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:48.774+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:48.847 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:48.846+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:48.872 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:48.872 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:48.889 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:48.948 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:48.946+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:49.027 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:49.027 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:49.044 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:49.089 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:49.088+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:49.149 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:49.148+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:49.181 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:49.181 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:49.197 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:49.250 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:49.246+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:49.350 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:49.346+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:49.381 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:49.381 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:49.397 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:49.452 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:49.450+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:49.529 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:49.529 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:49.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:49.597 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:49.596+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:49.655 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:49.650+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:49.688 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:49.688 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:49.705 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:49.754 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:49.750+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:49.855 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:49.854+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:49.887 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:49.887 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:49.904 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:49.956 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:49.954+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:50.046 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:50.046 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:50.056 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:50.054+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:50.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:50.157 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:50.156+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:50.203 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:50.203 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:50.219 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:50.271 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:50.270+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:50.359 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:50.356+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:50.365 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:50.365 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:50.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:50.460 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:50.456+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:50.561 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:50.560+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:50.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:50.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:50.644 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:42:50.703 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:50.702+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:50.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:50.763 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:50.764+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:50.768 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:50.786 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:50.786 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:50.808 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:50.828 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:50.849 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:50.864 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:50.864+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:50.870 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:50.870 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:50.885 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:50.885 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:50.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:50.964 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:50.964+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:51.062 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:51.062 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:51.062 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:51.066 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:51.062+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:51.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:51.167 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:51.166+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 174.317775138, 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 174.31772036000001, 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:42:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:42:51.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 160.88994990099999, 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:42:51.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:42:51.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 137.89734583399999, 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:51.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:42:51.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:42:51.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:51.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:42:51.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 137.89650746300001, 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:42:51.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:42:51.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.877999361999997, 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.268 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.877685153000002, 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:42:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.876048827000005, 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:42:51.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:42:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:42:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:42:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:42:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:42:51.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:51.281 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.875830867999994, 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.285 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.875535466000002, 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.286 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:42:51.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.287 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:51.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.290 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.875264630999993, 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.291 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:42:51.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:42:51.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.664073950000002, 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.299 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.664053916, 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.300 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:42:51.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:42:51.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:42:51.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.664032837999997, 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:42:51.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.664013244000003, 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:42:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:42:51.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.313 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.663993090000005, 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:42:51.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.663973694000006, 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.657443893999996, 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.322 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:42:51.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:42:51.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.657424008000007, 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.327 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:42:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:42:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.657404634000002, 2024-09-14T08:42:51.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:42:51.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:42:51.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:42:51.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:42:51.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:42:51.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:42:51.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:42:51.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.336 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.336 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.336 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:51.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:51.338 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:51.340+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:51.438 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:51.434+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:51.505 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:51.505 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:51.505 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:51.505 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:51.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:51.563 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:51.562+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:51.625 INFO:tasks.thrashosds.thrasher:in_osds: [2, 4, 5, 0, 3] out_osds: [1] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:42:51.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T08:42:51.631 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:42:51.640 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:51.636+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:51.723 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:51.723 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:51.723 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:51.723 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:51.723 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:51.739 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:51.742 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:51.738+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:51.841 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:51.838+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:51.873 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:51.873 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:51.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:51.874 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:51.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.874 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:42:51.874 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:51.874 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 161.56824261, 2024-09-14T08:42:51.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:42:51.875 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.875 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.875 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:51.875 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.875 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:42:51.875 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:51.875 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:42:51.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:42:51.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:42:51.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:42:51.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:42:51.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:42:51.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:42:51.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:51.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.881 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 129.30613243100001, 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.882 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:42:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:42:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 129.30598526, 2024-09-14T08:42:51.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:42:51.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:42:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 129.30584346000001, 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:42:51.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:42:51.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.742577693000001, 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:42:51.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.734286402999999, 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:42:51.902 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.903 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.903 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.903 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:42:51.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.903 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:42:51.906 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.734263162000005, 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:42:51.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:42:51.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:42:51.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:42:51.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.911 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.734243898000003, 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:42:51.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:51.916 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.734224621999999, 2024-09-14T08:42:51.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:42:51.917 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.917 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.917 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.917 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:42:51.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.917 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:42:51.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:42:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.734012168999996, 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.726799076000006, 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:42:51.925 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:51.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:51.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:42:51.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.726777863999999, 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:51.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:42:51.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.726758513999997, 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:42:51.935 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:42:51.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:42:51.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:42:51.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.726731474999994, 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.944 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.726712324999994, 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:42:51.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.726690740999999, 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:42:51.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:42:51.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.726671331999995, 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.957 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.726652455999997, 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.958 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:42:51.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:42:51.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:42:51.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:42:51.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:51.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:42:51.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:42:51.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.718621619999993, 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:42:51.965 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.969 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.718595223999998, 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:51.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:42:51.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:42:51.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:51.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:51.974 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:51.975 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:51.976 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:51.976+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:52.076 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:52.072+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:52.107 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:52.107 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:52.107 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:52.107 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:52.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:52.213 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:52.212+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:52.278 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:52.274+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:52.287 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:52.287 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:52.287 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:52.287 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:52.287 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:52.301 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:52.389 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:52.388+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:52.465 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:52.465 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:52.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:52.465 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:52.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.465 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.465 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:52.465 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.21732857500001, 2024-09-14T08:42:52.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:42:52.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.217262245, 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:42:52.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.217206785, 2024-09-14T08:42:52.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:42:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:42:52.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.217147165, 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.479 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:42:52.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:42:52.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.217065625, 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.217009297, 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.488 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:42:52.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:42:52.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.21693780199999, 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:42:52.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:42:52.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:42:52.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:42:52.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:42:52.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:42:52.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:42:52.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.216864931, 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.503 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.503 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:52.503 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.21682271899999, 2024-09-14T08:42:52.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:42:52.503 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.503 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:42:52.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.216792889, 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.508 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:42:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:42:52.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:42:52.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:42:52.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.513 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.513 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:52.513 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.216764592, 2024-09-14T08:42:52.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:42:52.513 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.513 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.513 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.514 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:42:52.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.514 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:52.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:52.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.216723497, 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.518 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:42:52.522 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.216694467, 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:42:52.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.21666598300001, 2024-09-14T08:42:52.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:52.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:52.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.216637843, 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:42:52.532 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.21660914700001, 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.537 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:42:52.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:42:52.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:42:52.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:42:52.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:42:52.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.21658038999999, 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:42:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:42:52.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:42:52.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:52.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:42:52.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.21655234299999, 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.547 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:42:52.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.551 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.21652236599999, 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:42:52.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:42:52.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5914.0:814 3.f 3:f6536a47:::rbd_data.10f188ed37a0.000000000000005e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 430080~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-14T08:42:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.890903036000001, 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.94391447500000003, 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5914", 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3720252961", 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 814 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:42:52.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574373+0000", 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574383+0000", 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0027000000000001e-05 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574405+0000", 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469000000000001e-05 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574419+0000", 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543999999999999e-05 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574489+0000", 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0178999999999993e-05 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574497+0000", 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6320000000000008e-06 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508185+0000", 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.93368827499999996 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508493+0000", 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030869300000000002 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508838+0000", 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034456200000000003 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.512327+0000", 2024-09-14T08:42:52.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034889330000000001 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518113+0000", 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057857730000000001 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518217+0000", 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104319 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:52.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518285+0000", 2024-09-14T08:42:52.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8139000000000006e-05 2024-09-14T08:42:52.563 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.563 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.563 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.563 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:52.563 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:52.563 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:52.564 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:52.565 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:52.562+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:52.665 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T08:42:52.665 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:52.662+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:52.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T08:42:52.743 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:52.744 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:52.744 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:52.744 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:52.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:52.805 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:52.804+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:52.867 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:52.864+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:52.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:52.888 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:52.888 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:52.888 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:52.903 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:52.969 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:52.966+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:53.026 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:53.026 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:53.044 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:53.044 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:53.060 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:53.061 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:53.070 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:53.066+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:53.072 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:53.072 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:53.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:53.072 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:53.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.072 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:42:53.072 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:53.072 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 157.339433894, 2024-09-14T08:42:53.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:42:53.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:42:53.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:53.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:42:53.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 101.803680069, 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.079 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:53.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:42:53.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:42:53.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:42:53.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 101.769015185, 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:53.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:42:53.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 101.768814214, 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:42:53.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:42:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.868138825000003, 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.099 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.868104610000003, 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:42:53.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:42:53.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.868063121000006, 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:42:53.104 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:53.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:42:53.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:42:53.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:42:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.868004639000006, 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.867974959999998, 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.114 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:42:53.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:42:53.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:42:53.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:42:53.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.867945750999993, 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.860339456000005, 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:53.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:53.127 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.860311465999999, 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:42:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.860283133999999, 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.133 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.133 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:42:53.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.133 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:42:53.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:42:53.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.860241375000001, 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:42:53.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:42:53.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:42:53.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:42:53.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.142 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.142 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.142 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:53.142 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.860212496000003, 2024-09-14T08:42:53.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:42:53.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.860178687000001, 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:42:53.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:53.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:42:53.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:42:53.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:42:53.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:42:53.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:42:53.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:42:53.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:42:53.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:42:53.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:42:53.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:42:53.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:42:53.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:42:53.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.153 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.860146327999999, 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:53.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:42:53.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:42:53.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.852018525000005, 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.159 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:42:53.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:42:53.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.851987539999996, 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:42:53.163 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.851958633999999, 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:53.168 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:53.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:53.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:53.169 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:53.169 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:42:53.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.169 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:42:53.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:42:53.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:53.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:53.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:53.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:42:53.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:42:53.173 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.173 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.173 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.173 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:53.173 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:53.174 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:53.175 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:53.175 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:53.175 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:53.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:53.176 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:53.177 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:53.177 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:53.170+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:53.275 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:53.272+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:53.304 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:53.304 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:53.319 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:53.353 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T08:42:53.382 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T08:42:53.405 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:53.404+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:53.477 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:53.476+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:53.490 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:53.491 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:53.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:53.578 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:53.574+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:53.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:42:53.678 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:53.676+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:53.679 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:53.679 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:53.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:53.779 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:53.780+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:53.833 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:53.833 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:53.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:53.879 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:53.880+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:53.960 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:53.961 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:53.975 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:53.980 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:53.980+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:54.081 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:54.084+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:54.090 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:54.090 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:54.104 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:54.181 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:54.178+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:54.227 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:54.227 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:54.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:54.283 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:54.282+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:54.383 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:54.378+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:54.402 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:54.402 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:54.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:54.483 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:54.484+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:54.580 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:54.580 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:54.584 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:54.582+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:54.596 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:54.674 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:42:54.680 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T08:42:54.685 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:54.688+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:54.709 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T08:42:54.774 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:54.774 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:54.785 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:54.782+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:54.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:54.885 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:54.888+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:54.946 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:54.946 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:54.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:55.007 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:55.006+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:55.088 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:55.086+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:55.089 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:55.089 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:55.102 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:55.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:55.223 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:55.222+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:55.234 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:55.234 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:55.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:55.289 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:55.286+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:55.319 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:55.319 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:55.336 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:55.336 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:55.352 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:55.352 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:55.368 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:55.368 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:55.374 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:55.374 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:55.383 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:55.394 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:55.413 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:55.413 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:55.429 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:55.432+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:55.491 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:55.490+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:55.513 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.266229065, 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.514 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.518 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26616273499999, 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:42:55.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.266107275, 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.523 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:42:55.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26604765499999, 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:42:55.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.265966115, 2024-09-14T08:42:55.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:55.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:42:55.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.265909787, 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:42:55.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.541 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26583829200001, 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.265765421, 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:42:55.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.550 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26572320899999, 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:55.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:42:55.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:42:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.265693379, 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:42:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.265665082, 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:42:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.265623987, 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:42:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26559495699999, 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:42:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26556647300001, 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:42:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26553833299999, 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:42:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26550963700001, 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:42:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:42:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26548088000001, 2024-09-14T08:42:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:42:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.590 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26545283300001, 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.591 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:42:55.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:42:55.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 177.26542285599999, 2024-09-14T08:42:55.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:55.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:42:55.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:42:55.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5914.0:814 3.f 3:f6536a47:::rbd_data.10f188ed37a0.000000000000005e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 430080~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.939803525999999, 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.94391447500000003, 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5914", 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3720252961", 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 814 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:55.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574373+0000", 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:42:55.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574383+0000", 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0027000000000001e-05 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574405+0000", 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469000000000001e-05 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574419+0000", 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543999999999999e-05 2024-09-14T08:42:55.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574489+0000", 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0178999999999993e-05 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574497+0000", 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6320000000000008e-06 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:55.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508185+0000", 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.93368827499999996 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508493+0000", 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030869300000000002 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508838+0000", 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034456200000000003 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.512327+0000", 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034889330000000001 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518113+0000", 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057857730000000001 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518217+0000", 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104319 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:55.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:55.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:55.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518285+0000", 2024-09-14T08:42:55.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8139000000000006e-05 2024-09-14T08:42:55.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.606 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:55.606 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:55.606 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:55.607 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:55.608 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:55.606+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:55.693 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T08:42:55.708 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:55.706+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:55.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T08:42:55.787 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:55.787 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:55.788 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:55.788 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:55.802 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:55.849 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:55.852+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:55.909 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:55.906+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:55.928 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:55.928 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:55.928 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:55.928 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:55.929 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:55.942 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:56.010 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:56.006+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:56.109 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 160.37658379600001, 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.110 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:42:56.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:42:56.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 104.84082997100001, 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:42:56.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:42:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:42:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:42:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:42:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.122 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 104.806165087, 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:42:56.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 104.805964116, 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:42:56.128 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:42:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:42:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:42:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:42:56.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:42:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:42:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.133 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.905288726999999, 2024-09-14T08:42:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:42:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:42:56.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:42:56.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:42:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:42:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:42:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:42:56.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.905254511999999, 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:42:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:42:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:42:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:42:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:42:56.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:42:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:42:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.905213023000002, 2024-09-14T08:42:56.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:42:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.905154541000002, 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:42:56.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:42:56.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.905124861999994, 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.154 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:42:56.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:42:56.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:42:56.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.159 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.159 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.159 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:56.159 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.905095653000004, 2024-09-14T08:42:56.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:42:56.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.897489358000001, 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:42:56.164 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:42:56.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:42:56.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:42:56.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:42:56.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.897461367999995, 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:42:56.169 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:42:56.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:42:56.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:42:56.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:42:56.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.174 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.174 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.174 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:56.174 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.897433035999995, 2024-09-14T08:42:56.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:42:56.174 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:42:56.178 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.897391276999997, 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.179 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.183 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.897362397999999, 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:42:56.187 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.897328588999997, 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.188 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:42:56.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.897296229999995, 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:42:56.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:42:56.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.197 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.889168427000001, 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.889137442000006, 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.202 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.889108535999995, 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:42:56.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:42:56.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:42:56.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.211 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.211 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.211 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:56.212 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:56.213 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:56.212+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:56.312 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:56.310+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:56.385 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:56.385 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:56.385 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:42:56.385 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:56.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:56.449 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:56.452+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:56.514 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:56.516+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:56.520 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:56.520 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:42:56.520 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:42:56.520 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:42:56.520 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:56.534 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:56.621 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:56.624+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:56.697 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:42:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:42:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:42:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:42:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 175.618225653, 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:42:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 175.618168449, 2024-09-14T08:42:56.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 175.618109565, 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.707 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:42:56.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:42:56.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 175.618044639, 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.711 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 175.61798318800001, 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:42:56.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 175.61792365400001, 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 175.617864344, 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 175.61779231200001, 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.46309193499999, 2024-09-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 151.46306050999999, 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 107.09919689, 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:42:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:42:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:42:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:42:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 107.09913754, 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:56.751 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:42:56.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:42:56.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 107.09909758800001, 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:42:56.758 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:42:56.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:42:56.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:42:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.615674635000005, 2024-09-14T08:42:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:42:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.765 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:42:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:42:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:42:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:42:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:56.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:42:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:56.772 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 83.609282069000002, 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:42:56.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:42:56.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:56.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:56.779 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.849692649000005, 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:42:56.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:42:56.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:56.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.808953247000005, 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.786 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:42:56.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:42:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:42:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:42:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:42:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:42:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:42:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:42:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:42:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:42:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:42:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.541382162999994, 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:42:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:56.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:42:56.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:56.802 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.477578269000006, 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:56.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:42:56.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:42:56.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:42:56.809 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 74.450106571000006, 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:42:56.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:42:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:56.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:42:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:42:56.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:42:56.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:42:56.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:42:56.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:42:56.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.816 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:42:56.816 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:42:56.816 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:42:56.816 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:42:56.819 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T08:42:56.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:56.819 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T08:42:56.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:42:56.820 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:56.814+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:56.919 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:56.920+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:57.004 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:57.004 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:57.020 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:57.020+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:57.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:42:57.121 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:57.118+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:57.141 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:57.141 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:57.141 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:42:57.141 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:42:57.141 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:57.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:42:57.190 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:42:57.190 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:42:57.209 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-14T08:42:56.701039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1009079108,"num_objects":1719,"num_object_clones":365,"num_object_copies":3438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1719,"num_whiteouts":789,"num_read":602540,"num_read_kb":1282793,"num_write":25050,"num_write_kb":296601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5023,"num_bytes_recovered":135883703,"num_keys_recovered":550,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21699,"ondisk_log_size":21699,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":428600,"kb_used_data":192700,"kb_used_omap":28,"kb_used_meta":235747,"kb_avail":471430600,"statfs":{"total":483183820800,"available":482744934400,"internally_reserved":0,"allocated":197324800,"data_stored":233245864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29130,"internal_metadata":241405494},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-91431958,"num_objects":-122,"num_object_clones":-46,"num_object_copies":-244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-122,"num_whiteouts":-40,"num_read":1347,"num_read_kb":1145,"num_write":192,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":242,"num_bytes_recovered":6478635,"num_keys_recovered":25,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.032547"},"pg_stats":[{"pgid":"3.1f","version":"171'421","reported_seq":4545,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.413272+0000","last_change":"2024-09-14T08:42:53.362957+0000","last_active":"2024-09-14T08:42:53.413272+0000","last_peered":"2024-09-14T08:42:53.413272+0000","last_clean":"2024-09-14T08:42:53.413272+0000","last_became_active":"2024-09-14T08:42:25.417105+0000","last_became_peered":"2024-09-14T08:42:25.417105+0000","last_unstale":"2024-09-14T08:42:53.413272+0000","last_undegraded":"2024-09-14T08:42:53.413272+0000","last_fullsized":"2024-09-14T08:42:53.413272+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:14.651341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015283600000000001,"stat_sum":{"num_bytes":18458239,"num_objects":53,"num_object_clones":9,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":29,"num_read":3876,"num_read_kb":17018,"num_write":467,"num_write_kb":4747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":260,"num_bytes_recovered":6338482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.1e","version":"173'347","reported_seq":29670,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.718058+0000","last_change":"2024-09-14T08:42:55.718426+0000","last_active":"2024-09-14T08:42:55.718058+0000","last_peered":"2024-09-14T08:42:55.718058+0000","last_clean":"2024-09-14T08:42:55.718058+0000","last_became_active":"2024-09-14T08:42:26.418116+0000","last_became_peered":"2024-09-14T08:42:26.418116+0000","last_unstale":"2024-09-14T08:42:55.718058+0000","last_undegraded":"2024-09-14T08:42:55.718058+0000","last_fullsized":"2024-09-14T08:42:55.718058+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:45.904373+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.022309241,"stat_sum":{"num_bytes":24586784,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":26,"num_read":28755,"num_read_kb":35231,"num_write":354,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":339488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.1d","version":"173'661","reported_seq":7914,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.981809+0000","last_change":"2024-09-14T08:42:55.707261+0000","last_active":"2024-09-14T08:42:55.981809+0000","last_peered":"2024-09-14T08:42:55.981809+0000","last_clean":"2024-09-14T08:42:55.981809+0000","last_became_active":"2024-09-14T08:40:16.726695+0000","last_became_peered":"2024-09-14T08:40:16.726695+0000","last_unstale":"2024-09-14T08:42:55.981809+0000","last_undegraded":"2024-09-14T08:42:55.981809+0000","last_fullsized":"2024-09-14T08:42:55.981809+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:32.572809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010263265000000001,"stat_sum":{"num_bytes":17675294,"num_objects":57,"num_object_clones":12,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":27,"num_read":9802,"num_read_kb":39986,"num_write":683,"num_write_kb":5103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.1c","version":"173'665","reported_seq":8456,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.924863+0000","last_change":"2024-09-14T08:42:55.712801+0000","last_active":"2024-09-14T08:42:55.924863+0000","last_peered":"2024-09-14T08:42:55.924863+0000","last_clean":"2024-09-14T08:42:55.924863+0000","last_became_active":"2024-09-14T08:40:16.726971+0000","last_became_peered":"2024-09-14T08:40:16.726971+0000","last_unstale":"2024-09-14T08:42:55.924863+0000","last_undegraded":"2024-09-14T08:42:55.924863+0000","last_fullsized":"2024-09-14T08:42:55.924863+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:26.578890+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.016344226,"stat_sum":{"num_bytes":29573678,"num_objects":52,"num_object_clones":9,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":24,"num_read":8396,"num_read_kb":52857,"num_write":803,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.1b","version":"166'822","reported_seq":10613,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.361502+0000","last_change":"2024-09-14T08:42:53.361852+0000","last_active":"2024-09-14T08:42:53.361502+0000","last_peered":"2024-09-14T08:42:53.361502+0000","last_clean":"2024-09-14T08:42:53.361502+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:42:53.361502+0000","last_undegraded":"2024-09-14T08:42:53.361502+0000","last_fullsized":"2024-09-14T08:42:53.361502+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:19.655880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001241556,"stat_sum":{"num_bytes":21215395,"num_objects":42,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":16,"num_read":11300,"num_read_kb":55075,"num_write":882,"num_write_kb":5905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.1a","version":"173'476","reported_seq":12023,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.948802+0000","last_change":"2024-09-14T08:42:55.704856+0000","last_active":"2024-09-14T08:42:55.948802+0000","last_peered":"2024-09-14T08:42:55.948802+0000","last_clean":"2024-09-14T08:42:55.948802+0000","last_became_active":"2024-09-14T08:42:50.645071+0000","last_became_peered":"2024-09-14T08:42:50.645071+0000","last_unstale":"2024-09-14T08:42:55.948802+0000","last_undegraded":"2024-09-14T08:42:55.948802+0000","last_fullsized":"2024-09-14T08:42:55.948802+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:29.723690+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0095428500000000003,"stat_sum":{"num_bytes":46941766,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":22,"num_read":11602,"num_read_kb":31389,"num_write":518,"num_write_kb":5402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":3693126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.19","version":"172'694","reported_seq":6884,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.695741+0000","last_change":"2024-09-14T08:42:55.696456+0000","last_active":"2024-09-14T08:42:55.695741+0000","last_peered":"2024-09-14T08:42:55.695741+0000","last_clean":"2024-09-14T08:42:55.695741+0000","last_became_active":"2024-09-14T08:42:51.637987+0000","last_became_peered":"2024-09-14T08:42:51.637987+0000","last_unstale":"2024-09-14T08:42:55.695741+0000","last_undegraded":"2024-09-14T08:42:55.695741+0000","last_fullsized":"2024-09-14T08:42:55.695741+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:12.293801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187935,"stat_sum":{"num_bytes":13217543,"num_objects":56,"num_object_clones":8,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":25,"num_read":7522,"num_read_kb":22087,"num_write":699,"num_write_kb":7608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":143,"num_bytes_recovered":2070791,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.18","version":"167'531","reported_seq":7458,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.951124+0000","last_change":"2024-09-14T08:42:55.700161+0000","last_active":"2024-09-14T08:42:55.951124+0000","last_peered":"2024-09-14T08:42:55.951124+0000","last_clean":"2024-09-14T08:42:55.951124+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:42:55.951124+0000","last_undegraded":"2024-09-14T08:42:55.951124+0000","last_fullsized":"2024-09-14T08:42:55.951124+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:07.389220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006926827,"stat_sum":{"num_bytes":31690530,"num_objects":61,"num_object_clones":12,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":33,"num_read":7686,"num_read_kb":29293,"num_write":449,"num_write_kb":3297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.17","version":"164'721","reported_seq":6627,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.362899+0000","last_change":"2024-09-14T08:42:53.363430+0000","last_active":"2024-09-14T08:42:53.362899+0000","last_peered":"2024-09-14T08:42:53.362899+0000","last_clean":"2024-09-14T08:42:53.362899+0000","last_became_active":"2024-09-14T08:42:22.384895+0000","last_became_peered":"2024-09-14T08:42:22.384895+0000","last_unstale":"2024-09-14T08:42:53.362899+0000","last_undegraded":"2024-09-14T08:42:53.362899+0000","last_fullsized":"2024-09-14T08:42:53.362899+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:59.175455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011575890000000001,"stat_sum":{"num_bytes":26594702,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":22,"num_read":7893,"num_read_kb":36467,"num_write":1019,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":3097246,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.16","version":"172'622","reported_seq":6478,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.707359+0000","last_change":"2024-09-14T08:42:55.711053+0000","last_active":"2024-09-14T08:42:55.707359+0000","last_peered":"2024-09-14T08:42:55.707359+0000","last_clean":"2024-09-14T08:42:55.707359+0000","last_became_active":"2024-09-14T08:42:26.411760+0000","last_became_peered":"2024-09-14T08:42:26.411760+0000","last_unstale":"2024-09-14T08:42:55.707359+0000","last_undegraded":"2024-09-14T08:42:55.707359+0000","last_fullsized":"2024-09-14T08:42:55.707359+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:04.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013929643,"stat_sum":{"num_bytes":15282927,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":27,"num_read":31021,"num_read_kb":35393,"num_write":657,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":2542413,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.15","version":"173'1070","reported_seq":7774,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.868109+0000","last_change":"2024-09-14T08:42:55.710121+0000","last_active":"2024-09-14T08:42:55.868109+0000","last_peered":"2024-09-14T08:42:55.868109+0000","last_clean":"2024-09-14T08:42:55.868109+0000","last_became_active":"2024-09-14T08:42:28.415193+0000","last_became_peered":"2024-09-14T08:42:28.415193+0000","last_unstale":"2024-09-14T08:42:55.868109+0000","last_undegraded":"2024-09-14T08:42:55.868109+0000","last_fullsized":"2024-09-14T08:42:55.868109+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1070,"log_dups_size":0,"ondisk_log_size":1070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:03.785719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018366166999999999,"stat_sum":{"num_bytes":47317601,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":24,"num_read":12230,"num_read_kb":26400,"num_write":1284,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":11240906,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.14","version":"173'367","reported_seq":32742,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.708935+0000","last_change":"2024-09-14T08:42:55.709323+0000","last_active":"2024-09-14T08:42:55.708935+0000","last_peered":"2024-09-14T08:42:55.708935+0000","last_clean":"2024-09-14T08:42:55.708935+0000","last_became_active":"2024-09-14T08:42:25.417110+0000","last_became_peered":"2024-09-14T08:42:25.417110+0000","last_unstale":"2024-09-14T08:42:55.708935+0000","last_undegraded":"2024-09-14T08:42:55.708935+0000","last_fullsized":"2024-09-14T08:42:55.708935+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:21.569592+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.017829256000000002,"stat_sum":{"num_bytes":39371508,"num_objects":47,"num_object_clones":8,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":19,"num_read":32222,"num_read_kb":39509,"num_write":436,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":1573864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.692290+0000","last_change":"2024-09-14T08:42:22.375924+0000","last_active":"2024-09-14T08:42:55.692290+0000","last_peered":"2024-09-14T08:42:55.692290+0000","last_clean":"2024-09-14T08:42:55.692290+0000","last_became_active":"2024-09-14T08:42:22.375477+0000","last_became_peered":"2024-09-14T08:42:22.375477+0000","last_unstale":"2024-09-14T08:42:55.692290+0000","last_undegraded":"2024-09-14T08:42:55.692290+0000","last_fullsized":"2024-09-14T08:42:55.692290+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:38.473011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"170'2312","reported_seq":58276,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.361958+0000","last_change":"2024-09-14T08:42:53.362496+0000","last_active":"2024-09-14T08:42:53.361958+0000","last_peered":"2024-09-14T08:42:53.361958+0000","last_clean":"2024-09-14T08:42:53.361958+0000","last_became_active":"2024-09-14T08:42:51.640209+0000","last_became_peered":"2024-09-14T08:42:51.640209+0000","last_unstale":"2024-09-14T08:42:53.361958+0000","last_undegraded":"2024-09-14T08:42:53.361958+0000","last_fullsized":"2024-09-14T08:42:53.361958+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2312,"log_dups_size":0,"ondisk_log_size":2312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:56.512911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001802554,"stat_sum":{"num_bytes":50154681,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":27,"num_read":67336,"num_read_kb":67962,"num_write":3738,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":322,"num_bytes_recovered":8690265,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"2.6","version":"0'0","reported_seq":302,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.692061+0000","last_change":"2024-09-14T08:42:47.609788+0000","last_active":"2024-09-14T08:42:55.692061+0000","last_peered":"2024-09-14T08:42:55.692061+0000","last_clean":"2024-09-14T08:42:55.692061+0000","last_became_active":"2024-09-14T08:42:47.608802+0000","last_became_peered":"2024-09-14T08:42:47.608802+0000","last_unstale":"2024-09-14T08:42:55.692061+0000","last_undegraded":"2024-09-14T08:42:55.692061+0000","last_fullsized":"2024-09-14T08:42:55.692061+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:54.044666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"171'699","reported_seq":58413,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.918159+0000","last_change":"2024-09-14T08:42:55.707952+0000","last_active":"2024-09-14T08:42:55.918159+0000","last_peered":"2024-09-14T08:42:55.918159+0000","last_clean":"2024-09-14T08:42:55.918159+0000","last_became_active":"2024-09-14T08:42:51.638044+0000","last_became_peered":"2024-09-14T08:42:51.638044+0000","last_unstale":"2024-09-14T08:42:55.918159+0000","last_undegraded":"2024-09-14T08:42:55.918159+0000","last_fullsized":"2024-09-14T08:42:55.918159+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:00.523309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013224804,"stat_sum":{"num_bytes":27924549,"num_objects":55,"num_object_clones":12,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":25,"num_read":52347,"num_read_kb":50140,"num_write":533,"num_write_kb":32319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":128,"num_bytes_recovered":3263572,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.5","version":"0'0","reported_seq":69,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.691514+0000","last_change":"2024-09-14T08:42:22.382565+0000","last_active":"2024-09-14T08:42:55.691514+0000","last_peered":"2024-09-14T08:42:55.691514+0000","last_clean":"2024-09-14T08:42:55.691514+0000","last_became_active":"2024-09-14T08:42:22.382087+0000","last_became_peered":"2024-09-14T08:42:22.382087+0000","last_unstale":"2024-09-14T08:42:55.691514+0000","last_undegraded":"2024-09-14T08:42:55.691514+0000","last_fullsized":"2024-09-14T08:42:55.691514+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:39.458480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"173'571","reported_seq":6206,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.710002+0000","last_change":"2024-09-14T08:42:55.712197+0000","last_active":"2024-09-14T08:42:55.710002+0000","last_peered":"2024-09-14T08:42:55.710002+0000","last_clean":"2024-09-14T08:42:55.710002+0000","last_became_active":"2024-09-14T08:42:51.637358+0000","last_became_peered":"2024-09-14T08:42:51.637358+0000","last_unstale":"2024-09-14T08:42:55.710002+0000","last_undegraded":"2024-09-14T08:42:55.710002+0000","last_fullsized":"2024-09-14T08:42:55.710002+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:47.394208+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017699775000000001,"stat_sum":{"num_bytes":39877775,"num_objects":57,"num_object_clones":13,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":32,"num_read":6259,"num_read_kb":17080,"num_write":585,"num_write_kb":20401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":4646686,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.4","version":"0'0","reported_seq":287,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.360452+0000","last_change":"2024-09-14T08:42:47.609601+0000","last_active":"2024-09-14T08:42:53.360452+0000","last_peered":"2024-09-14T08:42:53.360452+0000","last_clean":"2024-09-14T08:42:53.360452+0000","last_became_active":"2024-09-14T08:42:47.609324+0000","last_became_peered":"2024-09-14T08:42:47.609324+0000","last_unstale":"2024-09-14T08:42:53.360452+0000","last_undegraded":"2024-09-14T08:42:53.360452+0000","last_fullsized":"2024-09-14T08:42:53.360452+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:12:04.494863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"167'729","reported_seq":10001,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.897403+0000","last_change":"2024-09-14T08:42:55.713027+0000","last_active":"2024-09-14T08:42:55.897403+0000","last_peered":"2024-09-14T08:42:55.897403+0000","last_clean":"2024-09-14T08:42:55.897403+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:42:55.897403+0000","last_undegraded":"2024-09-14T08:42:55.897403+0000","last_fullsized":"2024-09-14T08:42:55.897403+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:28.846577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017439298999999998,"stat_sum":{"num_bytes":22563064,"num_objects":62,"num_object_clones":12,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":30,"num_read":11077,"num_read_kb":43135,"num_write":1022,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.3","version":"173'1415","reported_seq":20979,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.890219+0000","last_change":"2024-09-14T08:42:55.718705+0000","last_active":"2024-09-14T08:42:55.890219+0000","last_peered":"2024-09-14T08:42:55.890219+0000","last_clean":"2024-09-14T08:42:55.890219+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:42:55.890219+0000","last_undegraded":"2024-09-14T08:42:55.890219+0000","last_fullsized":"2024-09-14T08:42:55.890219+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:57.781533+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.020794996999999999,"stat_sum":{"num_bytes":12432495,"num_objects":55,"num_object_clones":10,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":31,"num_read":24679,"num_read_kb":26884,"num_write":2288,"num_write_kb":5034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.2","version":"19'2","reported_seq":27,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.359873+0000","last_change":"2024-09-14T08:42:47.619715+0000","last_active":"2024-09-14T08:42:53.359873+0000","last_peered":"2024-09-14T08:42:53.359873+0000","last_clean":"2024-09-14T08:42:53.359873+0000","last_became_active":"2024-09-14T08:42:47.614777+0000","last_became_peered":"2024-09-14T08:42:47.614777+0000","last_unstale":"2024-09-14T08:42:53.359873+0000","last_undegraded":"2024-09-14T08:42:53.359873+0000","last_fullsized":"2024-09-14T08:42:53.359873+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:31.964359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"173'407","reported_seq":27591,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.977772+0000","last_change":"2024-09-14T08:42:55.697189+0000","last_active":"2024-09-14T08:42:55.977772+0000","last_peered":"2024-09-14T08:42:55.977772+0000","last_clean":"2024-09-14T08:42:55.977772+0000","last_became_active":"2024-09-14T08:42:50.641457+0000","last_became_peered":"2024-09-14T08:42:50.641457+0000","last_unstale":"2024-09-14T08:42:55.977772+0000","last_undegraded":"2024-09-14T08:42:55.977772+0000","last_fullsized":"2024-09-14T08:42:55.977772+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:05.167234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045143730000000003,"stat_sum":{"num_bytes":17184894,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":20,"num_read":26922,"num_read_kb":27559,"num_write":419,"num_write_kb":3533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":1973374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":335,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.694101+0000","last_change":"2024-09-14T08:42:47.612389+0000","last_active":"2024-09-14T08:42:55.694101+0000","last_peered":"2024-09-14T08:42:55.694101+0000","last_clean":"2024-09-14T08:42:55.694101+0000","last_became_active":"2024-09-14T08:42:47.611579+0000","last_became_peered":"2024-09-14T08:42:47.611579+0000","last_unstale":"2024-09-14T08:42:55.694101+0000","last_undegraded":"2024-09-14T08:42:55.694101+0000","last_fullsized":"2024-09-14T08:42:55.694101+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:02.018600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'391","reported_seq":8496,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.360503+0000","last_change":"2024-09-14T08:42:53.360943+0000","last_active":"2024-09-14T08:42:53.360503+0000","last_peered":"2024-09-14T08:42:53.360503+0000","last_clean":"2024-09-14T08:42:53.360503+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:42:53.360503+0000","last_undegraded":"2024-09-14T08:42:53.360503+0000","last_fullsized":"2024-09-14T08:42:53.360503+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:57.116518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093347000000000005,"stat_sum":{"num_bytes":50922533,"num_objects":43,"num_object_clones":13,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":22,"num_read":7742,"num_read_kb":16833,"num_write":415,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.691012+0000","last_change":"2024-09-14T08:42:47.603243+0000","last_active":"2024-09-14T08:42:55.691012+0000","last_peered":"2024-09-14T08:42:55.691012+0000","last_clean":"2024-09-14T08:42:55.691012+0000","last_became_active":"2024-09-14T08:42:47.602254+0000","last_became_peered":"2024-09-14T08:42:47.602254+0000","last_unstale":"2024-09-14T08:42:55.691012+0000","last_undegraded":"2024-09-14T08:42:55.691012+0000","last_fullsized":"2024-09-14T08:42:55.691012+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:10.348781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"173'475","reported_seq":17788,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.982858+0000","last_change":"2024-09-14T08:42:55.692354+0000","last_active":"2024-09-14T08:42:55.982858+0000","last_peered":"2024-09-14T08:42:55.982858+0000","last_clean":"2024-09-14T08:42:55.982858+0000","last_became_active":"2024-09-14T08:42:50.640092+0000","last_became_peered":"2024-09-14T08:42:50.640092+0000","last_unstale":"2024-09-14T08:42:55.982858+0000","last_undegraded":"2024-09-14T08:42:55.982858+0000","last_fullsized":"2024-09-14T08:42:55.982858+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:01:37.639580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001140715,"stat_sum":{"num_bytes":33712372,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":18,"num_read":17753,"num_read_kb":57235,"num_write":579,"num_write_kb":6792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4162898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.3","version":"17'1","reported_seq":247,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.695404+0000","last_change":"2024-09-14T08:40:16.718478+0000","last_active":"2024-09-14T08:42:55.695404+0000","last_peered":"2024-09-14T08:42:55.695404+0000","last_clean":"2024-09-14T08:42:55.695404+0000","last_became_active":"2024-09-14T08:40:16.717575+0000","last_became_peered":"2024-09-14T08:40:16.717575+0000","last_unstale":"2024-09-14T08:42:55.695404+0000","last_undegraded":"2024-09-14T08:42:55.695404+0000","last_fullsized":"2024-09-14T08:42:55.695404+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:50.808473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":75,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.691028+0000","last_change":"2024-09-14T08:42:22.399938+0000","last_active":"2024-09-14T08:42:55.691028+0000","last_peered":"2024-09-14T08:42:55.691028+0000","last_clean":"2024-09-14T08:42:55.691028+0000","last_became_active":"2024-09-14T08:42:22.385069+0000","last_became_peered":"2024-09-14T08:42:22.385069+0000","last_unstale":"2024-09-14T08:42:55.691028+0000","last_undegraded":"2024-09-14T08:42:55.691028+0000","last_fullsized":"2024-09-14T08:42:55.691028+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:01.403929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"173'525","reported_seq":34939,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.707363+0000","last_change":"2024-09-14T08:42:55.707363+0000","last_active":"2024-09-14T08:42:55.707363+0000","last_peered":"2024-09-14T08:42:55.707363+0000","last_clean":"2024-09-14T08:42:55.707363+0000","last_became_active":"2024-09-14T08:42:50.639888+0000","last_became_peered":"2024-09-14T08:42:50.639888+0000","last_unstale":"2024-09-14T08:42:55.707363+0000","last_undegraded":"2024-09-14T08:42:55.707363+0000","last_fullsized":"2024-09-14T08:42:55.707363+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:09.172671+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.013806634,"stat_sum":{"num_bytes":21720179,"num_objects":48,"num_object_clones":6,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":20,"num_read":33080,"num_read_kb":35531,"num_write":422,"num_write_kb":3443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":1670787,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.9","version":"173'932","reported_seq":16206,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.860665+0000","last_change":"2024-09-14T08:42:55.702794+0000","last_active":"2024-09-14T08:42:55.860665+0000","last_peered":"2024-09-14T08:42:55.860665+0000","last_clean":"2024-09-14T08:42:55.860665+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:42:55.860665+0000","last_undegraded":"2024-09-14T08:42:55.860665+0000","last_fullsized":"2024-09-14T08:42:55.860665+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":932,"log_dups_size":0,"ondisk_log_size":932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:12:13.520139+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0070862010000000003,"stat_sum":{"num_bytes":23625070,"num_objects":62,"num_object_clones":12,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":27,"num_read":15542,"num_read_kb":32505,"num_write":775,"num_write_kb":8902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.a","version":"173'574","reported_seq":13685,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.860130+0000","last_change":"2024-09-14T08:42:55.716425+0000","last_active":"2024-09-14T08:42:55.860130+0000","last_peered":"2024-09-14T08:42:55.860130+0000","last_clean":"2024-09-14T08:42:55.860130+0000","last_became_active":"2024-09-14T08:40:36.358876+0000","last_became_peered":"2024-09-14T08:40:36.358876+0000","last_unstale":"2024-09-14T08:42:55.860130+0000","last_undegraded":"2024-09-14T08:42:55.860130+0000","last_fullsized":"2024-09-14T08:42:55.860130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:43.722099+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.021632052999999998,"stat_sum":{"num_bytes":62023233,"num_objects":46,"num_object_clones":10,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":20,"num_read":14429,"num_read_kb":83630,"num_write":580,"num_write_kb":41439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":5746688,"num_keys_recovered":33,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.b","version":"169'617","reported_seq":5706,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.361060+0000","last_change":"2024-09-14T08:42:53.361413+0000","last_active":"2024-09-14T08:42:53.361060+0000","last_peered":"2024-09-14T08:42:53.361060+0000","last_clean":"2024-09-14T08:42:53.361060+0000","last_became_active":"2024-09-14T08:42:50.638810+0000","last_became_peered":"2024-09-14T08:42:50.638810+0000","last_unstale":"2024-09-14T08:42:53.361060+0000","last_undegraded":"2024-09-14T08:42:53.361060+0000","last_fullsized":"2024-09-14T08:42:53.361060+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:46.400616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013362700000000001,"stat_sum":{"num_bytes":18505796,"num_objects":51,"num_object_clones":11,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":21,"num_read":6312,"num_read_kb":21940,"num_write":801,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":6134440,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.c","version":"170'858","reported_seq":43644,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.362155+0000","last_change":"2024-09-14T08:42:53.362528+0000","last_active":"2024-09-14T08:42:53.362155+0000","last_peered":"2024-09-14T08:42:53.362155+0000","last_clean":"2024-09-14T08:42:53.362155+0000","last_became_active":"2024-09-14T08:42:20.373418+0000","last_became_peered":"2024-09-14T08:42:20.373418+0000","last_unstale":"2024-09-14T08:42:53.362155+0000","last_undegraded":"2024-09-14T08:42:53.362155+0000","last_fullsized":"2024-09-14T08:42:53.362155+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:10.120375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001718437,"stat_sum":{"num_bytes":31991847,"num_objects":65,"num_object_clones":14,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":32,"num_read":48340,"num_read_kb":102090,"num_write":691,"num_write_kb":9595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":6565966,"num_keys_recovered":104,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.d","version":"171'626","reported_seq":7643,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.709783+0000","last_change":"2024-09-14T08:42:55.710460+0000","last_active":"2024-09-14T08:42:55.709783+0000","last_peered":"2024-09-14T08:42:55.709783+0000","last_clean":"2024-09-14T08:42:55.709783+0000","last_became_active":"2024-09-14T08:42:27.414699+0000","last_became_peered":"2024-09-14T08:42:27.414699+0000","last_unstale":"2024-09-14T08:42:55.709783+0000","last_undegraded":"2024-09-14T08:42:55.709783+0000","last_fullsized":"2024-09-14T08:42:55.709783+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:53.578336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018698904999999998,"stat_sum":{"num_bytes":21204992,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":18,"num_read":8994,"num_read_kb":22539,"num_write":491,"num_write_kb":7328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":4142592,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.e","version":"173'284","reported_seq":7098,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.718390+0000","last_change":"2024-09-14T08:42:55.718773+0000","last_active":"2024-09-14T08:42:55.718390+0000","last_peered":"2024-09-14T08:42:55.718390+0000","last_clean":"2024-09-14T08:42:55.718390+0000","last_became_active":"2024-09-14T08:40:16.727022+0000","last_became_peered":"2024-09-14T08:40:16.727022+0000","last_unstale":"2024-09-14T08:42:55.718390+0000","last_undegraded":"2024-09-14T08:42:55.718390+0000","last_fullsized":"2024-09-14T08:42:55.718390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:01.201796+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.021372710999999999,"stat_sum":{"num_bytes":23751184,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":24,"num_read":6538,"num_read_kb":21436,"num_write":270,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.f","version":"173'518","reported_seq":9111,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.718335+0000","last_change":"2024-09-14T08:42:55.718681+0000","last_active":"2024-09-14T08:42:55.718335+0000","last_peered":"2024-09-14T08:42:55.718335+0000","last_clean":"2024-09-14T08:42:55.718335+0000","last_became_active":"2024-09-14T08:42:34.505471+0000","last_became_peered":"2024-09-14T08:42:34.505471+0000","last_unstale":"2024-09-14T08:42:55.718335+0000","last_undegraded":"2024-09-14T08:42:55.718335+0000","last_fullsized":"2024-09-14T08:42:55.718335+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:46.649365+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.026640189000000002,"stat_sum":{"num_bytes":50459168,"num_objects":67,"num_object_clones":16,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":29,"num_read":7832,"num_read_kb":43793,"num_write":475,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":348,"num_bytes_recovered":15889488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.10","version":"171'423","reported_seq":19341,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.694773+0000","last_change":"2024-09-14T08:42:55.696105+0000","last_active":"2024-09-14T08:42:55.694773+0000","last_peered":"2024-09-14T08:42:55.694773+0000","last_clean":"2024-09-14T08:42:55.694773+0000","last_became_active":"2024-09-14T08:42:23.389353+0000","last_became_peered":"2024-09-14T08:42:23.389353+0000","last_unstale":"2024-09-14T08:42:55.694773+0000","last_undegraded":"2024-09-14T08:42:55.694773+0000","last_fullsized":"2024-09-14T08:42:55.694773+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:59.120428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036552170000000001,"stat_sum":{"num_bytes":71857294,"num_objects":61,"num_object_clones":15,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":22,"num_read":19952,"num_read_kb":55710,"num_write":432,"num_write_kb":3477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":1554330,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.11","version":"173'490","reported_seq":43607,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.707447+0000","last_change":"2024-09-14T08:42:55.707841+0000","last_active":"2024-09-14T08:42:55.707447+0000","last_peered":"2024-09-14T08:42:55.707447+0000","last_clean":"2024-09-14T08:42:55.707447+0000","last_became_active":"2024-09-14T08:42:27.413056+0000","last_became_peered":"2024-09-14T08:42:27.413056+0000","last_unstale":"2024-09-14T08:42:55.707447+0000","last_undegraded":"2024-09-14T08:42:55.707447+0000","last_fullsized":"2024-09-14T08:42:55.707447+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:31.594050+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.016558494,"stat_sum":{"num_bytes":60701263,"num_objects":55,"num_object_clones":14,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":28,"num_read":43989,"num_read_kb":101589,"num_write":404,"num_write_kb":14201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":13487774,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.12","version":"169'552","reported_seq":6228,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.361135+0000","last_change":"2024-09-14T08:42:53.361850+0000","last_active":"2024-09-14T08:42:53.361135+0000","last_peered":"2024-09-14T08:42:53.361135+0000","last_clean":"2024-09-14T08:42:53.361135+0000","last_became_active":"2024-09-14T08:42:26.414400+0000","last_became_peered":"2024-09-14T08:42:26.414400+0000","last_unstale":"2024-09-14T08:42:53.361135+0000","last_undegraded":"2024-09-14T08:42:53.361135+0000","last_fullsized":"2024-09-14T08:42:53.361135+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:13.549394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00159318,"stat_sum":{"num_bytes":21080690,"num_objects":54,"num_object_clones":13,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":23,"num_read":5523,"num_read_kb":20668,"num_write":565,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":13958088,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.13","version":"173'829","reported_seq":3611,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.697211+0000","last_change":"2024-09-14T08:42:55.697621+0000","last_active":"2024-09-14T08:42:55.697211+0000","last_peered":"2024-09-14T08:42:55.697211+0000","last_clean":"2024-09-14T08:42:55.697211+0000","last_became_active":"2024-09-14T08:42:27.413923+0000","last_became_peered":"2024-09-14T08:42:27.413923+0000","last_unstale":"2024-09-14T08:42:55.697211+0000","last_undegraded":"2024-09-14T08:42:55.697211+0000","last_fullsized":"2024-09-14T08:42:55.697211+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:17:35.508495+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0062778699999999996,"stat_sum":{"num_bytes":14869675,"num_objects":53,"num_object_clones":8,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":26,"num_read":5523,"num_read_kb":13774,"num_write":1211,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":2328801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1008488721,"num_objects":1715,"num_object_clones":365,"num_object_copies":3430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1715,"num_whiteouts":789,"num_read":602474,"num_read_kb":1282738,"num_write":24947,"num_write_kb":294971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5012,"num_bytes_recovered":132931844,"num_keys_recovered":550,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":195821568,"data_stored":239586159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},"log_size":21624,"ondisk_log_size":21624,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114784,"kb_used_data":47500,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94257056,"statfs":{"total":96636764160,"available":96519225344,"internally_reserved":0,"allocated":48640000,"data_stored":59949198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77952,"kb_used_data":46748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94293888,"statfs":{"total":96636764160,"available":96556941312,"internally_reserved":0,"allocated":47869952,"data_stored":60328540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75820,"kb_used_data":30740,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94296020,"statfs":{"total":96636764160,"available":96559124480,"internally_reserved":0,"allocated":31477760,"data_stored":33783161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":0,"seq":55834574898,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607603,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99764,"kb_used_data":36640,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94272076,"statfs":{"total":96636764160,"available":96534605824,"internally_reserved":0,"allocated":37519360,"data_stored":44836068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846605,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60280,"kb_used_data":31072,"kb_used_omap":22,"kb_used_meta":29161,"kb_avail":94311560,"statfs":{"total":96636764160,"available":96575037440,"internally_reserved":0,"allocated":31817728,"data_stored":34348897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":29861664},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28340224,"data_stored":32093470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12251136,"data_stored":14289105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28725248,"data_stored":31992962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45006848,"data_stored":58687188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46567424,"data_stored":59077696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34930688,"data_stored":43445738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:42:57.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:42:57.251 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:57.250+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:57.306 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:42:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:42:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:42:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.348463914, 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:42:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:42:57.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:42:57.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.311 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.347266828000002, 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:57.312 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:57.316 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.347204136000002, 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:42:57.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:42:57.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.347166389000002, 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:42:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:42:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:42:57.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.347069326000003, 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.326 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:42:57.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 42.346988478999997, 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:42:57.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:42:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:42:57.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 37.954982129999998, 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:42:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:42:57.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:42:57.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.626231995000001, 2024-09-14T08:42:57.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.057207060999999997, 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:42:57.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681724+0000", 2024-09-14T08:42:57.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.804e-06 2024-09-14T08:42:57.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681734+0000", 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6490000000000003e-06 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681751+0000", 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7176999999999998e-05 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681760+0000", 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681849+0000", 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8837000000000003e-05 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681981+0000", 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013216700000000001 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.685622+0000", 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003641483 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.690759+0000", 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051364820000000004 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738832+0000", 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.048073087 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738883+0000", 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1428000000000003e-05 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738930+0000", 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6471000000000003e-05 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.349 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.349 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:42:57.349 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.601760113000001, 2024-09-14T08:42:57.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032695727000000001, 2024-09-14T08:42:57.349 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.349 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.349 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for ondisk", 2024-09-14T08:42:57.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706196+0000", 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.387e-06 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706206+0000", 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706218+0000", 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2092e-05 2024-09-14T08:42:57.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706227+0000", 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6549999999999993e-06 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706292+0000", 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5571e-05 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for ondisk", 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706626+0000", 2024-09-14T08:42:57.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033403600000000001 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738890+0000", 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032263888999999997 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6051 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4012032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.533323307, 2024-09-14T08:42:57.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030933603, 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6051 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:42:57.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774632+0000", 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774634+0000", 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774640+0000", 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9689999999999999e-06 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774645+0000", 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7359999999999998e-06 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805487+0000", 2024-09-14T08:42:57.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030841179 2024-09-14T08:42:57.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805527+0000", 2024-09-14T08:42:57.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0442999999999999e-05 2024-09-14T08:42:57.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805565+0000", 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7854e-05 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6052 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3667968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.533302535000001, 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031002565999999999, 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.358 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6052 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:42:57.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774653+0000", 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.39e-07 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774655+0000", 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1560000000000002e-06 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774660+0000", 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774665+0000", 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805581+0000", 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030915857000000001 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805617+0000", 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5985999999999997e-05 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805655+0000", 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7771000000000001e-05 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6053 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3790848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.362 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.533282194999998, 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031072499, 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6053 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:42:57.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774673+0000", 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774675+0000", 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0729999999999999e-06 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774679+0000", 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1840000000000001e-06 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774682+0000", 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:42:57.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805671+0000", 2024-09-14T08:42:57.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030988430000000001 2024-09-14T08:42:57.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805706+0000", 2024-09-14T08:42:57.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5685999999999997e-05 2024-09-14T08:42:57.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805745+0000", 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8637000000000003e-05 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6054 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3446784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:42:57.367 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.533268481, 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031147358, 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6054 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:42:57.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774688+0000", 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.378e-06 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774692+0000", 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0249999999999996e-06 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774695+0000", 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8289999999999999e-06 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805761+0000", 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031066142000000001 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805797+0000", 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5942000000000002e-05 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805834+0000", 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6789999999999998e-05 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6055 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4134912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.533256441999999, 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031224526999999998, 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6055 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774699+0000", 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774700+0000", 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2440000000000001e-06 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774704+0000", 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6120000000000001e-06 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774707+0000", 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8940000000000002e-06 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805849+0000", 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031141629000000001 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805887+0000", 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579000000000001e-05 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805923+0000", 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6207000000000001e-05 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6056 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3569664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:42:57.376 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.533243774999999, 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031298725999999999, 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6056 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:42:57.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.65e-07 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774712+0000", 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.238e-06 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774716+0000", 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.326e-06 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774719+0000", 2024-09-14T08:42:57.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8380000000000002e-06 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805938+0000", 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031219757000000001 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805973+0000", 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4999999999999997e-05 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806010+0000", 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6301999999999999e-05 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6057 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3913728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.533232563999999, 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031394058000000002, 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.381 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6057 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774723+0000", 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.175e-06 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774727+0000", 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8979999999999998e-06 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774731+0000", 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8870000000000002e-06 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806036+0000", 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031304473999999999 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806076+0000", 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0037999999999999e-05 2024-09-14T08:42:57.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806116+0000", 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0363e-05 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6058 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4036608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.533219769999999, 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031564481999999998, 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.385 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6058 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3900000000000001e-07 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774736+0000", 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.204e-06 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774740+0000", 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3589999999999999e-06 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774742+0000", 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806144+0000", 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031401815999999999 2024-09-14T08:42:57.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806220+0000", 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5556999999999995e-05 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806299+0000", 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9534000000000001e-05 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.389 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6059 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3692544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.53320854, 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031762410999999997, 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6059 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774748+0000", 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2109999999999999e-06 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774751+0000", 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4060000000000001e-06 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774754+0000", 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806358+0000", 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031604039 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806434+0000", 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6068000000000004e-05 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806509+0000", 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4629000000000007e-05 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.393 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6060 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3471360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.533196490999998, 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031873437999999997, 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6060 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.394 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774759+0000", 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3200000000000005e-07 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774761+0000", 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774767+0000", 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4280000000000001e-06 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774773+0000", 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2020000000000001e-06 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806543+0000", 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031769144999999999 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806589+0000", 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6119999999999999e-05 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806632+0000", 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2852000000000002e-05 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6061 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3815424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.533174422999998, 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032027014999999999, 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:42:57.398 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6061 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:42:57.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782424+0000", 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0076440379999999997 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782439+0000", 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4362000000000001e-05 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:42:57.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782448+0000", 2024-09-14T08:42:57.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3929999999999997e-06 2024-09-14T08:42:57.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:42:57.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782454+0000", 2024-09-14T08:42:57.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9900000000000002e-06 2024-09-14T08:42:57.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806671+0000", 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024216615 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806739+0000", 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8272e-05 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806807+0000", 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8344999999999997e-05 2024-09-14T08:42:57.402 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.403 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.403 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.403 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:42:57.403 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:42:57.403 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:57.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:42:57.405 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:57.404+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:57.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:42:57.505 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:57.508+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:57.521 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:57.521 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:57.521 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:57.521 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:42:57.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:42:57.549 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:42:57.549 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:42:57.570 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-14T08:42:56.701039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1009079108,"num_objects":1719,"num_object_clones":365,"num_object_copies":3438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1719,"num_whiteouts":789,"num_read":602540,"num_read_kb":1282793,"num_write":25050,"num_write_kb":296601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5023,"num_bytes_recovered":135883703,"num_keys_recovered":550,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21699,"ondisk_log_size":21699,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":428600,"kb_used_data":192700,"kb_used_omap":28,"kb_used_meta":235747,"kb_avail":471430600,"statfs":{"total":483183820800,"available":482744934400,"internally_reserved":0,"allocated":197324800,"data_stored":233245864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29130,"internal_metadata":241405494},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-91431958,"num_objects":-122,"num_object_clones":-46,"num_object_copies":-244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-122,"num_whiteouts":-40,"num_read":1347,"num_read_kb":1145,"num_write":192,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":242,"num_bytes_recovered":6478635,"num_keys_recovered":25,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.032547"},"pg_stats":[{"pgid":"3.1f","version":"171'421","reported_seq":4545,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.413272+0000","last_change":"2024-09-14T08:42:53.362957+0000","last_active":"2024-09-14T08:42:53.413272+0000","last_peered":"2024-09-14T08:42:53.413272+0000","last_clean":"2024-09-14T08:42:53.413272+0000","last_became_active":"2024-09-14T08:42:25.417105+0000","last_became_peered":"2024-09-14T08:42:25.417105+0000","last_unstale":"2024-09-14T08:42:53.413272+0000","last_undegraded":"2024-09-14T08:42:53.413272+0000","last_fullsized":"2024-09-14T08:42:53.413272+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:14.651341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015283600000000001,"stat_sum":{"num_bytes":18458239,"num_objects":53,"num_object_clones":9,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":29,"num_read":3876,"num_read_kb":17018,"num_write":467,"num_write_kb":4747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":260,"num_bytes_recovered":6338482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.1e","version":"173'347","reported_seq":29670,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.718058+0000","last_change":"2024-09-14T08:42:55.718426+0000","last_active":"2024-09-14T08:42:55.718058+0000","last_peered":"2024-09-14T08:42:55.718058+0000","last_clean":"2024-09-14T08:42:55.718058+0000","last_became_active":"2024-09-14T08:42:26.418116+0000","last_became_peered":"2024-09-14T08:42:26.418116+0000","last_unstale":"2024-09-14T08:42:55.718058+0000","last_undegraded":"2024-09-14T08:42:55.718058+0000","last_fullsized":"2024-09-14T08:42:55.718058+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:45.904373+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.022309241,"stat_sum":{"num_bytes":24586784,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":26,"num_read":28755,"num_read_kb":35231,"num_write":354,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":339488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.1d","version":"173'661","reported_seq":7914,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.981809+0000","last_change":"2024-09-14T08:42:55.707261+0000","last_active":"2024-09-14T08:42:55.981809+0000","last_peered":"2024-09-14T08:42:55.981809+0000","last_clean":"2024-09-14T08:42:55.981809+0000","last_became_active":"2024-09-14T08:40:16.726695+0000","last_became_peered":"2024-09-14T08:40:16.726695+0000","last_unstale":"2024-09-14T08:42:55.981809+0000","last_undegraded":"2024-09-14T08:42:55.981809+0000","last_fullsized":"2024-09-14T08:42:55.981809+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:32.572809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010263265000000001,"stat_sum":{"num_bytes":17675294,"num_objects":57,"num_object_clones":12,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":27,"num_read":9802,"num_read_kb":39986,"num_write":683,"num_write_kb":5103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.1c","version":"173'665","reported_seq":8456,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.924863+0000","last_change":"2024-09-14T08:42:55.712801+0000","last_active":"2024-09-14T08:42:55.924863+0000","last_peered":"2024-09-14T08:42:55.924863+0000","last_clean":"2024-09-14T08:42:55.924863+0000","last_became_active":"2024-09-14T08:40:16.726971+0000","last_became_peered":"2024-09-14T08:40:16.726971+0000","last_unstale":"2024-09-14T08:42:55.924863+0000","last_undegraded":"2024-09-14T08:42:55.924863+0000","last_fullsized":"2024-09-14T08:42:55.924863+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:26.578890+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.016344226,"stat_sum":{"num_bytes":29573678,"num_objects":52,"num_object_clones":9,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":24,"num_read":8396,"num_read_kb":52857,"num_write":803,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.1b","version":"166'822","reported_seq":10613,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.361502+0000","last_change":"2024-09-14T08:42:53.361852+0000","last_active":"2024-09-14T08:42:53.361502+0000","last_peered":"2024-09-14T08:42:53.361502+0000","last_clean":"2024-09-14T08:42:53.361502+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:42:53.361502+0000","last_undegraded":"2024-09-14T08:42:53.361502+0000","last_fullsized":"2024-09-14T08:42:53.361502+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:19.655880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001241556,"stat_sum":{"num_bytes":21215395,"num_objects":42,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":16,"num_read":11300,"num_read_kb":55075,"num_write":882,"num_write_kb":5905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.1a","version":"173'476","reported_seq":12023,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.948802+0000","last_change":"2024-09-14T08:42:55.704856+0000","last_active":"2024-09-14T08:42:55.948802+0000","last_peered":"2024-09-14T08:42:55.948802+0000","last_clean":"2024-09-14T08:42:55.948802+0000","last_became_active":"2024-09-14T08:42:50.645071+0000","last_became_peered":"2024-09-14T08:42:50.645071+0000","last_unstale":"2024-09-14T08:42:55.948802+0000","last_undegraded":"2024-09-14T08:42:55.948802+0000","last_fullsized":"2024-09-14T08:42:55.948802+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:29.723690+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0095428500000000003,"stat_sum":{"num_bytes":46941766,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":22,"num_read":11602,"num_read_kb":31389,"num_write":518,"num_write_kb":5402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":3693126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.19","version":"172'694","reported_seq":6884,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.695741+0000","last_change":"2024-09-14T08:42:55.696456+0000","last_active":"2024-09-14T08:42:55.695741+0000","last_peered":"2024-09-14T08:42:55.695741+0000","last_clean":"2024-09-14T08:42:55.695741+0000","last_became_active":"2024-09-14T08:42:51.637987+0000","last_became_peered":"2024-09-14T08:42:51.637987+0000","last_unstale":"2024-09-14T08:42:55.695741+0000","last_undegraded":"2024-09-14T08:42:55.695741+0000","last_fullsized":"2024-09-14T08:42:55.695741+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:12.293801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187935,"stat_sum":{"num_bytes":13217543,"num_objects":56,"num_object_clones":8,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":25,"num_read":7522,"num_read_kb":22087,"num_write":699,"num_write_kb":7608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":143,"num_bytes_recovered":2070791,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.18","version":"167'531","reported_seq":7458,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.951124+0000","last_change":"2024-09-14T08:42:55.700161+0000","last_active":"2024-09-14T08:42:55.951124+0000","last_peered":"2024-09-14T08:42:55.951124+0000","last_clean":"2024-09-14T08:42:55.951124+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:42:55.951124+0000","last_undegraded":"2024-09-14T08:42:55.951124+0000","last_fullsized":"2024-09-14T08:42:55.951124+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:07.389220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006926827,"stat_sum":{"num_bytes":31690530,"num_objects":61,"num_object_clones":12,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":33,"num_read":7686,"num_read_kb":29293,"num_write":449,"num_write_kb":3297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.17","version":"164'721","reported_seq":6627,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.362899+0000","last_change":"2024-09-14T08:42:53.363430+0000","last_active":"2024-09-14T08:42:53.362899+0000","last_peered":"2024-09-14T08:42:53.362899+0000","last_clean":"2024-09-14T08:42:53.362899+0000","last_became_active":"2024-09-14T08:42:22.384895+0000","last_became_peered":"2024-09-14T08:42:22.384895+0000","last_unstale":"2024-09-14T08:42:53.362899+0000","last_undegraded":"2024-09-14T08:42:53.362899+0000","last_fullsized":"2024-09-14T08:42:53.362899+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:59.175455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011575890000000001,"stat_sum":{"num_bytes":26594702,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":22,"num_read":7893,"num_read_kb":36467,"num_write":1019,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":3097246,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.16","version":"172'622","reported_seq":6478,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.707359+0000","last_change":"2024-09-14T08:42:55.711053+0000","last_active":"2024-09-14T08:42:55.707359+0000","last_peered":"2024-09-14T08:42:55.707359+0000","last_clean":"2024-09-14T08:42:55.707359+0000","last_became_active":"2024-09-14T08:42:26.411760+0000","last_became_peered":"2024-09-14T08:42:26.411760+0000","last_unstale":"2024-09-14T08:42:55.707359+0000","last_undegraded":"2024-09-14T08:42:55.707359+0000","last_fullsized":"2024-09-14T08:42:55.707359+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:04.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013929643,"stat_sum":{"num_bytes":15282927,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":27,"num_read":31021,"num_read_kb":35393,"num_write":657,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":2542413,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.15","version":"173'1070","reported_seq":7774,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.868109+0000","last_change":"2024-09-14T08:42:55.710121+0000","last_active":"2024-09-14T08:42:55.868109+0000","last_peered":"2024-09-14T08:42:55.868109+0000","last_clean":"2024-09-14T08:42:55.868109+0000","last_became_active":"2024-09-14T08:42:28.415193+0000","last_became_peered":"2024-09-14T08:42:28.415193+0000","last_unstale":"2024-09-14T08:42:55.868109+0000","last_undegraded":"2024-09-14T08:42:55.868109+0000","last_fullsized":"2024-09-14T08:42:55.868109+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1070,"log_dups_size":0,"ondisk_log_size":1070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:03.785719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018366166999999999,"stat_sum":{"num_bytes":47317601,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":24,"num_read":12230,"num_read_kb":26400,"num_write":1284,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":11240906,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.14","version":"173'367","reported_seq":32742,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.708935+0000","last_change":"2024-09-14T08:42:55.709323+0000","last_active":"2024-09-14T08:42:55.708935+0000","last_peered":"2024-09-14T08:42:55.708935+0000","last_clean":"2024-09-14T08:42:55.708935+0000","last_became_active":"2024-09-14T08:42:25.417110+0000","last_became_peered":"2024-09-14T08:42:25.417110+0000","last_unstale":"2024-09-14T08:42:55.708935+0000","last_undegraded":"2024-09-14T08:42:55.708935+0000","last_fullsized":"2024-09-14T08:42:55.708935+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:21.569592+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.017829256000000002,"stat_sum":{"num_bytes":39371508,"num_objects":47,"num_object_clones":8,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":19,"num_read":32222,"num_read_kb":39509,"num_write":436,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":1573864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.692290+0000","last_change":"2024-09-14T08:42:22.375924+0000","last_active":"2024-09-14T08:42:55.692290+0000","last_peered":"2024-09-14T08:42:55.692290+0000","last_clean":"2024-09-14T08:42:55.692290+0000","last_became_active":"2024-09-14T08:42:22.375477+0000","last_became_peered":"2024-09-14T08:42:22.375477+0000","last_unstale":"2024-09-14T08:42:55.692290+0000","last_undegraded":"2024-09-14T08:42:55.692290+0000","last_fullsized":"2024-09-14T08:42:55.692290+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:38.473011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"170'2312","reported_seq":58276,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.361958+0000","last_change":"2024-09-14T08:42:53.362496+0000","last_active":"2024-09-14T08:42:53.361958+0000","last_peered":"2024-09-14T08:42:53.361958+0000","last_clean":"2024-09-14T08:42:53.361958+0000","last_became_active":"2024-09-14T08:42:51.640209+0000","last_became_peered":"2024-09-14T08:42:51.640209+0000","last_unstale":"2024-09-14T08:42:53.361958+0000","last_undegraded":"2024-09-14T08:42:53.361958+0000","last_fullsized":"2024-09-14T08:42:53.361958+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2312,"log_dups_size":0,"ondisk_log_size":2312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:56.512911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001802554,"stat_sum":{"num_bytes":50154681,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":27,"num_read":67336,"num_read_kb":67962,"num_write":3738,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":322,"num_bytes_recovered":8690265,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"2.6","version":"0'0","reported_seq":302,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.692061+0000","last_change":"2024-09-14T08:42:47.609788+0000","last_active":"2024-09-14T08:42:55.692061+0000","last_peered":"2024-09-14T08:42:55.692061+0000","last_clean":"2024-09-14T08:42:55.692061+0000","last_became_active":"2024-09-14T08:42:47.608802+0000","last_became_peered":"2024-09-14T08:42:47.608802+0000","last_unstale":"2024-09-14T08:42:55.692061+0000","last_undegraded":"2024-09-14T08:42:55.692061+0000","last_fullsized":"2024-09-14T08:42:55.692061+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:54.044666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"171'699","reported_seq":58413,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.918159+0000","last_change":"2024-09-14T08:42:55.707952+0000","last_active":"2024-09-14T08:42:55.918159+0000","last_peered":"2024-09-14T08:42:55.918159+0000","last_clean":"2024-09-14T08:42:55.918159+0000","last_became_active":"2024-09-14T08:42:51.638044+0000","last_became_peered":"2024-09-14T08:42:51.638044+0000","last_unstale":"2024-09-14T08:42:55.918159+0000","last_undegraded":"2024-09-14T08:42:55.918159+0000","last_fullsized":"2024-09-14T08:42:55.918159+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:00.523309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013224804,"stat_sum":{"num_bytes":27924549,"num_objects":55,"num_object_clones":12,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":25,"num_read":52347,"num_read_kb":50140,"num_write":533,"num_write_kb":32319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":128,"num_bytes_recovered":3263572,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.5","version":"0'0","reported_seq":69,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.691514+0000","last_change":"2024-09-14T08:42:22.382565+0000","last_active":"2024-09-14T08:42:55.691514+0000","last_peered":"2024-09-14T08:42:55.691514+0000","last_clean":"2024-09-14T08:42:55.691514+0000","last_became_active":"2024-09-14T08:42:22.382087+0000","last_became_peered":"2024-09-14T08:42:22.382087+0000","last_unstale":"2024-09-14T08:42:55.691514+0000","last_undegraded":"2024-09-14T08:42:55.691514+0000","last_fullsized":"2024-09-14T08:42:55.691514+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:39.458480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"173'571","reported_seq":6206,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.710002+0000","last_change":"2024-09-14T08:42:55.712197+0000","last_active":"2024-09-14T08:42:55.710002+0000","last_peered":"2024-09-14T08:42:55.710002+0000","last_clean":"2024-09-14T08:42:55.710002+0000","last_became_active":"2024-09-14T08:42:51.637358+0000","last_became_peered":"2024-09-14T08:42:51.637358+0000","last_unstale":"2024-09-14T08:42:55.710002+0000","last_undegraded":"2024-09-14T08:42:55.710002+0000","last_fullsized":"2024-09-14T08:42:55.710002+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:47.394208+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017699775000000001,"stat_sum":{"num_bytes":39877775,"num_objects":57,"num_object_clones":13,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":32,"num_read":6259,"num_read_kb":17080,"num_write":585,"num_write_kb":20401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":4646686,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.4","version":"0'0","reported_seq":287,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.360452+0000","last_change":"2024-09-14T08:42:47.609601+0000","last_active":"2024-09-14T08:42:53.360452+0000","last_peered":"2024-09-14T08:42:53.360452+0000","last_clean":"2024-09-14T08:42:53.360452+0000","last_became_active":"2024-09-14T08:42:47.609324+0000","last_became_peered":"2024-09-14T08:42:47.609324+0000","last_unstale":"2024-09-14T08:42:53.360452+0000","last_undegraded":"2024-09-14T08:42:53.360452+0000","last_fullsized":"2024-09-14T08:42:53.360452+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:12:04.494863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"167'729","reported_seq":10001,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.897403+0000","last_change":"2024-09-14T08:42:55.713027+0000","last_active":"2024-09-14T08:42:55.897403+0000","last_peered":"2024-09-14T08:42:55.897403+0000","last_clean":"2024-09-14T08:42:55.897403+0000","last_became_active":"2024-09-14T08:40:16.717297+0000","last_became_peered":"2024-09-14T08:40:16.717297+0000","last_unstale":"2024-09-14T08:42:55.897403+0000","last_undegraded":"2024-09-14T08:42:55.897403+0000","last_fullsized":"2024-09-14T08:42:55.897403+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:28.846577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017439298999999998,"stat_sum":{"num_bytes":22563064,"num_objects":62,"num_object_clones":12,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":30,"num_read":11077,"num_read_kb":43135,"num_write":1022,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.3","version":"173'1415","reported_seq":20979,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.890219+0000","last_change":"2024-09-14T08:42:55.718705+0000","last_active":"2024-09-14T08:42:55.890219+0000","last_peered":"2024-09-14T08:42:55.890219+0000","last_clean":"2024-09-14T08:42:55.890219+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:42:55.890219+0000","last_undegraded":"2024-09-14T08:42:55.890219+0000","last_fullsized":"2024-09-14T08:42:55.890219+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:57.781533+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.020794996999999999,"stat_sum":{"num_bytes":12432495,"num_objects":55,"num_object_clones":10,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":31,"num_read":24679,"num_read_kb":26884,"num_write":2288,"num_write_kb":5034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.2","version":"19'2","reported_seq":27,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.359873+0000","last_change":"2024-09-14T08:42:47.619715+0000","last_active":"2024-09-14T08:42:53.359873+0000","last_peered":"2024-09-14T08:42:53.359873+0000","last_clean":"2024-09-14T08:42:53.359873+0000","last_became_active":"2024-09-14T08:42:47.614777+0000","last_became_peered":"2024-09-14T08:42:47.614777+0000","last_unstale":"2024-09-14T08:42:53.359873+0000","last_undegraded":"2024-09-14T08:42:53.359873+0000","last_fullsized":"2024-09-14T08:42:53.359873+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:31.964359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"173'407","reported_seq":27591,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.977772+0000","last_change":"2024-09-14T08:42:55.697189+0000","last_active":"2024-09-14T08:42:55.977772+0000","last_peered":"2024-09-14T08:42:55.977772+0000","last_clean":"2024-09-14T08:42:55.977772+0000","last_became_active":"2024-09-14T08:42:50.641457+0000","last_became_peered":"2024-09-14T08:42:50.641457+0000","last_unstale":"2024-09-14T08:42:55.977772+0000","last_undegraded":"2024-09-14T08:42:55.977772+0000","last_fullsized":"2024-09-14T08:42:55.977772+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:05.167234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045143730000000003,"stat_sum":{"num_bytes":17184894,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":20,"num_read":26922,"num_read_kb":27559,"num_write":419,"num_write_kb":3533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":1973374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":335,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.694101+0000","last_change":"2024-09-14T08:42:47.612389+0000","last_active":"2024-09-14T08:42:55.694101+0000","last_peered":"2024-09-14T08:42:55.694101+0000","last_clean":"2024-09-14T08:42:55.694101+0000","last_became_active":"2024-09-14T08:42:47.611579+0000","last_became_peered":"2024-09-14T08:42:47.611579+0000","last_unstale":"2024-09-14T08:42:55.694101+0000","last_undegraded":"2024-09-14T08:42:55.694101+0000","last_fullsized":"2024-09-14T08:42:55.694101+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:02.018600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'391","reported_seq":8496,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.360503+0000","last_change":"2024-09-14T08:42:53.360943+0000","last_active":"2024-09-14T08:42:53.360503+0000","last_peered":"2024-09-14T08:42:53.360503+0000","last_clean":"2024-09-14T08:42:53.360503+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:42:53.360503+0000","last_undegraded":"2024-09-14T08:42:53.360503+0000","last_fullsized":"2024-09-14T08:42:53.360503+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:57.116518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093347000000000005,"stat_sum":{"num_bytes":50922533,"num_objects":43,"num_object_clones":13,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":22,"num_read":7742,"num_read_kb":16833,"num_write":415,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.691012+0000","last_change":"2024-09-14T08:42:47.603243+0000","last_active":"2024-09-14T08:42:55.691012+0000","last_peered":"2024-09-14T08:42:55.691012+0000","last_clean":"2024-09-14T08:42:55.691012+0000","last_became_active":"2024-09-14T08:42:47.602254+0000","last_became_peered":"2024-09-14T08:42:47.602254+0000","last_unstale":"2024-09-14T08:42:55.691012+0000","last_undegraded":"2024-09-14T08:42:55.691012+0000","last_fullsized":"2024-09-14T08:42:55.691012+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:10.348781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"173'475","reported_seq":17788,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.982858+0000","last_change":"2024-09-14T08:42:55.692354+0000","last_active":"2024-09-14T08:42:55.982858+0000","last_peered":"2024-09-14T08:42:55.982858+0000","last_clean":"2024-09-14T08:42:55.982858+0000","last_became_active":"2024-09-14T08:42:50.640092+0000","last_became_peered":"2024-09-14T08:42:50.640092+0000","last_unstale":"2024-09-14T08:42:55.982858+0000","last_undegraded":"2024-09-14T08:42:55.982858+0000","last_fullsized":"2024-09-14T08:42:55.982858+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:01:37.639580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001140715,"stat_sum":{"num_bytes":33712372,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":18,"num_read":17753,"num_read_kb":57235,"num_write":579,"num_write_kb":6792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4162898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"2.3","version":"17'1","reported_seq":247,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.695404+0000","last_change":"2024-09-14T08:40:16.718478+0000","last_active":"2024-09-14T08:42:55.695404+0000","last_peered":"2024-09-14T08:42:55.695404+0000","last_clean":"2024-09-14T08:42:55.695404+0000","last_became_active":"2024-09-14T08:40:16.717575+0000","last_became_peered":"2024-09-14T08:40:16.717575+0000","last_unstale":"2024-09-14T08:42:55.695404+0000","last_undegraded":"2024-09-14T08:42:55.695404+0000","last_fullsized":"2024-09-14T08:42:55.695404+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:50.808473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":75,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.691028+0000","last_change":"2024-09-14T08:42:22.399938+0000","last_active":"2024-09-14T08:42:55.691028+0000","last_peered":"2024-09-14T08:42:55.691028+0000","last_clean":"2024-09-14T08:42:55.691028+0000","last_became_active":"2024-09-14T08:42:22.385069+0000","last_became_peered":"2024-09-14T08:42:22.385069+0000","last_unstale":"2024-09-14T08:42:55.691028+0000","last_undegraded":"2024-09-14T08:42:55.691028+0000","last_fullsized":"2024-09-14T08:42:55.691028+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:01.403929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"173'525","reported_seq":34939,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.707363+0000","last_change":"2024-09-14T08:42:55.707363+0000","last_active":"2024-09-14T08:42:55.707363+0000","last_peered":"2024-09-14T08:42:55.707363+0000","last_clean":"2024-09-14T08:42:55.707363+0000","last_became_active":"2024-09-14T08:42:50.639888+0000","last_became_peered":"2024-09-14T08:42:50.639888+0000","last_unstale":"2024-09-14T08:42:55.707363+0000","last_undegraded":"2024-09-14T08:42:55.707363+0000","last_fullsized":"2024-09-14T08:42:55.707363+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:09.172671+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.013806634,"stat_sum":{"num_bytes":21720179,"num_objects":48,"num_object_clones":6,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":20,"num_read":33080,"num_read_kb":35531,"num_write":422,"num_write_kb":3443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":1670787,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.9","version":"173'932","reported_seq":16206,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.860665+0000","last_change":"2024-09-14T08:42:55.702794+0000","last_active":"2024-09-14T08:42:55.860665+0000","last_peered":"2024-09-14T08:42:55.860665+0000","last_clean":"2024-09-14T08:42:55.860665+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:42:55.860665+0000","last_undegraded":"2024-09-14T08:42:55.860665+0000","last_fullsized":"2024-09-14T08:42:55.860665+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":932,"log_dups_size":0,"ondisk_log_size":932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:12:13.520139+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0070862010000000003,"stat_sum":{"num_bytes":23625070,"num_objects":62,"num_object_clones":12,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":27,"num_read":15542,"num_read_kb":32505,"num_write":775,"num_write_kb":8902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.a","version":"173'574","reported_seq":13685,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.860130+0000","last_change":"2024-09-14T08:42:55.716425+0000","last_active":"2024-09-14T08:42:55.860130+0000","last_peered":"2024-09-14T08:42:55.860130+0000","last_clean":"2024-09-14T08:42:55.860130+0000","last_became_active":"2024-09-14T08:40:36.358876+0000","last_became_peered":"2024-09-14T08:40:36.358876+0000","last_unstale":"2024-09-14T08:42:55.860130+0000","last_undegraded":"2024-09-14T08:42:55.860130+0000","last_fullsized":"2024-09-14T08:42:55.860130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:43.722099+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.021632052999999998,"stat_sum":{"num_bytes":62023233,"num_objects":46,"num_object_clones":10,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":20,"num_read":14429,"num_read_kb":83630,"num_write":580,"num_write_kb":41439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":5746688,"num_keys_recovered":33,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.b","version":"169'617","reported_seq":5706,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.361060+0000","last_change":"2024-09-14T08:42:53.361413+0000","last_active":"2024-09-14T08:42:53.361060+0000","last_peered":"2024-09-14T08:42:53.361060+0000","last_clean":"2024-09-14T08:42:53.361060+0000","last_became_active":"2024-09-14T08:42:50.638810+0000","last_became_peered":"2024-09-14T08:42:50.638810+0000","last_unstale":"2024-09-14T08:42:53.361060+0000","last_undegraded":"2024-09-14T08:42:53.361060+0000","last_fullsized":"2024-09-14T08:42:53.361060+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:46.400616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013362700000000001,"stat_sum":{"num_bytes":18505796,"num_objects":51,"num_object_clones":11,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":21,"num_read":6312,"num_read_kb":21940,"num_write":801,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":6134440,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.c","version":"170'858","reported_seq":43644,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.362155+0000","last_change":"2024-09-14T08:42:53.362528+0000","last_active":"2024-09-14T08:42:53.362155+0000","last_peered":"2024-09-14T08:42:53.362155+0000","last_clean":"2024-09-14T08:42:53.362155+0000","last_became_active":"2024-09-14T08:42:20.373418+0000","last_became_peered":"2024-09-14T08:42:20.373418+0000","last_unstale":"2024-09-14T08:42:53.362155+0000","last_undegraded":"2024-09-14T08:42:53.362155+0000","last_fullsized":"2024-09-14T08:42:53.362155+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:10.120375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001718437,"stat_sum":{"num_bytes":31991847,"num_objects":65,"num_object_clones":14,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":32,"num_read":48340,"num_read_kb":102090,"num_write":691,"num_write_kb":9595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":6565966,"num_keys_recovered":104,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.d","version":"171'626","reported_seq":7643,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.709783+0000","last_change":"2024-09-14T08:42:55.710460+0000","last_active":"2024-09-14T08:42:55.709783+0000","last_peered":"2024-09-14T08:42:55.709783+0000","last_clean":"2024-09-14T08:42:55.709783+0000","last_became_active":"2024-09-14T08:42:27.414699+0000","last_became_peered":"2024-09-14T08:42:27.414699+0000","last_unstale":"2024-09-14T08:42:55.709783+0000","last_undegraded":"2024-09-14T08:42:55.709783+0000","last_fullsized":"2024-09-14T08:42:55.709783+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:53.578336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018698904999999998,"stat_sum":{"num_bytes":21204992,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":18,"num_read":8994,"num_read_kb":22539,"num_write":491,"num_write_kb":7328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":4142592,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.e","version":"173'284","reported_seq":7098,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.718390+0000","last_change":"2024-09-14T08:42:55.718773+0000","last_active":"2024-09-14T08:42:55.718390+0000","last_peered":"2024-09-14T08:42:55.718390+0000","last_clean":"2024-09-14T08:42:55.718390+0000","last_became_active":"2024-09-14T08:40:16.727022+0000","last_became_peered":"2024-09-14T08:40:16.727022+0000","last_unstale":"2024-09-14T08:42:55.718390+0000","last_undegraded":"2024-09-14T08:42:55.718390+0000","last_fullsized":"2024-09-14T08:42:55.718390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:01.201796+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.021372710999999999,"stat_sum":{"num_bytes":23751184,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":24,"num_read":6538,"num_read_kb":21436,"num_write":270,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.f","version":"173'518","reported_seq":9111,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.718335+0000","last_change":"2024-09-14T08:42:55.718681+0000","last_active":"2024-09-14T08:42:55.718335+0000","last_peered":"2024-09-14T08:42:55.718335+0000","last_clean":"2024-09-14T08:42:55.718335+0000","last_became_active":"2024-09-14T08:42:34.505471+0000","last_became_peered":"2024-09-14T08:42:34.505471+0000","last_unstale":"2024-09-14T08:42:55.718335+0000","last_undegraded":"2024-09-14T08:42:55.718335+0000","last_fullsized":"2024-09-14T08:42:55.718335+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:46.649365+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.026640189000000002,"stat_sum":{"num_bytes":50459168,"num_objects":67,"num_object_clones":16,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":29,"num_read":7832,"num_read_kb":43793,"num_write":475,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":348,"num_bytes_recovered":15889488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.10","version":"171'423","reported_seq":19341,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.694773+0000","last_change":"2024-09-14T08:42:55.696105+0000","last_active":"2024-09-14T08:42:55.694773+0000","last_peered":"2024-09-14T08:42:55.694773+0000","last_clean":"2024-09-14T08:42:55.694773+0000","last_became_active":"2024-09-14T08:42:23.389353+0000","last_became_peered":"2024-09-14T08:42:23.389353+0000","last_unstale":"2024-09-14T08:42:55.694773+0000","last_undegraded":"2024-09-14T08:42:55.694773+0000","last_fullsized":"2024-09-14T08:42:55.694773+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:59.120428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036552170000000001,"stat_sum":{"num_bytes":71857294,"num_objects":61,"num_object_clones":15,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":22,"num_read":19952,"num_read_kb":55710,"num_write":432,"num_write_kb":3477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":1554330,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.11","version":"173'490","reported_seq":43607,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.707447+0000","last_change":"2024-09-14T08:42:55.707841+0000","last_active":"2024-09-14T08:42:55.707447+0000","last_peered":"2024-09-14T08:42:55.707447+0000","last_clean":"2024-09-14T08:42:55.707447+0000","last_became_active":"2024-09-14T08:42:27.413056+0000","last_became_peered":"2024-09-14T08:42:27.413056+0000","last_unstale":"2024-09-14T08:42:55.707447+0000","last_undegraded":"2024-09-14T08:42:55.707447+0000","last_fullsized":"2024-09-14T08:42:55.707447+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:31.594050+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.016558494,"stat_sum":{"num_bytes":60701263,"num_objects":55,"num_object_clones":14,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":28,"num_read":43989,"num_read_kb":101589,"num_write":404,"num_write_kb":14201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":13487774,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]},{"pgid":"3.12","version":"169'552","reported_seq":6228,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T08:42:53.361135+0000","last_change":"2024-09-14T08:42:53.361850+0000","last_active":"2024-09-14T08:42:53.361135+0000","last_peered":"2024-09-14T08:42:53.361135+0000","last_clean":"2024-09-14T08:42:53.361135+0000","last_became_active":"2024-09-14T08:42:26.414400+0000","last_became_peered":"2024-09-14T08:42:26.414400+0000","last_unstale":"2024-09-14T08:42:53.361135+0000","last_undegraded":"2024-09-14T08:42:53.361135+0000","last_fullsized":"2024-09-14T08:42:53.361135+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:13.549394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00159318,"stat_sum":{"num_bytes":21080690,"num_objects":54,"num_object_clones":13,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":23,"num_read":5523,"num_read_kb":20668,"num_write":565,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":13958088,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"21","length":"4"}]},{"pgid":"3.13","version":"173'829","reported_seq":3611,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-14T08:42:55.697211+0000","last_change":"2024-09-14T08:42:55.697621+0000","last_active":"2024-09-14T08:42:55.697211+0000","last_peered":"2024-09-14T08:42:55.697211+0000","last_clean":"2024-09-14T08:42:55.697211+0000","last_became_active":"2024-09-14T08:42:27.413923+0000","last_became_peered":"2024-09-14T08:42:27.413923+0000","last_unstale":"2024-09-14T08:42:55.697211+0000","last_undegraded":"2024-09-14T08:42:55.697211+0000","last_fullsized":"2024-09-14T08:42:55.697211+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:17:35.508495+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0062778699999999996,"stat_sum":{"num_bytes":14869675,"num_objects":53,"num_object_clones":8,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":26,"num_read":5523,"num_read_kb":13774,"num_write":1211,"num_write_kb":9124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":2328801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"6"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1008488721,"num_objects":1715,"num_object_clones":365,"num_object_copies":3430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1715,"num_whiteouts":789,"num_read":602474,"num_read_kb":1282738,"num_write":24947,"num_write_kb":294971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5012,"num_bytes_recovered":132931844,"num_keys_recovered":550,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":195821568,"data_stored":239586159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},"log_size":21624,"ondisk_log_size":21624,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114784,"kb_used_data":47500,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94257056,"statfs":{"total":96636764160,"available":96519225344,"internally_reserved":0,"allocated":48640000,"data_stored":59949198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77952,"kb_used_data":46748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94293888,"statfs":{"total":96636764160,"available":96556941312,"internally_reserved":0,"allocated":47869952,"data_stored":60328540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75820,"kb_used_data":30740,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94296020,"statfs":{"total":96636764160,"available":96559124480,"internally_reserved":0,"allocated":31477760,"data_stored":33783161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":0,"seq":55834574898,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607603,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99764,"kb_used_data":36640,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94272076,"statfs":{"total":96636764160,"available":96534605824,"internally_reserved":0,"allocated":37519360,"data_stored":44836068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846605,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60280,"kb_used_data":31072,"kb_used_omap":22,"kb_used_meta":29161,"kb_avail":94311560,"statfs":{"total":96636764160,"available":96575037440,"internally_reserved":0,"allocated":31817728,"data_stored":34348897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":29861664},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28340224,"data_stored":32093470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12251136,"data_stored":14289105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28725248,"data_stored":31992962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45006848,"data_stored":58687188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46567424,"data_stored":59077696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34930688,"data_stored":43445738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:42:57.572 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T08:42:57.572 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:42:57.572 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-09-14T08:42:57.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2024-09-14T08:42:57.586 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:57.587 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:57.604 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:57.604 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:57.607 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:57.608+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:57.622 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:57.623 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:57.644 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:57.644 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:57.657 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:57.657 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:57.664 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:57.664 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:57.672 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:42:57.685 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:57.686 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:57.702 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:42:57.709 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:57.706+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:57.807 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:57.806+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:57.826 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:57.826 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:57.840 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:42:57.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-14T08:42:57.918+0000 7fe5f37fe640 0 --2- 172.21.15.89:0/2384917273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f4141b90 0x7fe5f4071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T08:42:57.920 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:57.918+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:58.010 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:58.006+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:58.015 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:58.015 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:58.028 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:42:58.115 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:58.114+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:58.117 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-14T08:42:58.114+0000 7f7148add640 -1 mon.a@0(leader).osd e175 definitely_dead 0 2024-09-14T08:42:58.187 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:58.187 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:58.199 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:42:58.211 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:58.212+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:58.312 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:58.310+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:58.366 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:58.366 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:58.381 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:42:58.423 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:58.422+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:58.511 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:58.511 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:58.514 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:58.516+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:58.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:42:58.617 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:42:58.620+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:42:58.690 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:58.690 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:58.704 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:42:58.715 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:58.714+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:58.728 INFO:teuthology.orchestra.run.smithi089.stderr:marked in osd.1. 2024-09-14T08:42:58.759 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-09-14T08:42:58.816 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:58.820+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:58.870 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:58.870 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:58.884 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:42:58.918 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:58.914+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:59.019 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:42:59.014+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:42:59.049 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:59.049 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:59.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:42:59.119 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:59.120+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:59.179 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:59.179 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:59.193 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:42:59.237 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:59.240+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:59.321 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:59.324+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:59.359 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:59.359 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:59.373 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:42:59.422 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:59.418+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:59.523 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:42:59.524+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:42:59.541 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:59.541 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:59.555 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:42:59.623 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:42:59.622+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:42:59.710 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:42:59.722 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:59.722 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:59.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:42:59.742 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:42:59.755 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:59.754+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:59.825 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:42:59.822+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:42:59.860 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:42:59.860 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:42:59.864 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:42:59.864 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:42:59.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:42:59.882 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:42:59.883 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:42:59.900 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:42:59.900 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:42:59.920 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:42:59.920 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:42:59.925 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:42:59.928+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:42:59.940 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:42:59.940 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:42:59.960 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:42:59.961 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:42:59.991 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:42:59.992 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:42:59.992 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:42:59.992 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:00.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:00.026 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:00.028+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:00.129 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:00.130+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:00.176 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:00.176 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:00.176 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:00.176 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:00.176 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:00.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:00.231 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:00.230+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:00.331 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:00.332+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:00.355 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.395429309000001, 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:43:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:43:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.394232223000003, 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:43:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:43:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.394169531000003, 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:43:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.394131784000002, 2024-09-14T08:43:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:43:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:43:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.394034720999997, 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:43:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:43:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.393953873999997, 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:43:00.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:00.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.001947524999999, 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:00.385 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:43:00.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:43:00.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.390 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.673197389999999, 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.057207060999999997, 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:00.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681724+0000", 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.804e-06 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681734+0000", 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6490000000000003e-06 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681751+0000", 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7176999999999998e-05 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681760+0000", 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681849+0000", 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8837000000000003e-05 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681981+0000", 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013216700000000001 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.685622+0000", 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003641483 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.690759+0000", 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051364820000000004 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738832+0000", 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.048073087 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738883+0000", 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1428000000000003e-05 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738930+0000", 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6471000000000003e-05 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.396 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.648725507999998, 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032695727000000001, 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for ondisk", 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706196+0000", 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.387e-06 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706206+0000", 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706218+0000", 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2092e-05 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706227+0000", 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6549999999999993e-06 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706292+0000", 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5571e-05 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for ondisk", 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706626+0000", 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033403600000000001 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738890+0000", 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032263888999999997 2024-09-14T08:43:00.400 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6051 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4012032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.580288702000001, 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030933603, 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6051 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774632+0000", 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774634+0000", 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774640+0000", 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9689999999999999e-06 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774645+0000", 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7359999999999998e-06 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805487+0000", 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030841179 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805527+0000", 2024-09-14T08:43:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0442999999999999e-05 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805565+0000", 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7854e-05 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6052 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3667968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.580267930000002, 2024-09-14T08:43:00.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031002565999999999, 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6052 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:00.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774653+0000", 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.39e-07 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774655+0000", 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1560000000000002e-06 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774660+0000", 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774665+0000", 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805581+0000", 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030915857000000001 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805617+0000", 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5985999999999997e-05 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805655+0000", 2024-09-14T08:43:00.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7771000000000001e-05 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6053 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3790848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.580247589999999, 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031072499, 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.410 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6053 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774673+0000", 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774675+0000", 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0729999999999999e-06 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774679+0000", 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1840000000000001e-06 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774682+0000", 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805671+0000", 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030988430000000001 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805706+0000", 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5685999999999997e-05 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805745+0000", 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8637000000000003e-05 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6054 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3446784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.414 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.580233876000001, 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031147358, 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6054 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:43:00.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774688+0000", 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.378e-06 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774692+0000", 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0249999999999996e-06 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774695+0000", 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8289999999999999e-06 2024-09-14T08:43:00.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805761+0000", 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031066142000000001 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805797+0000", 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5942000000000002e-05 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805834+0000", 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6789999999999998e-05 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6055 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4134912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.580221837, 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031224526999999998, 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.419 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6055 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774699+0000", 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774700+0000", 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2440000000000001e-06 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774704+0000", 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6120000000000001e-06 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774707+0000", 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8940000000000002e-06 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805849+0000", 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031141629000000001 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805887+0000", 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579000000000001e-05 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805923+0000", 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6207000000000001e-05 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.423 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6056 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3569664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.58020917, 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031298725999999999, 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6056 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.65e-07 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774712+0000", 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.238e-06 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774716+0000", 2024-09-14T08:43:00.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.326e-06 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774719+0000", 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8380000000000002e-06 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805938+0000", 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031219757000000001 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805973+0000", 2024-09-14T08:43:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4999999999999997e-05 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806010+0000", 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6301999999999999e-05 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6057 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3913728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.580197958999999, 2024-09-14T08:43:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031394058000000002, 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6057 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774723+0000", 2024-09-14T08:43:00.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.175e-06 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774727+0000", 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8979999999999998e-06 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774731+0000", 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8870000000000002e-06 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806036+0000", 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031304473999999999 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806076+0000", 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0037999999999999e-05 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806116+0000", 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0363e-05 2024-09-14T08:43:00.432 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6058 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4036608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.580185165, 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031564481999999998, 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.433 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6058 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:00.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3900000000000001e-07 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774736+0000", 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.204e-06 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774740+0000", 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3589999999999999e-06 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774742+0000", 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806144+0000", 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031401815999999999 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806220+0000", 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5556999999999995e-05 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806299+0000", 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9534000000000001e-05 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6059 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3692544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.580173935000001, 2024-09-14T08:43:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031762410999999997, 2024-09-14T08:43:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6059 2024-09-14T08:43:00.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774748+0000", 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2109999999999999e-06 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774751+0000", 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4060000000000001e-06 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774754+0000", 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806358+0000", 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031604039 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806434+0000", 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6068000000000004e-05 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806509+0000", 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4629000000000007e-05 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6060 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3471360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.580161885999999, 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031873437999999997, 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.442 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6060 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774759+0000", 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3200000000000005e-07 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774761+0000", 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774767+0000", 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4280000000000001e-06 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774773+0000", 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2020000000000001e-06 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806543+0000", 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031769144999999999 2024-09-14T08:43:00.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806589+0000", 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6119999999999999e-05 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806632+0000", 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2852000000000002e-05 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6061 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3815424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.580139817999999, 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032027014999999999, 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:00.447 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6061 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782424+0000", 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0076440379999999997 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782439+0000", 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4362000000000001e-05 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782448+0000", 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3929999999999997e-06 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782454+0000", 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9900000000000002e-06 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806671+0000", 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024216615 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806739+0000", 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8272e-05 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806807+0000", 2024-09-14T08:43:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8344999999999997e-05 2024-09-14T08:43:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.451 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.451 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:00.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:00.453 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:00.452+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:00.553 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:00.550+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:00.571 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:00.571 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:00.572 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:00.584 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:43:00.654 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:00.656+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:00.718 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:43:00.755 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:00.756+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:00.760 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:00.760 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:00.761 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:00.761 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:00.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:43:00.871 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:00.874+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:00.948 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 184.022261345, 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 184.02220656700001, 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:43:00.957 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 170.594436108, 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:43:00.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 147.60183204099999, 2024-09-14T08:43:00.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:00.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:43:00.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 147.60099367000001, 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:43:00.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.582485568999999, 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.972 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:43:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.582171360000004, 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:43:00.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:43:00.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.980 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.580535033999993, 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:00.981 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.580317074999996, 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.985 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.580021673000005, 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.993 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.579750837999995, 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:00.997 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.368560157000005, 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.998 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:43:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.368540123000002, 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.002 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:01.006 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.368519044999999, 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:43:01.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:43:01.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.010 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.368499451000005, 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.014 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.368479296999993, 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:01.015 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:43:01.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.368459900999994, 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.019 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:01.023 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.361930100999999, 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.361910214999995, 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:01.031 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.361890841000005, 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:43:01.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.035 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.036 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.036 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.036 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.036 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:01.037 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:01.037 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:01.038+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:01.138 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:01.138+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:01.200 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:01.200 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:01.200 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:01.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:01.263 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:01.266+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:01.340 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:01.344+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:01.389 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:01.389 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:01.389 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:01.389 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:01.389 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:01.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:01.441 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:01.444+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:01.539 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:01.539 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:01.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:01.539 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 171.23505170799999, 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:43:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:43:01.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:43:01.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 138.972941529, 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:43:01.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 138.97279435799999, 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.551 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:43:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 138.97265255799999, 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.556 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:43:01.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.409386791000003, 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:43:01.561 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.562 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.562 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.562 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:43:01.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.562 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:43:01.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.401095501, 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:43:01.566 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:43:01.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.401072260000007, 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.572 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.576 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.401052996000004, 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:01.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:43:01.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.401033720000001, 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.400821266999998, 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.586 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:43:01.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.393608173999993, 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:43:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.393586962000001, 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.595 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:43:01.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:01.599 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.393567611999998, 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.393540572999996, 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:43:01.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:43:01.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.608 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.393521422999996, 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.393499839, 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:43:01.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.393480429999997, 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.618 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:43:01.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.393461553999998, 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:01.622 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:43:01.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:43:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.385430717999995, 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:43:01.626 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.385404321999999, 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:01.630 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:01.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:43:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:43:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:01.634 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:01.634 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:01.636 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:01.636 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:01.638+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:01.737 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:01.738+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:01.769 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:01.769 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:01.769 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:01.787 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:01.838 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:01.838+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:01.908 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:01.908 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:01.908 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:01.908 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:01.908 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:01.922 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:01.938 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:01.938+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:01.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:43:02.039 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:02.040+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:02.049 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80183206699999, 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:43:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:43:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80176573700001, 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:43:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80171027700001, 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:43:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:43:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80165065700001, 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:43:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80156911700001, 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80151278899999, 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:43:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:43:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.801441294, 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:43:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:43:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:43:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:43:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80136842300001, 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:43:02.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.801326211, 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:02.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80129638099999, 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.091 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80126808399999, 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:02.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:02.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.099 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80122698900001, 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:43:02.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80119795900001, 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.104 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:43:02.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80116947499999, 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:43:02.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.80114133500001, 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.113 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.117 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.801112639, 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:02.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:43:02.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:43:02.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.801083882, 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.122 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:43:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.801055835, 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:43:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:43:02.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.801025858, 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:02.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:02.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5914.0:814 3.f 3:f6536a47:::rbd_data.10f188ed37a0.000000000000005e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 430080~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.475406528000001, 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.94391447500000003, 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:02.135 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5914", 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3720252961", 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 814 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:02.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574373+0000", 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574383+0000", 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0027000000000001e-05 2024-09-14T08:43:02.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574405+0000", 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469000000000001e-05 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574419+0000", 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543999999999999e-05 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574489+0000", 2024-09-14T08:43:02.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0178999999999993e-05 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574497+0000", 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6320000000000008e-06 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508185+0000", 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.93368827499999996 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508493+0000", 2024-09-14T08:43:02.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030869300000000002 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508838+0000", 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034456200000000003 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.512327+0000", 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034889330000000001 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518113+0000", 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057857730000000001 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518217+0000", 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104319 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518285+0000", 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8139000000000006e-05 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.141 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:02.142 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:02.142 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:02.145 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:02.145 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:02.146 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:02.146 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:02.148+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:02.161 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:02.161 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:02.178 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:02.178 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:02.200 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:02.200 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:02.220 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:02.220 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:02.242 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:02.242 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:02.246 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:02.248+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:02.324 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:02.324 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:02.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:02.381 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:02.384+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:02.447 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:02.450+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:02.511 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:02.511 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:02.526 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:02.548 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:02.550+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:02.646 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:02.646 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:02.649 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:02.650+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:02.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:02.749 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:02.750+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:02.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:43:02.792 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:02.792 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:02.809 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:02.850 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:02.850+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:02.945 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:02.945 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:02.951 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:02.954+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:02.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:03.053 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:03.054+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:03.076 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:03.076 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:03.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:03.153 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:03.154+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:03.221 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:03.221 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:03.236 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:03.254 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:03.256+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:43:03.355 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:03.358+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:03.413 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:03.413 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:03.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:03.457 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:03.460+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:03.557 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:03.558+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:03.599 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:03.599 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:03.615 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:03.658 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:03.660+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:03.759 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:03.758+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:03.760 INFO:tasks.thrashosds.thrasher:in_osds: [2, 4, 5, 0, 3, 1] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:43:03.760 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:43:03.760 INFO:tasks.thrashosds.thrasher:Removing osd 5, in_osds are: [2, 4, 5, 0, 3, 1] 2024-09-14T08:43:03.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 5 2024-09-14T08:43:03.796 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:03.796 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:03.814 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:43:03.899 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:03.902+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:03.960 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:03.962+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:03.985 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:03.985 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:04.000 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:43:04.087 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:04.090+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:04.114 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-14T08:43:04.114+0000 7f7148add640 -1 mon.a@0(leader).osd e181 definitely_dead 0 2024-09-14T08:43:04.162 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:04.162+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:04.177 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:04.177 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:04.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:04.262 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:43:04.279 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:04.282+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:04.357 INFO:teuthology.orchestra.run.smithi089.stderr:marked out osd.5. 2024-09-14T08:43:04.358 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:04.358 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:04.366 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:04.366+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:04.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:04.433 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:04.433 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:04.450 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:04.450 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:04.465 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:04.466+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:04.467 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:04.467 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:04.488 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:04.488 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:04.508 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:04.509 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:04.529 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:04.530 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:04.548 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:04.548 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:04.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:04.566 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:04.568+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:04.666 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:04.666+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:04.728 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:04.728 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:04.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 174.42289431399999, 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:04.729 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:43:04.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:43:04.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 142.160784135, 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.735 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:43:04.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:04.740 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 142.16063696399999, 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:04.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:43:04.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:43:04.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.745 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 142.160495164, 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:43:04.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.750 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.597229397000007, 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:43:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.755 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.588938107000004, 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:43:04.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:43:04.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.588914865999996, 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:43:04.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.588895601999994, 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.765 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:04.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.588876326000005, 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.769 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:43:04.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.588663873000002, 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:43:04.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.581450779999997, 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:43:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:43:04.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:43:04.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.782 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.581429568000004, 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.787 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.581410218000002, 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:43:04.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:43:04.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.581383178999999, 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.792 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.581364029, 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:43:04.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:43:04.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.581342445000004, 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.801 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:04.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.581323036000001, 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:43:04.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:43:04.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.581304160000002, 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.810 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.573273323999999, 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:04.818 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 81.573246928000003, 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:04.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:04.822 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:04.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:04.824 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:04.824+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:04.925 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:04.926+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:04.955 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:04.955 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:04.955 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:04.955 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:04.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:05.026 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:05.026+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:05.093 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:05.093 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:05.107 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:05.127 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:05.126+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:05.228 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:05.230+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:05.232 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:05.232 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38208 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4085760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98527232000001, 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095422235999999994, 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.233 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38208 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247945+0000", 2024-09-14T08:43:05.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247946+0000", 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0669999999999999e-06 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247951+0000", 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1460000000000004e-06 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247977+0000", 2024-09-14T08:43:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5471000000000001e-05 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.247992+0000", 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4941e-05 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343081+0000", 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095089136000000005 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343214+0000", 2024-09-14T08:43:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013340499999999999 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343367+0000", 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98520599, 2024-09-14T08:43:05.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.241 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98515053, 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.245 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98509091, 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:43:05.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:43:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:43:05.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98500937, 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:05.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.984953042, 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:05.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:43:05.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98488154699999, 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.259 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:43:05.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:43:05.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.984808676, 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:43:05.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98476646399999, 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:43:05.268 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:43:05.272 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.984736634, 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:43:05.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:05.277 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.984708337, 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:05.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:43:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.984667242, 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:43:05.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:43:05.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:43:05.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:43:05.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:43:05.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98463821199999, 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.287 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:43:05.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98460972800001, 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.291 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:05.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.295 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.984581588, 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.296 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98455289200001, 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.300 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:43:05.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98452413499999, 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:43:05.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:43:05.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98449608799999, 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.309 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:05.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.313 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 186.98446611099999, 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:05.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:43:05.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5914.0:814 3.f 3:f6536a47:::rbd_data.10f188ed37a0.000000000000005e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 430080~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.658846781000001, 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.94391447500000003, 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5914", 2024-09-14T08:43:05.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3720252961", 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 814 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574373+0000", 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574383+0000", 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0027000000000001e-05 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574405+0000", 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469000000000001e-05 2024-09-14T08:43:05.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574419+0000", 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543999999999999e-05 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574489+0000", 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0178999999999993e-05 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574497+0000", 2024-09-14T08:43:05.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6320000000000008e-06 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508185+0000", 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.93368827499999996 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508493+0000", 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030869300000000002 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508838+0000", 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034456200000000003 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.512327+0000", 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034889330000000001 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518113+0000", 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057857730000000001 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518217+0000", 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104319 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518285+0000", 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8139000000000006e-05 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.324 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:05.325 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:05.328 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:05.330+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:05.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:43:05.429 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:05.432+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:05.462 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:05.462 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:05.462 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:05.462 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:05.476 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:05.530 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:05.530+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:05.630 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:05.632+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:05.642 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:05.642 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:05.643 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:05.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:05.731 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:05.734+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 170.09311608499999, 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:43:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 114.55736226, 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 114.522697376, 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:43:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 114.522496405, 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:43:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.621821015999998, 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:43:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:43:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.621786800999999, 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:43:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.621745312000002, 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:43:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:43:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.621686830000002, 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:43:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.621657150999994, 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:43:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.621627942000003, 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.614021647000001, 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.613993656999995, 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:43:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.613965324999995, 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:43:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:43:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:43:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:43:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.613923565999997, 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.613894686999998, 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.613860877999997, 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:43:05.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.613828518999995, 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.902 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:43:05.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:43:05.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.605700716000001, 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.906 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.605669731000006, 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:43:05.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:43:05.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.605640824999995, 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:05.914 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:05.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:05.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:43:05.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:05.918 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:05.920 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:05.920 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:05.920+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:06.021 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:06.024+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:06.087 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:06.087 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:06.087 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:06.087 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:06.101 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:06.145 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:06.148+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:06.222 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:06.224+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:06.262 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:06.262 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:06.262 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:06.262 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:06.262 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:06.276 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:06.369 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:06.372+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:06.375 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:43:06.424 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:06.424+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:06.468 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.468 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 185.38989245299999, 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:43:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:43:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:43:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:43:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:43:06.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:06.473 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 185.38983524899999, 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:43:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 185.38977636499999, 2024-09-14T08:43:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:43:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 185.389711439, 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:43:06.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:43:06.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 185.389649988, 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.487 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:06.491 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 185.389590454, 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:06.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 185.38953114399999, 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:43:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 185.389459112, 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.500 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:06.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:43:06.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:43:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:43:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:43:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:43:06.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 161.23475873500001, 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.505 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:43:06.509 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 161.23472731000001, 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:43:06.513 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 116.87086368999999, 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:06.514 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:43:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 116.87080434000001, 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:43:06.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:43:06.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.525 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 116.870764388, 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:43:06.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:43:06.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 93.387341434999996, 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.532 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:43:06.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:43:06.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 93.380948868999994, 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.538 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:43:06.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:43:06.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:43:06.544 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 84.621359448999996, 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:06.545 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:43:06.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:43:06.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:43:06.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:43:06.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:43:06.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:43:06.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:06.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:43:06.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:43:06.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:06.552 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 84.580620046999996, 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:43:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:43:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 84.313048963, 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:43:06.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:43:06.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:06.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 84.249245068999997, 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.566 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:43:06.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:43:06.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:06.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:06.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:43:06.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:43:06.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:43:06.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:43:06.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 84.221773370999998, 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:06.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:06.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:43:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:06.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:43:06.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:43:06.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:06.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:43:06.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:06.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:43:06.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:43:06.580 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.580 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.580 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.580 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:06.580 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:06.580 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:06.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:43:06.582 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:06.582+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:06.582 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:06.682 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:06.682+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:06.731 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:06.732 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:06.732 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:06.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:06.753 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:06.753 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:06.773 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:06.773 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:06.782 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:06.784+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:06.794 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:06.794 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:06.819 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:06.820 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:06.847 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:06.847 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:06.872 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:06.872 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:06.883 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:06.884+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:06.892 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:06.892 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:06.910 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:06.985 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:06.988+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:07.085 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:07.085+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:07.094 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:07.094 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:07.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:07.186 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:07.188+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:07.285 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:07.285 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:07.287 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:07.288+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:07.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:43:07.387 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:07.389+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:07.447 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:07.447 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:07.462 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:43:07.503 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:07.505+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:07.589 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:07.592+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:07.632 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:07.632 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:07.646 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:07.691 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:07.693+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:07.769 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:07.769 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:07.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:07.831 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:07.833+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:07.893 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:07.893+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:07.968 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:07.968 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:07.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:07.993 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:07.996+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:08.094 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:08.096+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:08.163 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:08.163 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:08.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:08.195 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:08.193+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:08.295 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:08.297+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:08.325 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:08.325 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:08.341 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:08.396 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:08.400+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:08.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:43:08.477 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:08.477 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:08.491 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:08.533 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:08.536+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:08.598 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:08.597+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:08.657 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:08.658 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:08.671 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:08.717 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:08.720+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:08.788 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:08.788 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:08.800 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:08.804+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:08.802 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:08.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:43:08.901 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:08.904+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:08.969 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:08.969 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:08.983 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:09.002 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:09.001+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:09.047 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:09.047 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:09.063 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:09.063 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:09.080 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:09.097 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:09.098 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:09.103 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:09.104+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:09.116 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:09.116 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:09.135 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 173.41798436600001, 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:43:09.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 117.882230541, 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.158 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 117.847565657, 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.163 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:43:09.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:43:09.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:43:09.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 117.84736468600001, 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:43:09.167 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.946689297000006, 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:43:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:43:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:43:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.946655082000007, 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:09.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.946613592999995, 2024-09-14T08:43:09.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:43:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.184 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.946555110999995, 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.946525432000001, 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.189 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:43:09.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:43:09.192 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.946496222999997, 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:43:09.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:43:09.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:09.197 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.938889927999995, 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:43:09.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.938861938000002, 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.202 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:43:09.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.938833606000003, 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.206 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:43:09.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.938791847000005, 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:09.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:43:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:43:09.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.938762968000006, 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.215 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.938729159000005, 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:43:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.223 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.938696800000002, 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:43:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.930568996999995, 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:43:09.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:43:09.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.930538012, 2024-09-14T08:43:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:43:09.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.236 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 99.930509106000002, 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.237 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:43:09.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:43:09.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:43:09.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:43:09.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.241 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.241 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.241 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:09.243 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:09.243 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:09.244+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:09.343 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:09.345+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:09.359 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:43:09.391 INFO:tasks.thrashosds.thrasher:in_osds: [2, 4, 0, 3, 1] out_osds: [5] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:43:09.392 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:43:09.392 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [2, 4, 0, 3, 1] 2024-09-14T08:43:09.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-14T08:43:09.425 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:09.425 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:09.425 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:09.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:09.484 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:09.488+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:09.545 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:09.548+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:09.565 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:09.565 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:09.565 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:09.565 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:09.565 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:09.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:09.645 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:09.645+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:09.746 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:09.745+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:09.749 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:09.749 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:09.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:09.749 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 188.671060356, 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.750 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:43:09.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 188.671003152, 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.754 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:43:09.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 188.670944268, 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:43:09.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 188.67087934200001, 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.763 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.767 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 188.67081789100001, 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:43:09.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:43:09.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 188.67075835700001, 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.772 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:09.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 188.670699047, 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:43:09.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:43:09.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 188.67062701500001, 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.781 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:43:09.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:09.785 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.515926638, 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:09.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 164.51589521299999, 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:43:09.790 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:43:09.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.152031593, 2024-09-14T08:43:09.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:43:09.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:43:09.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:43:09.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:43:09.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:43:09.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.799 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.151972243, 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:43:09.800 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:43:09.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.15193229099999, 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:09.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.668509338000007, 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:43:09.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 96.662116772000005, 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.819 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:43:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.825 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.902527352000007, 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:09.826 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:43:09.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:43:09.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:43:09.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.832 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.861787949999993, 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:43:09.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:43:09.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.594216865999996, 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.840 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:09.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:43:09.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:43:09.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:43:09.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.530412971999993, 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:43:09.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:43:09.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 87.502941273999994, 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:09.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:43:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:43:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:09.858 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:09.859 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-14T08:43:09.753+0000 7f7148add640 -1 mon.a@0(leader).osd e187 definitely_dead 0 2024-09-14T08:43:09.859 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:09.860 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:09.861+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:09.960 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:09.961+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:09.985 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:09.985 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:09.986 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:09.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:10.087 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:10.089+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:10.162 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:10.164+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:10.163 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:10.164 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:10.164 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:10.164 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:10.164 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:10.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:10.263 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:10.265+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:10.345 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:10.345 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:10.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:10.345 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:10.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.345 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.384963564000003, 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.383766477999998, 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:43:10.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.383703785999998, 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:43:10.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.383666038999998, 2024-09-14T08:43:10.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.383568975999999, 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:43:10.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:43:10.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.368 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.383488129, 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.991481780000001, 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:10.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:43:10.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:43:10.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:10.379 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.662731645000001, 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.057207060999999997, 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:10.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681724+0000", 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.804e-06 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681734+0000", 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6490000000000003e-06 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681751+0000", 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7176999999999998e-05 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681760+0000", 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681849+0000", 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8837000000000003e-05 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681981+0000", 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013216700000000001 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.685622+0000", 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003641483 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:10.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.690759+0000", 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051364820000000004 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738832+0000", 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.048073087 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738883+0000", 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1428000000000003e-05 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738930+0000", 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6471000000000003e-05 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.638259763000001, 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032695727000000001, 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.385 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for ondisk", 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706196+0000", 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.387e-06 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706206+0000", 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706218+0000", 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2092e-05 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706227+0000", 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6549999999999993e-06 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706292+0000", 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5571e-05 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for ondisk", 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706626+0000", 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033403600000000001 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738890+0000", 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032263888999999997 2024-09-14T08:43:10.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.390 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.390 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6051 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4012032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.390 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:10.390 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.569822957, 2024-09-14T08:43:10.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030933603, 2024-09-14T08:43:10.391 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.391 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.391 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.391 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6051 2024-09-14T08:43:10.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774632+0000", 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774634+0000", 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774640+0000", 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9689999999999999e-06 2024-09-14T08:43:10.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774645+0000", 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7359999999999998e-06 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805487+0000", 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030841179 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805527+0000", 2024-09-14T08:43:10.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0442999999999999e-05 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805565+0000", 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7854e-05 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6052 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3667968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.569802185, 2024-09-14T08:43:10.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031002565999999999, 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6052 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774653+0000", 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.39e-07 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774655+0000", 2024-09-14T08:43:10.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1560000000000002e-06 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774660+0000", 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774665+0000", 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805581+0000", 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030915857000000001 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805617+0000", 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5985999999999997e-05 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805655+0000", 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7771000000000001e-05 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.399 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6053 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3790848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.569781845000001, 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031072499, 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.400 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6053 2024-09-14T08:43:10.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.401 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:10.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774673+0000", 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774675+0000", 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0729999999999999e-06 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774679+0000", 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1840000000000001e-06 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774682+0000", 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805671+0000", 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030988430000000001 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805706+0000", 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5685999999999997e-05 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805745+0000", 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8637000000000003e-05 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6054 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3446784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.404 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.569768131, 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031147358, 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6054 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:10.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774688+0000", 2024-09-14T08:43:10.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.378e-06 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774692+0000", 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0249999999999996e-06 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774695+0000", 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8289999999999999e-06 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805761+0000", 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031066142000000001 2024-09-14T08:43:10.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805797+0000", 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5942000000000002e-05 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805834+0000", 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6789999999999998e-05 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6055 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4134912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.569756091999999, 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031224526999999998, 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.409 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6055 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774699+0000", 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774700+0000", 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2440000000000001e-06 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774704+0000", 2024-09-14T08:43:10.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6120000000000001e-06 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774707+0000", 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8940000000000002e-06 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805849+0000", 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031141629000000001 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805887+0000", 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579000000000001e-05 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805923+0000", 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6207000000000001e-05 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6056 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3569664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.413 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.569743424999999, 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031298725999999999, 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6056 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:10.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.65e-07 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774712+0000", 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.238e-06 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774716+0000", 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.326e-06 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774719+0000", 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8380000000000002e-06 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805938+0000", 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031219757000000001 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805973+0000", 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4999999999999997e-05 2024-09-14T08:43:10.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806010+0000", 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6301999999999999e-05 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6057 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3913728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.569732213999998, 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031394058000000002, 2024-09-14T08:43:10.418 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6057 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774723+0000", 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.175e-06 2024-09-14T08:43:10.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774727+0000", 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8979999999999998e-06 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774731+0000", 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8870000000000002e-06 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806036+0000", 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031304473999999999 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806076+0000", 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0037999999999999e-05 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806116+0000", 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0363e-05 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6058 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4036608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.569719419999998, 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031564481999999998, 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6058 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3900000000000001e-07 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774736+0000", 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.204e-06 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774740+0000", 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3589999999999999e-06 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774742+0000", 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806144+0000", 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031401815999999999 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806220+0000", 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5556999999999995e-05 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806299+0000", 2024-09-14T08:43:10.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9534000000000001e-05 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6059 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3692544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.56970819, 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031762410999999997, 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.427 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6059 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774748+0000", 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2109999999999999e-06 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774751+0000", 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4060000000000001e-06 2024-09-14T08:43:10.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774754+0000", 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806358+0000", 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031604039 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806434+0000", 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6068000000000004e-05 2024-09-14T08:43:10.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806509+0000", 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4629000000000007e-05 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6060 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3471360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.569696141000001, 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031873437999999997, 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.431 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6060 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774759+0000", 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3200000000000005e-07 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774761+0000", 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774767+0000", 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4280000000000001e-06 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774773+0000", 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2020000000000001e-06 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806543+0000", 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031769144999999999 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806589+0000", 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6119999999999999e-05 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806632+0000", 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2852000000000002e-05 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6061 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3815424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.569674073000002, 2024-09-14T08:43:10.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032027014999999999, 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6061 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:10.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782424+0000", 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0076440379999999997 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782439+0000", 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4362000000000001e-05 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782448+0000", 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3929999999999997e-06 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782454+0000", 2024-09-14T08:43:10.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9900000000000002e-06 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806671+0000", 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024216615 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806739+0000", 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8272e-05 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806807+0000", 2024-09-14T08:43:10.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8344999999999997e-05 2024-09-14T08:43:10.440 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.440 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.440 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.440 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.440 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.440 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:10.441 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:10.442 INFO:teuthology.orchestra.run.smithi089.stderr:marked out osd.3. 2024-09-14T08:43:10.443 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:10.441+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:10.542 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:10.544+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:10.612 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:10.613 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:10.613 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:10.613 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:10.627 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:43:10.671 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:10.673+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:10.743 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:10.744+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:10.749 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:10.749 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:10.749 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:10.749 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:10.749 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:10.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:43:10.851 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:10.853+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:10.929 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:10.929 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 194.00459207200001, 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:43:10.930 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.934 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 194.00453729399999, 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:10.935 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:43:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 180.576766835, 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:43:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:43:10.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 157.584162768, 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:43:10.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:43:10.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 157.58332439700001, 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:43:10.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.950 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:10.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:10.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:43:10.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:10.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:43:10.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.564816296000004, 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:43:10.955 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:43:10.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.564502086999994, 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.562865760999998, 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.964 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.968 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.562647802000001, 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:43:10.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.562352399999995, 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.562081565, 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:43:10.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.350890883999995, 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.982 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:43:10.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.350870850000007, 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.986 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:43:10.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.350849772000004, 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:43:10.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.995 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.350830177999995, 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:10.999 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.350810023999998, 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:43:11.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:43:11.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:11.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:43:11.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:43:11.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:11.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:43:11.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.004 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.350790627999999, 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:11.005 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.344260828000003, 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:11.009 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:43:11.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:11.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:11.013 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.344240941999999, 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.014 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:11.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:43:11.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:11.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:11.018 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 98.344221567999995, 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:43:11.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:11.023 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:11.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:11.025 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:11.025+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:11.125 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:11.128+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:11.194 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:11.194 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:11.194 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:11.194 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:11.208 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:11.244 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:43:11.255 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:11.257+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:11.327 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:11.328 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:11.328 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:11.328 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:11.328 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:11.328 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:11.328+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:11.342 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:11.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:43:11.425 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:11.425 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:11.427 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:11.429+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:11.446 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:11.447 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:11.463 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:11.463 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:11.483 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:11.483 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:11.484 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:11.485 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:11.498 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:11.506 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:11.506 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:11.525 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:11.525 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:11.544 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:11.548+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:11.630 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:11.629+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:11.630 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:11.631 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:11.644 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:11.732 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:11.736+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:11.812 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:11.812 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:11.827 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:11.831 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:11.829+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:11.931 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:11.933+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:11.995 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:11.995 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:12.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:12.032 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:12.033+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:12.128 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:12.128 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:12.132 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:12.136+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:12.142 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:12.233 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:12.236+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:12.306 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:12.306 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:12.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:12.365 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:12.368+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:12.366 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:43:12.434 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:12.436+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:12.511 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:12.511 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:12.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:12.535 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:12.533+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:12.636 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:12.637+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:12.708 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:12.708 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:12.723 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:12.736 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:12.737+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:12.837 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:12.837+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:12.864 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:12.864 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:12.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:12.937 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:12.937+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:13.017 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:13.017 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:13.035 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:13.038 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:13.037+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:13.138 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:13.137+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:13.178 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:13.178 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:13.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:13.239 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:13.241+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:13.341 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:13.344+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:13.386 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:13.386 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:13.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:13.451 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:13.453+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:13.532 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:13.532 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:13.542 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:43:13.543 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:13.541+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:13.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:13.643 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:13.644+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:13.710 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:13.711 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:13.730 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:13.730 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:13.732 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:13.732 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:13.743 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:13.745+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:13.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:43:13.753 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:13.753 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:13.779 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:13.779 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:13.805 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:13.806 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:13.831 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:13.831 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:13.844 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:13.845+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:13.888 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:13.930 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:13.931 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:13.931 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:13.931 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:13.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:43:13.975 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:13.977+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:14.047 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:14.048+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 197.17692011, 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.102 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.103 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.103 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.103 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:43:14.103 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:14.103 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:43:14.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.104 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:14.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:14.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:43:14.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:43:14.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:43:14.107 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 197.17686533200001, 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:43:14.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.112 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 183.74909487299999, 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:43:14.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:43:14.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:43:14.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:43:14.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:43:14.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.117 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 160.75649080599999, 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.118 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:43:14.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:43:14.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:43:14.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:43:14.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:43:14.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.123 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 160.755652435, 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:43:14.124 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:43:14.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.125 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:43:14.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:14.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:43:14.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:43:14.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.73714433400001, 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:43:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:14.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:43:14.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:43:14.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:43:14.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:43:14.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.736830125, 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.136 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:43:14.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:43:14.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.735193799, 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:43:14.140 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:43:14.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.73497584, 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:14.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.734680438, 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:43:14.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.734409603, 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:43:14.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:43:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.523218922, 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.159 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:43:14.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:43:14.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:43:14.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.523198888, 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.163 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:43:14.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.52317780999999, 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:14.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:43:14.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.171 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.523158216, 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.172 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:43:14.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.177 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.177 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:14.177 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.523138062, 2024-09-14T08:43:14.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:43:14.177 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.177 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.177 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.178 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.178 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:43:14.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.178 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:14.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:43:14.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:43:14.181 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.182 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.182 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.182 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.182 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:14.182 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.523118666, 2024-09-14T08:43:14.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:43:14.182 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.182 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:14.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.51658886600001, 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.187 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:43:14.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.191 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.51656898, 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:43:14.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:43:14.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:43:14.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:43:14.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.516549606, 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.196 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:43:14.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.200 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.201 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.201 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:14.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:14.203 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:14.204+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:14.303 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:14.304+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:14.334 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:14.334 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:14.335 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:14.335 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:14.349 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:14.404 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:14.408+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:14.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:43:14.506 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:14.508+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:14.506 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:14.506 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:14.506 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:14.506 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:14.507 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:14.529 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:14.607 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:14.605+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:14.661 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 184.35727595500001, 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 152.09516577599999, 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:43:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 152.09501860500001, 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:43:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:43:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 152.09487680500001, 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:43:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:43:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:43:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:43:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:43:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.531611037999994, 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:43:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.523319748000006, 2024-09-14T08:43:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:43:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:43:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.523296506999998, 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:43:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.523277242999995, 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.523257967000006, 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:43:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:43:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:43:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:43:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:43:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:43:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:43:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.523045514000003, 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:43:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.515832420999999, 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:43:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:43:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:43:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:43:14.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:43:14.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:43:14.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:43:14.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:43:14.716 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.716 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.716 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.716 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.515811209000006, 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:43:14.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.515791859000004, 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.721 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.722 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.722 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.722 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.722 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.722 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:43:14.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.723 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:14.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:14.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:43:14.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:43:14.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:43:14.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:43:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:43:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:43:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.515764820000001, 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:43:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:43:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:43:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.515745670000001, 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:43:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.515724086000006, 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:43:14.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:14.742 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.515704677000002, 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:14.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:43:14.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.515685801000004, 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:14.747 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:43:14.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.751 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.507654965, 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:43:14.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:43:14.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.507628569000005, 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:14.756 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:43:14.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:43:14.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.760 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.760 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.760 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:14.760 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:14.760 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:14.761 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:14.762 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:14.764+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:14.862 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:14.864+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:14.891 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:14.891 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:14.891 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:14.892 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:14.905 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:14.963 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:14.961+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:15.064 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:15.065+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:15.065 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:15.065 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:15.066 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:15.066 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:15.066 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:15.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:15.165 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:15.168+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:15.204 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:15.204 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.958889785, 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.205 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.958834325, 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.209 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.958774705, 2024-09-14T08:43:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.958693165, 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:43:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:43:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:43:15.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:43:15.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:43:15.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:43:15.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:43:15.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:43:15.222 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.222 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.958636837, 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.223 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:43:15.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:15.227 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.95856534199999, 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:15.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:15.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:43:15.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:43:15.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:43:15.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:43:15.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:43:15.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:43:15.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:43:15.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:43:15.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.234 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.958492471, 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:43:15.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.95845025899999, 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.239 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.240 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:43:15.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.240 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:15.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:15.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:43:15.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:15.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:43:15.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:43:15.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:43:15.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:43:15.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:43:15.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:43:15.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:43:15.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:43:15.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.245 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.958420429, 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:43:15.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:43:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:43:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.958392132, 2024-09-14T08:43:15.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:43:15.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.254 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.958351037, 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.255 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.95832200699999, 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.259 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:43:15.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:43:15.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.95829352300001, 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.958265383, 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:43:15.268 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:43:15.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:43:15.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.95823668700001, 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.273 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:15.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:43:15.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:43:15.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.95820792999999, 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:43:15.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:43:15.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:43:15.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:43:15.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:43:15.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:43:15.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:43:15.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.95817988300001, 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.282 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:43:15.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 196.95814990599999, 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:15.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:43:15.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.291 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.291 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.291 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5914.0:814 3.f 3:f6536a47:::rbd_data.10f188ed37a0.000000000000005e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 430080~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-14T08:43:15.291 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:15.291 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.632530576000001, 2024-09-14T08:43:15.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.94391447500000003, 2024-09-14T08:43:15.292 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.292 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.292 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:15.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5914", 2024-09-14T08:43:15.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3720252961", 2024-09-14T08:43:15.293 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 814 2024-09-14T08:43:15.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.293 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:15.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574373+0000", 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574383+0000", 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0027000000000001e-05 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574405+0000", 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469000000000001e-05 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574419+0000", 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543999999999999e-05 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574489+0000", 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0178999999999993e-05 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574497+0000", 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6320000000000008e-06 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508185+0000", 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.93368827499999996 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508493+0000", 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030869300000000002 2024-09-14T08:43:15.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508838+0000", 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034456200000000003 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.512327+0000", 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034889330000000001 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518113+0000", 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057857730000000001 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518217+0000", 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104319 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518285+0000", 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8139000000000006e-05 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.298 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:26441 3.a 3.fa1caca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.6904062829999997, 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.86137544499999996, 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:15.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 26441 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516497+0000", 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3870000000000002e-06 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516508+0000", 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0740000000000001e-05 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516538+0000", 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9822999999999999e-05 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516552+0000", 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516623+0000", 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0345999999999994e-05 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516629+0000", 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3960000000000003e-06 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:10.377840+0000", 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.861210594 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:10.377870+0000", 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0735999999999998e-05 2024-09-14T08:43:15.303 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.304 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:15.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:15.306 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:15.305+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:15.366 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:43:15.405 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:15.408+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:15.444 INFO:tasks.thrashosds.thrasher:in_osds: [2, 4, 0, 1] out_osds: [5, 3] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:43:15.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T08:43:15.486 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:26746 3.a 3.2cd6f60a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e193)", 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:43:15.391059+0000", 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.099142791999999993, 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099186680999999999, 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for peered", 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 26746 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:15.391059+0000", 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:15.391059+0000", 2024-09-14T08:43:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:15.391061+0000", 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.204e-06 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:15.391070+0000", 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8079999999999994e-06 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:15.391092+0000", 2024-09-14T08:43:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1948000000000001e-05 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:15.391106+0000", 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4545999999999999e-05 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:15.391182+0000", 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5494999999999995e-05 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:15.391192+0000", 2024-09-14T08:43:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9019999999999994e-06 2024-09-14T08:43:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-14T08:43:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 1 2024-09-14T08:43:15.491 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:15.500 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:15.506 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:15.505+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:15.607 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:15.608+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:15.669 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:15.669 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:15.669 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:15.669 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:15.669 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:15.683 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:15.707 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:15.709+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:15.809 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:15.809+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:15.848 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:43:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 180.11558174300001, 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:43:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:43:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.57982791800001, 2024-09-14T08:43:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:43:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:43:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:43:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:43:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:43:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.545163034, 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:43:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.544962063, 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:43:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:43:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.644286674, 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:43:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:43:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.644252459, 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:43:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.64421097, 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:43:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.644152488, 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:43:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.644122809, 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:43:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.64409360000001, 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:43:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:43:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.636487305, 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:43:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:43:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.636459315, 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:43:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:43:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.636430983, 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.636389224, 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:43:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.636360345, 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:43:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:43:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:43:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:43:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.636326536, 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:43:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:43:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.636294177, 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:43:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:43:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.628166374, 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.931 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:43:15.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:43:15.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:43:15.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:43:15.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.62813538899999, 2024-09-14T08:43:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:43:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.628106483, 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:43:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:43:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:15.945 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:15.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:43:15.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:15.947 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:15.948+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:16.047 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:16.045+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:16.105 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:16.106 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:16.119 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:16.119 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:16.119 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:16.119 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:16.124 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:16.124 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:16.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:16.144 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:16.144 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:16.166 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:16.166 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:16.176 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:16.180+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:16.185 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:16.186 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:16.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:16.248 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:16.252+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:16.251 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:16.251 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:16.267 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:16.349 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:16.349+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:16.368 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T08:43:16.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T08:43:16.443 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:16.443 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:16.450 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:16.452+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:16.458 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:16.550 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:16.552+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:16.609 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:16.609 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:16.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:16.667 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:16.669+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:16.740 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:16.740 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:16.752 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:16.752+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:16.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:16.853 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:16.853+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:16.928 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:16.928 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:16.942 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:16.984 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:16.985+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:17.054 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:17.053+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:17.104 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:17.104 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:17.118 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:43:17.160 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:17.161+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:17.256 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:17.257+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:17.282 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:17.282 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:17.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:43:17.357 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:17.360+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:17.374 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T08:43:17.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T08:43:17.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:43:17.470 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:17.470 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:17.470 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:17.469+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:17.488 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:17.559 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:17.560+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:17.660 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:17.661+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:17.669 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:17.669 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:17.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:17.768 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:17.769+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:17.845 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:17.845 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:17.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:17.899 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:17.901+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:17.964 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:17.968+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:18.019 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:18.019 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:18.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:18.065 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:18.065+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:18.163 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:18.163 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:18.165 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:18.168+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:18.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:18.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:43:18.266 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:18.268+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:18.342 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:18.342 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:18.356 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:18.366 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:18.366 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:18.384 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:18.384 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:18.400 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:18.400 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:18.404 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:18.408+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:18.417 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:18.417 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:18.436 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:18.437 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:18.444 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:43:18.450 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T08:43:18.459 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:18.459 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:18.467 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:18.465+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:18.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T08:43:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:18.536 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28860980900001, 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28855434900001, 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:18.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:43:18.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28849472900001, 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:43:18.546 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:18.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28841318900001, 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:43:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28835686100001, 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.559 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.288285366, 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:18.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:43:18.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28821249500001, 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.564 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:43:18.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.288170283, 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:18.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:43:18.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:43:18.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28814045300001, 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:18.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.577 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28811215600001, 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:43:18.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28807106100001, 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:43:18.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:18.586 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.288042031, 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28801354699999, 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:43:18.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28798540700001, 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.595 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.599 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28795671099999, 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:18.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:43:18.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.287927954, 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.604 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.608 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.287899907, 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:43:18.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:43:18.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 200.28786993, 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:18.613 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:43:18.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5914.0:814 3.f 3:f6536a47:::rbd_data.10f188ed37a0.000000000000005e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 430080~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-14T08:43:18.617 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.962250599999997, 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.94391447500000003, 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5914", 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3720252961", 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 814 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574373+0000", 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574383+0000", 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0027000000000001e-05 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574405+0000", 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469000000000001e-05 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574419+0000", 2024-09-14T08:43:18.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543999999999999e-05 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574489+0000", 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0178999999999993e-05 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574497+0000", 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6320000000000008e-06 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508185+0000", 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.93368827499999996 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508493+0000", 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030869300000000002 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508838+0000", 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034456200000000003 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.512327+0000", 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034889330000000001 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518113+0000", 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057857730000000001 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518217+0000", 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104319 2024-09-14T08:43:18.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518285+0000", 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8139000000000006e-05 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:26441 3.a 3.fa1caca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.020126307, 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.86137544499999996, 2024-09-14T08:43:18.624 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 26441 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516497+0000", 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3870000000000002e-06 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516508+0000", 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0740000000000001e-05 2024-09-14T08:43:18.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516538+0000", 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9822999999999999e-05 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516552+0000", 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516623+0000", 2024-09-14T08:43:18.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0345999999999994e-05 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516629+0000", 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3960000000000003e-06 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:10.377840+0000", 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.861210594 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:10.377870+0000", 2024-09-14T08:43:18.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0735999999999998e-05 2024-09-14T08:43:18.629 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.629 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.629 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.629 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:18.629 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:18.629 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:18.630 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:18.631 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:18.632+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:18.731 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:18.732+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:18.801 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:18.801 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:18.802 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:18.802 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:18.815 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:18.857 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:18.860+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:18.932 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:18.933+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:18.979 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:18.979 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:18.979 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:18.979 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:18.979 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:18.993 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:19.040 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:19.044+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:19.110 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 183.37968758400001, 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:43:19.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:43:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:19.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:19.117 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 127.843933759, 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:19.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:43:19.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:19.122 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 127.809268875, 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 127.809067904, 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:19.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:43:19.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:43:19.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.908392515, 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:43:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.9083583, 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:43:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.90831681100001, 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:43:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.90825832900001, 2024-09-14T08:43:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:43:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:43:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.90822865, 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:43:19.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:43:19.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.90819944099999, 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.90059314600001, 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.157 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:43:19.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.900565156, 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.165 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.900536824, 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:43:19.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.900495065, 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.900466186, 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.174 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:43:19.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:43:19.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:43:19.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.900432377, 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:43:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:43:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:43:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:43:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.900400018, 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.183 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:43:19.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.89227221500001, 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:43:19.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:43:19.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.89224123, 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.191 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:19.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:43:19.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:43:19.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 109.892212324, 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.195 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.199 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:19.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:19.201 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:19.204+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:19.301 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:19.304+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:19.371 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:19.371 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:19.385 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:19.433 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:19.436+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:19.462 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T08:43:19.496 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T08:43:19.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:43:19.502 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:19.504+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:19.559 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:19.559 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:19.559 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:19.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:19.603 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:19.601+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:19.704 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:19.708+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 198.66923833000001, 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.748 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.752 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 198.66918112600001, 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:19.753 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 198.66912224199999, 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.757 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:43:19.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 198.66905731599999, 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:43:19.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 198.668995865, 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:19.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:43:19.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 198.668936331, 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:43:19.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:43:19.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 198.66887702099999, 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:19.775 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:43:19.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:43:19.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:43:19.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:43:19.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:43:19.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.779 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 198.66880498899999, 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:43:19.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:43:19.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:43:19.784 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.784 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.784 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.784 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.51410461200001, 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:43:19.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:43:19.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 174.51407318700001, 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.789 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:19.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:43:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 130.15020956699999, 2024-09-14T08:43:19.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:43:19.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 130.150150217, 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.798 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:43:19.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:43:19.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:43:19.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:43:19.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 130.150110265, 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:43:19.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.66668731199999, 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.810 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:43:19.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:43:19.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:43:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 106.66029474600001, 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:43:19.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:43:19.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:19.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 97.900705325999994, 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:43:19.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:43:19.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:19.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.829 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 97.859965923999994, 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:43:19.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:43:19.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:43:19.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:19.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:19.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:19.836 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 97.592394839999997, 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:43:19.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:43:19.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 97.528590945999994, 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:19.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:43:19.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:43:19.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 97.501119247999995, 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.850 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:19.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:43:19.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:43:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:19.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:19.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:19.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:43:19.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:43:19.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.856 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:19.856 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:19.856 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:19.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:19.858 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:19.860+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:19.884 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:43:19.884 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:43:19.904 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-09-14T08:43:19.459774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654615797,"num_objects":1194,"num_object_clones":192,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1194,"num_whiteouts":638,"num_read":604548,"num_read_kb":1284512,"num_write":25500,"num_write_kb":296694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9217,"num_bytes_recovered":217838728,"num_keys_recovered":901,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22534,"ondisk_log_size":22534,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":382860,"kb_used_data":116668,"kb_used_omap":26,"kb_used_meta":265637,"kb_avail":377104500,"statfs":{"total":386547056640,"available":386155008000,"internally_reserved":0,"allocated":119468032,"data_stored":129821063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27537,"internal_metadata":272012399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-65305778,"num_objects":-98,"num_object_clones":0,"num_object_copies":-196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-521,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-98,"num_whiteouts":0,"num_read":313,"num_read_kb":269,"num_write":147,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1780,"num_bytes_recovered":38758879,"num_keys_recovered":153,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.086905"},"pg_stats":[{"pgid":"3.1f","version":"192'446","reported_seq":4895,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.376133+0000","last_change":"2024-09-14T08:43:15.384559+0000","last_active":"2024-09-14T08:43:17.376133+0000","last_peered":"2024-09-14T08:43:17.376133+0000","last_clean":"2024-09-14T08:43:17.376133+0000","last_became_active":"2024-09-14T08:43:14.380873+0000","last_became_peered":"2024-09-14T08:43:14.380873+0000","last_unstale":"2024-09-14T08:43:17.376133+0000","last_undegraded":"2024-09-14T08:43:17.376133+0000","last_fullsized":"2024-09-14T08:43:17.376133+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:20.741590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015346789999999999,"stat_sum":{"num_bytes":2177114,"num_objects":34,"num_object_clones":4,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":24,"num_read":3896,"num_read_kb":17034,"num_write":484,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":8172556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.1e","version":"180'356","reported_seq":29993,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379914+0000","last_change":"2024-09-14T08:43:15.390030+0000","last_active":"2024-09-14T08:43:16.379914+0000","last_peered":"2024-09-14T08:43:16.379914+0000","last_clean":"2024-09-14T08:43:16.379914+0000","last_became_active":"2024-09-14T08:43:15.387202+0000","last_became_peered":"2024-09-14T08:43:15.387202+0000","last_unstale":"2024-09-14T08:43:16.379914+0000","last_undegraded":"2024-09-14T08:43:16.379914+0000","last_fullsized":"2024-09-14T08:43:16.379914+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:43:52.709195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001297908,"stat_sum":{"num_bytes":23808016,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":23,"num_read":28758,"num_read_kb":35232,"num_write":357,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":515120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.1d","version":"191'690","reported_seq":8341,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.380043+0000","last_change":"2024-09-14T08:43:15.380253+0000","last_active":"2024-09-14T08:43:16.380043+0000","last_peered":"2024-09-14T08:43:16.380043+0000","last_clean":"2024-09-14T08:43:16.380043+0000","last_became_active":"2024-09-14T08:43:09.375179+0000","last_became_peered":"2024-09-14T08:43:09.375179+0000","last_unstale":"2024-09-14T08:43:16.380043+0000","last_undegraded":"2024-09-14T08:43:16.380043+0000","last_fullsized":"2024-09-14T08:43:16.380043+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:38.174569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025563040000000001,"stat_sum":{"num_bytes":12239902,"num_objects":44,"num_object_clones":9,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":24,"num_read":9902,"num_read_kb":40075,"num_write":700,"num_write_kb":5104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":131,"num_bytes_recovered":1147934,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.1c","version":"191'686","reported_seq":8851,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379342+0000","last_change":"2024-09-14T08:43:15.380132+0000","last_active":"2024-09-14T08:43:16.379342+0000","last_peered":"2024-09-14T08:43:16.379342+0000","last_clean":"2024-09-14T08:43:16.379342+0000","last_became_active":"2024-09-14T08:43:09.379114+0000","last_became_peered":"2024-09-14T08:43:09.379114+0000","last_unstale":"2024-09-14T08:43:16.379342+0000","last_undegraded":"2024-09-14T08:43:16.379342+0000","last_fullsized":"2024-09-14T08:43:16.379342+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:21.749326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026738729999999998,"stat_sum":{"num_bytes":25540654,"num_objects":37,"num_object_clones":4,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":19,"num_read":8432,"num_read_kb":52893,"num_write":820,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":3698222,"num_keys_recovered":59,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.1b","version":"195'858","reported_seq":10824,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.375958+0000","last_change":"2024-09-14T08:43:15.382755+0000","last_active":"2024-09-14T08:43:17.375958+0000","last_peered":"2024-09-14T08:43:17.375958+0000","last_clean":"2024-09-14T08:43:17.375958+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:43:17.375958+0000","last_undegraded":"2024-09-14T08:43:17.375958+0000","last_fullsized":"2024-09-14T08:43:17.375958+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:40.428250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001159237,"stat_sum":{"num_bytes":9251927,"num_objects":27,"num_object_clones":4,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":14,"num_read":11506,"num_read_kb":55252,"num_write":909,"num_write_kb":5911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.1a","version":"191'503","reported_seq":12407,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379678+0000","last_change":"2024-09-14T08:43:15.383124+0000","last_active":"2024-09-14T08:43:16.379678+0000","last_peered":"2024-09-14T08:43:16.379678+0000","last_clean":"2024-09-14T08:43:16.379678+0000","last_became_active":"2024-09-14T08:43:02.789956+0000","last_became_peered":"2024-09-14T08:43:02.789956+0000","last_unstale":"2024-09-14T08:43:16.379678+0000","last_undegraded":"2024-09-14T08:43:16.379678+0000","last_fullsized":"2024-09-14T08:43:16.379678+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:33:27.658339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047468500000000004,"stat_sum":{"num_bytes":10147398,"num_objects":30,"num_object_clones":6,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":14,"num_read":11644,"num_read_kb":31431,"num_write":525,"num_write_kb":5402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":6116492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.19","version":"192'713","reported_seq":7276,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.382642+0000","last_change":"2024-09-14T08:43:15.380149+0000","last_active":"2024-09-14T08:43:16.382642+0000","last_peered":"2024-09-14T08:43:16.382642+0000","last_clean":"2024-09-14T08:43:16.382642+0000","last_became_active":"2024-09-14T08:43:04.380576+0000","last_became_peered":"2024-09-14T08:43:04.380576+0000","last_unstale":"2024-09-14T08:43:16.382642+0000","last_undegraded":"2024-09-14T08:43:16.382642+0000","last_fullsized":"2024-09-14T08:43:16.382642+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:50.241690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070131600000000001,"stat_sum":{"num_bytes":7350982,"num_objects":37,"num_object_clones":3,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":20,"num_read":7531,"num_read_kb":22091,"num_write":708,"num_write_kb":7608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3588110,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.18","version":"191'569","reported_seq":7666,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379301+0000","last_change":"2024-09-14T08:43:15.373839+0000","last_active":"2024-09-14T08:43:16.379301+0000","last_peered":"2024-09-14T08:43:16.379301+0000","last_clean":"2024-09-14T08:43:16.379301+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:43:16.379301+0000","last_undegraded":"2024-09-14T08:43:16.379301+0000","last_fullsized":"2024-09-14T08:43:16.379301+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:07.943979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015155139999999999,"stat_sum":{"num_bytes":20641956,"num_objects":45,"num_object_clones":7,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":29,"num_read":7935,"num_read_kb":29507,"num_write":472,"num_write_kb":3303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.17","version":"191'744","reported_seq":6988,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.376266+0000","last_change":"2024-09-14T08:43:15.384962+0000","last_active":"2024-09-14T08:43:17.376266+0000","last_peered":"2024-09-14T08:43:17.376266+0000","last_clean":"2024-09-14T08:43:17.376266+0000","last_became_active":"2024-09-14T08:43:08.374620+0000","last_became_peered":"2024-09-14T08:43:08.374620+0000","last_unstale":"2024-09-14T08:43:17.376266+0000","last_undegraded":"2024-09-14T08:43:17.376266+0000","last_fullsized":"2024-09-14T08:43:17.376266+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:28.654230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010746410000000001,"stat_sum":{"num_bytes":24726288,"num_objects":38,"num_object_clones":6,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":18,"num_read":7924,"num_read_kb":36491,"num_write":1036,"num_write_kb":4602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":280,"num_bytes_recovered":4642734,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.16","version":"191'639","reported_seq":6955,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.383422+0000","last_change":"2024-09-14T08:43:15.387851+0000","last_active":"2024-09-14T08:43:16.383422+0000","last_peered":"2024-09-14T08:43:16.383422+0000","last_clean":"2024-09-14T08:43:16.383422+0000","last_became_active":"2024-09-14T08:43:15.384248+0000","last_became_peered":"2024-09-14T08:43:15.384248+0000","last_unstale":"2024-09-14T08:43:16.383422+0000","last_undegraded":"2024-09-14T08:43:16.383422+0000","last_fullsized":"2024-09-14T08:43:16.383422+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.760827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001384775,"stat_sum":{"num_bytes":11180783,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":21,"num_read":31021,"num_read_kb":35393,"num_write":662,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":3628604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.15","version":"191'1085","reported_seq":8109,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.376167+0000","last_change":"2024-09-14T08:43:15.389351+0000","last_active":"2024-09-14T08:43:17.376167+0000","last_peered":"2024-09-14T08:43:17.376167+0000","last_clean":"2024-09-14T08:43:17.376167+0000","last_became_active":"2024-09-14T08:43:15.385613+0000","last_became_peered":"2024-09-14T08:43:15.385613+0000","last_unstale":"2024-09-14T08:43:17.376167+0000","last_undegraded":"2024-09-14T08:43:17.376167+0000","last_fullsized":"2024-09-14T08:43:17.376167+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:16.663410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013447509999999999,"stat_sum":{"num_bytes":40624737,"num_objects":36,"num_object_clones":6,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":20,"num_read":12230,"num_read_kb":26400,"num_write":1289,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":14245931,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.14","version":"180'380","reported_seq":33059,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379525+0000","last_change":"2024-09-14T08:43:15.384497+0000","last_active":"2024-09-14T08:43:16.379525+0000","last_peered":"2024-09-14T08:43:16.379525+0000","last_clean":"2024-09-14T08:43:16.379525+0000","last_became_active":"2024-09-14T08:43:15.380416+0000","last_became_peered":"2024-09-14T08:43:15.380416+0000","last_unstale":"2024-09-14T08:43:16.379525+0000","last_undegraded":"2024-09-14T08:43:16.379525+0000","last_fullsized":"2024-09-14T08:43:16.379525+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:19.517065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016596270000000001,"stat_sum":{"num_bytes":37907700,"num_objects":35,"num_object_clones":3,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":32222,"num_read_kb":39509,"num_write":439,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":2619100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379577+0000","last_change":"2024-09-14T08:43:11.389539+0000","last_active":"2024-09-14T08:43:16.379577+0000","last_peered":"2024-09-14T08:43:16.379577+0000","last_clean":"2024-09-14T08:43:16.379577+0000","last_became_active":"2024-09-14T08:43:11.388867+0000","last_became_peered":"2024-09-14T08:43:11.388867+0000","last_unstale":"2024-09-14T08:43:16.379577+0000","last_undegraded":"2024-09-14T08:43:16.379577+0000","last_fullsized":"2024-09-14T08:43:16.379577+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:28.366694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"195'2345","reported_seq":58670,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.606963+0000","last_change":"2024-09-14T08:43:15.382903+0000","last_active":"2024-09-14T08:43:17.606963+0000","last_peered":"2024-09-14T08:43:17.606963+0000","last_clean":"2024-09-14T08:43:17.606963+0000","last_became_active":"2024-09-14T08:43:05.379281+0000","last_became_peered":"2024-09-14T08:43:05.379281+0000","last_unstale":"2024-09-14T08:43:17.606963+0000","last_undegraded":"2024-09-14T08:43:17.606963+0000","last_fullsized":"2024-09-14T08:43:17.606963+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2345,"log_dups_size":0,"ondisk_log_size":2345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:43.181567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011147100000000001,"stat_sum":{"num_bytes":27191993,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":23,"num_read":67342,"num_read_kb":67966,"num_write":3747,"num_write_kb":9125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":11715346,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.383496+0000","last_change":"2024-09-14T08:43:11.388443+0000","last_active":"2024-09-14T08:43:16.383496+0000","last_peered":"2024-09-14T08:43:16.383496+0000","last_clean":"2024-09-14T08:43:16.383496+0000","last_became_active":"2024-09-14T08:43:11.388079+0000","last_became_peered":"2024-09-14T08:43:11.388079+0000","last_unstale":"2024-09-14T08:43:16.383496+0000","last_undegraded":"2024-09-14T08:43:16.383496+0000","last_fullsized":"2024-09-14T08:43:16.383496+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:52.370876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"191'731","reported_seq":58856,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.380084+0000","last_change":"2024-09-14T08:43:15.375441+0000","last_active":"2024-09-14T08:43:16.380084+0000","last_peered":"2024-09-14T08:43:16.380084+0000","last_clean":"2024-09-14T08:43:16.380084+0000","last_became_active":"2024-09-14T08:43:03.368746+0000","last_became_peered":"2024-09-14T08:43:03.368746+0000","last_unstale":"2024-09-14T08:43:16.380084+0000","last_undegraded":"2024-09-14T08:43:16.380084+0000","last_fullsized":"2024-09-14T08:43:16.380084+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:19.842971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000657852,"stat_sum":{"num_bytes":26077253,"num_objects":44,"num_object_clones":9,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":22,"num_read":52515,"num_read_kb":50286,"num_write":554,"num_write_kb":32325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":6496921,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.376033+0000","last_change":"2024-09-14T08:43:11.385079+0000","last_active":"2024-09-14T08:43:17.376033+0000","last_peered":"2024-09-14T08:43:17.376033+0000","last_clean":"2024-09-14T08:43:17.376033+0000","last_became_active":"2024-09-14T08:43:11.384762+0000","last_became_peered":"2024-09-14T08:43:11.384762+0000","last_unstale":"2024-09-14T08:43:17.376033+0000","last_undegraded":"2024-09-14T08:43:17.376033+0000","last_fullsized":"2024-09-14T08:43:17.376033+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:59.189410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"191'590","reported_seq":6294,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.383237+0000","last_change":"2024-09-14T08:43:15.382906+0000","last_active":"2024-09-14T08:43:16.383237+0000","last_peered":"2024-09-14T08:43:16.383237+0000","last_clean":"2024-09-14T08:43:16.383237+0000","last_became_active":"2024-09-14T08:43:05.385814+0000","last_became_peered":"2024-09-14T08:43:05.385814+0000","last_unstale":"2024-09-14T08:43:16.383237+0000","last_undegraded":"2024-09-14T08:43:16.383237+0000","last_fullsized":"2024-09-14T08:43:16.383237+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:12.835655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001532088,"stat_sum":{"num_bytes":38005903,"num_objects":38,"num_object_clones":4,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":23,"num_read":6259,"num_read_kb":17080,"num_write":586,"num_write_kb":20401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":6627757,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.383337+0000","last_change":"2024-09-14T08:42:59.735414+0000","last_active":"2024-09-14T08:43:16.383337+0000","last_peered":"2024-09-14T08:43:16.383337+0000","last_clean":"2024-09-14T08:43:16.383337+0000","last_became_active":"2024-09-14T08:42:59.734556+0000","last_became_peered":"2024-09-14T08:42:59.734556+0000","last_unstale":"2024-09-14T08:43:16.383337+0000","last_undegraded":"2024-09-14T08:43:16.383337+0000","last_fullsized":"2024-09-14T08:43:16.383337+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:09.696145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"191'746","reported_seq":10718,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.386989+0000","last_change":"2024-09-14T08:43:16.386989+0000","last_active":"2024-09-14T08:43:16.386989+0000","last_peered":"2024-09-14T08:43:16.386989+0000","last_clean":"2024-09-14T08:43:16.386989+0000","last_became_active":"2024-09-14T08:43:16.384133+0000","last_became_peered":"2024-09-14T08:43:16.384133+0000","last_unstale":"2024-09-14T08:43:16.386989+0000","last_undegraded":"2024-09-14T08:43:16.386989+0000","last_fullsized":"2024-09-14T08:43:16.386989+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:13:28.829869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237908,"stat_sum":{"num_bytes":15455976,"num_objects":46,"num_object_clones":7,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":26,"num_read":11077,"num_read_kb":43135,"num_write":1029,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":4578256,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.3","version":"192'1475","reported_seq":21146,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379432+0000","last_change":"2024-09-14T08:43:15.381495+0000","last_active":"2024-09-14T08:43:16.379432+0000","last_peered":"2024-09-14T08:43:16.379432+0000","last_clean":"2024-09-14T08:43:16.379432+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:43:16.379432+0000","last_undegraded":"2024-09-14T08:43:16.379432+0000","last_fullsized":"2024-09-14T08:43:16.379432+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1475,"log_dups_size":0,"ondisk_log_size":1475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:01.535592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002240742,"stat_sum":{"num_bytes":10275840,"num_objects":42,"num_object_clones":5,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":27,"num_read":24777,"num_read_kb":26968,"num_write":2341,"num_write_kb":5061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.2","version":"19'2","reported_seq":59,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.382912+0000","last_change":"2024-09-14T08:43:05.397691+0000","last_active":"2024-09-14T08:43:16.382912+0000","last_peered":"2024-09-14T08:43:16.382912+0000","last_clean":"2024-09-14T08:43:16.382912+0000","last_became_active":"2024-09-14T08:43:05.385764+0000","last_became_peered":"2024-09-14T08:43:05.385764+0000","last_unstale":"2024-09-14T08:43:16.382912+0000","last_undegraded":"2024-09-14T08:43:16.382912+0000","last_fullsized":"2024-09-14T08:43:16.382912+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:57.939626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"191'433","reported_seq":27813,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.382763+0000","last_change":"2024-09-14T08:43:15.381834+0000","last_active":"2024-09-14T08:43:16.382763+0000","last_peered":"2024-09-14T08:43:16.382763+0000","last_clean":"2024-09-14T08:43:16.382763+0000","last_became_active":"2024-09-14T08:43:04.374801+0000","last_became_peered":"2024-09-14T08:43:04.374801+0000","last_unstale":"2024-09-14T08:43:16.382763+0000","last_undegraded":"2024-09-14T08:43:16.382763+0000","last_fullsized":"2024-09-14T08:43:16.382763+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:11.750945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383081,"stat_sum":{"num_bytes":13491262,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":15,"num_read":26947,"num_read_kb":27579,"num_write":437,"num_write_kb":3537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":3380924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.1","version":"0'0","reported_seq":383,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379464+0000","last_change":"2024-09-14T08:42:59.737549+0000","last_active":"2024-09-14T08:43:16.379464+0000","last_peered":"2024-09-14T08:43:16.379464+0000","last_clean":"2024-09-14T08:43:16.379464+0000","last_became_active":"2024-09-14T08:42:59.737208+0000","last_became_peered":"2024-09-14T08:42:59.737208+0000","last_unstale":"2024-09-14T08:43:16.379464+0000","last_undegraded":"2024-09-14T08:43:16.379464+0000","last_fullsized":"2024-09-14T08:43:16.379464+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:23.174811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"191'411","reported_seq":8605,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.375527+0000","last_change":"2024-09-14T08:43:15.382117+0000","last_active":"2024-09-14T08:43:17.375527+0000","last_peered":"2024-09-14T08:43:17.375527+0000","last_clean":"2024-09-14T08:43:17.375527+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:43:17.375527+0000","last_undegraded":"2024-09-14T08:43:17.375527+0000","last_fullsized":"2024-09-14T08:43:17.375527+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:52.527691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010803880000000001,"stat_sum":{"num_bytes":34930725,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":13,"num_read":7742,"num_read_kb":16833,"num_write":417,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.0","version":"0'0","reported_seq":102,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.382629+0000","last_change":"2024-09-14T08:43:11.378457+0000","last_active":"2024-09-14T08:43:16.382629+0000","last_peered":"2024-09-14T08:43:16.382629+0000","last_clean":"2024-09-14T08:43:16.382629+0000","last_became_active":"2024-09-14T08:43:11.378113+0000","last_became_peered":"2024-09-14T08:43:11.378113+0000","last_unstale":"2024-09-14T08:43:16.382629+0000","last_undegraded":"2024-09-14T08:43:16.382629+0000","last_fullsized":"2024-09-14T08:43:16.382629+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:10.175793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"192'497","reported_seq":18362,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.382245+0000","last_change":"2024-09-14T08:43:15.382288+0000","last_active":"2024-09-14T08:43:16.382245+0000","last_peered":"2024-09-14T08:43:16.382245+0000","last_clean":"2024-09-14T08:43:16.382245+0000","last_became_active":"2024-09-14T08:43:14.384007+0000","last_became_peered":"2024-09-14T08:43:14.384007+0000","last_unstale":"2024-09-14T08:43:16.382245+0000","last_undegraded":"2024-09-14T08:43:16.382245+0000","last_fullsized":"2024-09-14T08:43:16.382245+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:01.251953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00153169,"stat_sum":{"num_bytes":31996069,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":17786,"num_read_kb":57260,"num_write":594,"num_write_kb":6796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":452,"num_bytes_recovered":15227317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.3","version":"17'1","reported_seq":299,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379760+0000","last_change":"2024-09-14T08:43:05.397167+0000","last_active":"2024-09-14T08:43:16.379760+0000","last_peered":"2024-09-14T08:43:16.379760+0000","last_clean":"2024-09-14T08:43:16.379760+0000","last_became_active":"2024-09-14T08:43:05.383499+0000","last_became_peered":"2024-09-14T08:43:05.383499+0000","last_unstale":"2024-09-14T08:43:16.379760+0000","last_undegraded":"2024-09-14T08:43:16.379760+0000","last_fullsized":"2024-09-14T08:43:16.379760+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:34.489242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":55,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.375596+0000","last_change":"2024-09-14T08:43:11.386530+0000","last_active":"2024-09-14T08:43:17.375596+0000","last_peered":"2024-09-14T08:43:17.375596+0000","last_clean":"2024-09-14T08:43:17.375596+0000","last_became_active":"2024-09-14T08:43:11.378014+0000","last_became_peered":"2024-09-14T08:43:11.378014+0000","last_unstale":"2024-09-14T08:43:17.375596+0000","last_undegraded":"2024-09-14T08:43:17.375596+0000","last_fullsized":"2024-09-14T08:43:17.375596+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:24.873378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"191'541","reported_seq":35283,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379340+0000","last_change":"2024-09-14T08:43:15.373706+0000","last_active":"2024-09-14T08:43:16.379340+0000","last_peered":"2024-09-14T08:43:16.379340+0000","last_clean":"2024-09-14T08:43:16.379340+0000","last_became_active":"2024-09-14T08:43:05.383845+0000","last_became_peered":"2024-09-14T08:43:05.383845+0000","last_unstale":"2024-09-14T08:43:16.379340+0000","last_undegraded":"2024-09-14T08:43:16.379340+0000","last_fullsized":"2024-09-14T08:43:16.379340+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:01.901931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014812689999999999,"stat_sum":{"num_bytes":11125875,"num_objects":32,"num_object_clones":2,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":16,"num_read":33080,"num_read_kb":35531,"num_write":430,"num_write_kb":3443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":2364662,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.9","version":"191'948","reported_seq":16301,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379136+0000","last_change":"2024-09-14T08:43:15.379696+0000","last_active":"2024-09-14T08:43:16.379136+0000","last_peered":"2024-09-14T08:43:16.379136+0000","last_clean":"2024-09-14T08:43:16.379136+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:43:16.379136+0000","last_undegraded":"2024-09-14T08:43:16.379136+0000","last_fullsized":"2024-09-14T08:43:16.379136+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:49.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026545850000000001,"stat_sum":{"num_bytes":20089446,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":23,"num_read":15547,"num_read_kb":32507,"num_write":783,"num_write_kb":8902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.a","version":"194'598","reported_seq":14028,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.387790+0000","last_change":"2024-09-14T08:43:16.388170+0000","last_active":"2024-09-14T08:43:16.387790+0000","last_peered":"2024-09-14T08:43:16.387790+0000","last_clean":"2024-09-14T08:43:16.387790+0000","last_became_active":"2024-09-14T08:43:16.382871+0000","last_became_peered":"2024-09-14T08:43:16.382871+0000","last_unstale":"2024-09-14T08:43:16.387790+0000","last_undegraded":"2024-09-14T08:43:16.387790+0000","last_fullsized":"2024-09-14T08:43:16.387790+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:56:43.386761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026515660000000002,"stat_sum":{"num_bytes":41086529,"num_objects":31,"num_object_clones":5,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":16,"num_read":14441,"num_read_kb":83640,"num_write":594,"num_write_kb":41440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":283,"num_bytes_recovered":18337410,"num_keys_recovered":105,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.b","version":"191'635","reported_seq":5818,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.383122+0000","last_change":"2024-09-14T08:43:15.382439+0000","last_active":"2024-09-14T08:43:16.383122+0000","last_peered":"2024-09-14T08:43:16.383122+0000","last_clean":"2024-09-14T08:43:16.383122+0000","last_became_active":"2024-09-14T08:43:03.368852+0000","last_became_peered":"2024-09-14T08:43:03.368852+0000","last_unstale":"2024-09-14T08:43:16.383122+0000","last_undegraded":"2024-09-14T08:43:16.383122+0000","last_fullsized":"2024-09-14T08:43:16.383122+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:29.816378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001377419,"stat_sum":{"num_bytes":12873760,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":17,"num_read":6322,"num_read_kb":21945,"num_write":809,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":387,"num_bytes_recovered":7762120,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.c","version":"195'969","reported_seq":44776,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.543836+0000","last_change":"2024-09-14T08:43:17.387796+0000","last_active":"2024-09-14T08:43:17.543836+0000","last_peered":"2024-09-14T08:43:17.543836+0000","last_clean":"2024-09-14T08:43:17.543836+0000","last_became_active":"2024-09-14T08:43:17.380948+0000","last_became_peered":"2024-09-14T08:43:17.380948+0000","last_unstale":"2024-09-14T08:43:17.543836+0000","last_undegraded":"2024-09-14T08:43:17.543836+0000","last_fullsized":"2024-09-14T08:43:17.543836+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:29.349543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031588269999999999,"stat_sum":{"num_bytes":24387623,"num_objects":43,"num_object_clones":7,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":25,"num_read":49255,"num_read_kb":102883,"num_write":763,"num_write_kb":9619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":466,"num_bytes_recovered":12466332,"num_keys_recovered":182,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.d","version":"191'645","reported_seq":7989,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379937+0000","last_change":"2024-09-14T08:43:15.387795+0000","last_active":"2024-09-14T08:43:16.379937+0000","last_peered":"2024-09-14T08:43:16.379937+0000","last_clean":"2024-09-14T08:43:16.379937+0000","last_became_active":"2024-09-14T08:43:15.380346+0000","last_became_peered":"2024-09-14T08:43:15.380346+0000","last_unstale":"2024-09-14T08:43:16.379937+0000","last_undegraded":"2024-09-14T08:43:16.379937+0000","last_fullsized":"2024-09-14T08:43:16.379937+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:26.563980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036837100000000002,"stat_sum":{"num_bytes":12927488,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":12,"num_read":8994,"num_read_kb":22539,"num_write":498,"num_write_kb":7328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":6800384,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.e","version":"191'306","reported_seq":7414,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379421+0000","last_change":"2024-09-14T08:43:15.380736+0000","last_active":"2024-09-14T08:43:16.379421+0000","last_peered":"2024-09-14T08:43:16.379421+0000","last_clean":"2024-09-14T08:43:16.379421+0000","last_became_active":"2024-09-14T08:43:08.375885+0000","last_became_peered":"2024-09-14T08:43:08.375885+0000","last_unstale":"2024-09-14T08:43:16.379421+0000","last_undegraded":"2024-09-14T08:43:16.379421+0000","last_fullsized":"2024-09-14T08:43:16.379421+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:10.580829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026032640000000001,"stat_sum":{"num_bytes":13799936,"num_objects":29,"num_object_clones":2,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":16,"num_read":6541,"num_read_kb":21437,"num_write":274,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":561152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.f","version":"191'539","reported_seq":9805,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.385552+0000","last_change":"2024-09-14T08:43:17.385552+0000","last_active":"2024-09-14T08:43:17.385552+0000","last_peered":"2024-09-14T08:43:17.385552+0000","last_clean":"2024-09-14T08:43:17.385552+0000","last_became_active":"2024-09-14T08:43:17.380806+0000","last_became_peered":"2024-09-14T08:43:17.380806+0000","last_unstale":"2024-09-14T08:43:17.385552+0000","last_undegraded":"2024-09-14T08:43:17.385552+0000","last_fullsized":"2024-09-14T08:43:17.385552+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:06.600302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022085500000000001,"stat_sum":{"num_bytes":40079376,"num_objects":47,"num_object_clones":12,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":26,"num_read":7835,"num_read_kb":43794,"num_write":488,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":636,"num_bytes_recovered":25134704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.10","version":"195'450","reported_seq":19730,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.375466+0000","last_change":"2024-09-14T08:43:15.382127+0000","last_active":"2024-09-14T08:43:17.375466+0000","last_peered":"2024-09-14T08:43:17.375466+0000","last_clean":"2024-09-14T08:43:17.375466+0000","last_became_active":"2024-09-14T08:43:08.375580+0000","last_became_peered":"2024-09-14T08:43:08.375580+0000","last_unstale":"2024-09-14T08:43:17.375466+0000","last_undegraded":"2024-09-14T08:43:17.375466+0000","last_fullsized":"2024-09-14T08:43:17.375466+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:16.940201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031778269999999998,"stat_sum":{"num_bytes":31244414,"num_objects":37,"num_object_clones":6,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":16,"num_read":19955,"num_read_kb":55711,"num_write":441,"num_write_kb":3477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":353,"num_bytes_recovered":2324520,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.11","version":"192'510","reported_seq":43982,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379282+0000","last_change":"2024-09-14T08:43:15.379493+0000","last_active":"2024-09-14T08:43:16.379282+0000","last_peered":"2024-09-14T08:43:16.379282+0000","last_clean":"2024-09-14T08:43:16.379282+0000","last_became_active":"2024-09-14T08:43:14.385923+0000","last_became_peered":"2024-09-14T08:43:14.385923+0000","last_unstale":"2024-09-14T08:43:16.379282+0000","last_undegraded":"2024-09-14T08:43:16.379282+0000","last_fullsized":"2024-09-14T08:43:16.379282+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:42.736630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020699749999999999,"stat_sum":{"num_bytes":4262479,"num_objects":38,"num_object_clones":7,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":24,"num_read":43989,"num_read_kb":101589,"num_write":410,"num_write_kb":14201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":14335213,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.12","version":"195'569","reported_seq":6586,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.384982+0000","last_change":"2024-09-14T08:43:17.384562+0000","last_active":"2024-09-14T08:43:17.384982+0000","last_peered":"2024-09-14T08:43:17.384982+0000","last_clean":"2024-09-14T08:43:17.384982+0000","last_became_active":"2024-09-14T08:43:17.381063+0000","last_became_peered":"2024-09-14T08:43:17.381063+0000","last_unstale":"2024-09-14T08:43:17.384982+0000","last_undegraded":"2024-09-14T08:43:17.384982+0000","last_fullsized":"2024-09-14T08:43:17.384982+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:37.855032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001341947,"stat_sum":{"num_bytes":7091826,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":20,"num_read":5523,"num_read_kb":20668,"num_write":572,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":17076794,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.13","version":"192'852","reported_seq":3956,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379568+0000","last_change":"2024-09-14T08:43:15.374078+0000","last_active":"2024-09-14T08:43:16.379568+0000","last_peered":"2024-09-14T08:43:16.379568+0000","last_clean":"2024-09-14T08:43:16.379568+0000","last_became_active":"2024-09-14T08:43:14.380884+0000","last_became_peered":"2024-09-14T08:43:14.380884+0000","last_unstale":"2024-09-14T08:43:16.379568+0000","last_undegraded":"2024-09-14T08:43:16.379568+0000","last_fullsized":"2024-09-14T08:43:16.379568+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:00.437049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001468158,"stat_sum":{"num_bytes":12034180,"num_objects":41,"num_object_clones":5,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":23,"num_read":5554,"num_read_kb":13798,"num_write":1229,"num_write_kb":9128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":3502437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":654025410,"num_objects":1190,"num_object_clones":192,"num_object_copies":2380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":638,"num_read":604482,"num_read_kb":1284457,"num_write":25397,"num_write_kb":295064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9203,"num_bytes_recovered":214886831,"num_keys_recovered":901,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123465728,"data_stored":144050286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},"log_size":22459,"ondisk_log_size":22459,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100284,"kb_used_data":28412,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94271556,"statfs":{"total":96636764160,"available":96534073344,"internally_reserved":0,"allocated":29093888,"data_stored":30914353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574903,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76816,"kb_used_data":27576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94295024,"statfs":{"total":96636764160,"available":96558104576,"internally_reserved":0,"allocated":28237824,"data_stored":30126466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149728,"kb_used_data":38020,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94222112,"statfs":{"total":96636764160,"available":96483442688,"internally_reserved":0,"allocated":38932480,"data_stored":44001183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":0,"seq":51539607607,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846610,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56032,"kb_used_data":22660,"kb_used_omap":22,"kb_used_meta":33321,"kb_avail":94315808,"statfs":{"total":96636764160,"available":96579387392,"internally_reserved":0,"allocated":23203840,"data_stored":24779061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":34121504},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20262912,"data_stored":23196986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38817792,"data_stored":46862762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19357696,"data_stored":20885848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11689984,"data_stored":14912681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26775552,"data_stored":29932872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6561792,"data_stored":8259137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:43:19.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:43:19.959 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:19.960+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:19.984 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:19.984 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:19.984 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:19.984 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:19.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:20.059 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:20.060+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:20.159 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:20.159 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:20.159 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:20.160 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:20.160 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:20.160 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:20.160+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:20.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:20.249 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:43:20.250 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:43:20.260 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:20.264+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:20.268 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-09-14T08:43:19.459774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654615797,"num_objects":1194,"num_object_clones":192,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1194,"num_whiteouts":638,"num_read":604548,"num_read_kb":1284512,"num_write":25500,"num_write_kb":296694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9217,"num_bytes_recovered":217838728,"num_keys_recovered":901,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22534,"ondisk_log_size":22534,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":382860,"kb_used_data":116668,"kb_used_omap":26,"kb_used_meta":265637,"kb_avail":377104500,"statfs":{"total":386547056640,"available":386155008000,"internally_reserved":0,"allocated":119468032,"data_stored":129821063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27537,"internal_metadata":272012399},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-65305778,"num_objects":-98,"num_object_clones":0,"num_object_copies":-196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-521,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-98,"num_whiteouts":0,"num_read":313,"num_read_kb":269,"num_write":147,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1780,"num_bytes_recovered":38758879,"num_keys_recovered":153,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.086905"},"pg_stats":[{"pgid":"3.1f","version":"192'446","reported_seq":4895,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.376133+0000","last_change":"2024-09-14T08:43:15.384559+0000","last_active":"2024-09-14T08:43:17.376133+0000","last_peered":"2024-09-14T08:43:17.376133+0000","last_clean":"2024-09-14T08:43:17.376133+0000","last_became_active":"2024-09-14T08:43:14.380873+0000","last_became_peered":"2024-09-14T08:43:14.380873+0000","last_unstale":"2024-09-14T08:43:17.376133+0000","last_undegraded":"2024-09-14T08:43:17.376133+0000","last_fullsized":"2024-09-14T08:43:17.376133+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:20.741590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015346789999999999,"stat_sum":{"num_bytes":2177114,"num_objects":34,"num_object_clones":4,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":24,"num_read":3896,"num_read_kb":17034,"num_write":484,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":8172556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.1e","version":"180'356","reported_seq":29993,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379914+0000","last_change":"2024-09-14T08:43:15.390030+0000","last_active":"2024-09-14T08:43:16.379914+0000","last_peered":"2024-09-14T08:43:16.379914+0000","last_clean":"2024-09-14T08:43:16.379914+0000","last_became_active":"2024-09-14T08:43:15.387202+0000","last_became_peered":"2024-09-14T08:43:15.387202+0000","last_unstale":"2024-09-14T08:43:16.379914+0000","last_undegraded":"2024-09-14T08:43:16.379914+0000","last_fullsized":"2024-09-14T08:43:16.379914+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:43:52.709195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001297908,"stat_sum":{"num_bytes":23808016,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":23,"num_read":28758,"num_read_kb":35232,"num_write":357,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":515120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.1d","version":"191'690","reported_seq":8341,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.380043+0000","last_change":"2024-09-14T08:43:15.380253+0000","last_active":"2024-09-14T08:43:16.380043+0000","last_peered":"2024-09-14T08:43:16.380043+0000","last_clean":"2024-09-14T08:43:16.380043+0000","last_became_active":"2024-09-14T08:43:09.375179+0000","last_became_peered":"2024-09-14T08:43:09.375179+0000","last_unstale":"2024-09-14T08:43:16.380043+0000","last_undegraded":"2024-09-14T08:43:16.380043+0000","last_fullsized":"2024-09-14T08:43:16.380043+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:38.174569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025563040000000001,"stat_sum":{"num_bytes":12239902,"num_objects":44,"num_object_clones":9,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":24,"num_read":9902,"num_read_kb":40075,"num_write":700,"num_write_kb":5104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":131,"num_bytes_recovered":1147934,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.1c","version":"191'686","reported_seq":8851,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379342+0000","last_change":"2024-09-14T08:43:15.380132+0000","last_active":"2024-09-14T08:43:16.379342+0000","last_peered":"2024-09-14T08:43:16.379342+0000","last_clean":"2024-09-14T08:43:16.379342+0000","last_became_active":"2024-09-14T08:43:09.379114+0000","last_became_peered":"2024-09-14T08:43:09.379114+0000","last_unstale":"2024-09-14T08:43:16.379342+0000","last_undegraded":"2024-09-14T08:43:16.379342+0000","last_fullsized":"2024-09-14T08:43:16.379342+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:21.749326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026738729999999998,"stat_sum":{"num_bytes":25540654,"num_objects":37,"num_object_clones":4,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":19,"num_read":8432,"num_read_kb":52893,"num_write":820,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":3698222,"num_keys_recovered":59,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.1b","version":"195'858","reported_seq":10824,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.375958+0000","last_change":"2024-09-14T08:43:15.382755+0000","last_active":"2024-09-14T08:43:17.375958+0000","last_peered":"2024-09-14T08:43:17.375958+0000","last_clean":"2024-09-14T08:43:17.375958+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:43:17.375958+0000","last_undegraded":"2024-09-14T08:43:17.375958+0000","last_fullsized":"2024-09-14T08:43:17.375958+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:40.428250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001159237,"stat_sum":{"num_bytes":9251927,"num_objects":27,"num_object_clones":4,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":14,"num_read":11506,"num_read_kb":55252,"num_write":909,"num_write_kb":5911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.1a","version":"191'503","reported_seq":12407,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379678+0000","last_change":"2024-09-14T08:43:15.383124+0000","last_active":"2024-09-14T08:43:16.379678+0000","last_peered":"2024-09-14T08:43:16.379678+0000","last_clean":"2024-09-14T08:43:16.379678+0000","last_became_active":"2024-09-14T08:43:02.789956+0000","last_became_peered":"2024-09-14T08:43:02.789956+0000","last_unstale":"2024-09-14T08:43:16.379678+0000","last_undegraded":"2024-09-14T08:43:16.379678+0000","last_fullsized":"2024-09-14T08:43:16.379678+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:33:27.658339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047468500000000004,"stat_sum":{"num_bytes":10147398,"num_objects":30,"num_object_clones":6,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":14,"num_read":11644,"num_read_kb":31431,"num_write":525,"num_write_kb":5402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":6116492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.19","version":"192'713","reported_seq":7276,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.382642+0000","last_change":"2024-09-14T08:43:15.380149+0000","last_active":"2024-09-14T08:43:16.382642+0000","last_peered":"2024-09-14T08:43:16.382642+0000","last_clean":"2024-09-14T08:43:16.382642+0000","last_became_active":"2024-09-14T08:43:04.380576+0000","last_became_peered":"2024-09-14T08:43:04.380576+0000","last_unstale":"2024-09-14T08:43:16.382642+0000","last_undegraded":"2024-09-14T08:43:16.382642+0000","last_fullsized":"2024-09-14T08:43:16.382642+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:50.241690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070131600000000001,"stat_sum":{"num_bytes":7350982,"num_objects":37,"num_object_clones":3,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":20,"num_read":7531,"num_read_kb":22091,"num_write":708,"num_write_kb":7608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3588110,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.18","version":"191'569","reported_seq":7666,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379301+0000","last_change":"2024-09-14T08:43:15.373839+0000","last_active":"2024-09-14T08:43:16.379301+0000","last_peered":"2024-09-14T08:43:16.379301+0000","last_clean":"2024-09-14T08:43:16.379301+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:43:16.379301+0000","last_undegraded":"2024-09-14T08:43:16.379301+0000","last_fullsized":"2024-09-14T08:43:16.379301+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:07.943979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015155139999999999,"stat_sum":{"num_bytes":20641956,"num_objects":45,"num_object_clones":7,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":29,"num_read":7935,"num_read_kb":29507,"num_write":472,"num_write_kb":3303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.17","version":"191'744","reported_seq":6988,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.376266+0000","last_change":"2024-09-14T08:43:15.384962+0000","last_active":"2024-09-14T08:43:17.376266+0000","last_peered":"2024-09-14T08:43:17.376266+0000","last_clean":"2024-09-14T08:43:17.376266+0000","last_became_active":"2024-09-14T08:43:08.374620+0000","last_became_peered":"2024-09-14T08:43:08.374620+0000","last_unstale":"2024-09-14T08:43:17.376266+0000","last_undegraded":"2024-09-14T08:43:17.376266+0000","last_fullsized":"2024-09-14T08:43:17.376266+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:28.654230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010746410000000001,"stat_sum":{"num_bytes":24726288,"num_objects":38,"num_object_clones":6,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":18,"num_read":7924,"num_read_kb":36491,"num_write":1036,"num_write_kb":4602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":280,"num_bytes_recovered":4642734,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.16","version":"191'639","reported_seq":6955,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.383422+0000","last_change":"2024-09-14T08:43:15.387851+0000","last_active":"2024-09-14T08:43:16.383422+0000","last_peered":"2024-09-14T08:43:16.383422+0000","last_clean":"2024-09-14T08:43:16.383422+0000","last_became_active":"2024-09-14T08:43:15.384248+0000","last_became_peered":"2024-09-14T08:43:15.384248+0000","last_unstale":"2024-09-14T08:43:16.383422+0000","last_undegraded":"2024-09-14T08:43:16.383422+0000","last_fullsized":"2024-09-14T08:43:16.383422+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.760827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001384775,"stat_sum":{"num_bytes":11180783,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":21,"num_read":31021,"num_read_kb":35393,"num_write":662,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":3628604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.15","version":"191'1085","reported_seq":8109,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.376167+0000","last_change":"2024-09-14T08:43:15.389351+0000","last_active":"2024-09-14T08:43:17.376167+0000","last_peered":"2024-09-14T08:43:17.376167+0000","last_clean":"2024-09-14T08:43:17.376167+0000","last_became_active":"2024-09-14T08:43:15.385613+0000","last_became_peered":"2024-09-14T08:43:15.385613+0000","last_unstale":"2024-09-14T08:43:17.376167+0000","last_undegraded":"2024-09-14T08:43:17.376167+0000","last_fullsized":"2024-09-14T08:43:17.376167+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:16.663410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013447509999999999,"stat_sum":{"num_bytes":40624737,"num_objects":36,"num_object_clones":6,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":20,"num_read":12230,"num_read_kb":26400,"num_write":1289,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":14245931,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.14","version":"180'380","reported_seq":33059,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379525+0000","last_change":"2024-09-14T08:43:15.384497+0000","last_active":"2024-09-14T08:43:16.379525+0000","last_peered":"2024-09-14T08:43:16.379525+0000","last_clean":"2024-09-14T08:43:16.379525+0000","last_became_active":"2024-09-14T08:43:15.380416+0000","last_became_peered":"2024-09-14T08:43:15.380416+0000","last_unstale":"2024-09-14T08:43:16.379525+0000","last_undegraded":"2024-09-14T08:43:16.379525+0000","last_fullsized":"2024-09-14T08:43:16.379525+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:19.517065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016596270000000001,"stat_sum":{"num_bytes":37907700,"num_objects":35,"num_object_clones":3,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":32222,"num_read_kb":39509,"num_write":439,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":2619100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379577+0000","last_change":"2024-09-14T08:43:11.389539+0000","last_active":"2024-09-14T08:43:16.379577+0000","last_peered":"2024-09-14T08:43:16.379577+0000","last_clean":"2024-09-14T08:43:16.379577+0000","last_became_active":"2024-09-14T08:43:11.388867+0000","last_became_peered":"2024-09-14T08:43:11.388867+0000","last_unstale":"2024-09-14T08:43:16.379577+0000","last_undegraded":"2024-09-14T08:43:16.379577+0000","last_fullsized":"2024-09-14T08:43:16.379577+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:28.366694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"195'2345","reported_seq":58670,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.606963+0000","last_change":"2024-09-14T08:43:15.382903+0000","last_active":"2024-09-14T08:43:17.606963+0000","last_peered":"2024-09-14T08:43:17.606963+0000","last_clean":"2024-09-14T08:43:17.606963+0000","last_became_active":"2024-09-14T08:43:05.379281+0000","last_became_peered":"2024-09-14T08:43:05.379281+0000","last_unstale":"2024-09-14T08:43:17.606963+0000","last_undegraded":"2024-09-14T08:43:17.606963+0000","last_fullsized":"2024-09-14T08:43:17.606963+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2345,"log_dups_size":0,"ondisk_log_size":2345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:43.181567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011147100000000001,"stat_sum":{"num_bytes":27191993,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":23,"num_read":67342,"num_read_kb":67966,"num_write":3747,"num_write_kb":9125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":11715346,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.383496+0000","last_change":"2024-09-14T08:43:11.388443+0000","last_active":"2024-09-14T08:43:16.383496+0000","last_peered":"2024-09-14T08:43:16.383496+0000","last_clean":"2024-09-14T08:43:16.383496+0000","last_became_active":"2024-09-14T08:43:11.388079+0000","last_became_peered":"2024-09-14T08:43:11.388079+0000","last_unstale":"2024-09-14T08:43:16.383496+0000","last_undegraded":"2024-09-14T08:43:16.383496+0000","last_fullsized":"2024-09-14T08:43:16.383496+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:52.370876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"191'731","reported_seq":58856,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.380084+0000","last_change":"2024-09-14T08:43:15.375441+0000","last_active":"2024-09-14T08:43:16.380084+0000","last_peered":"2024-09-14T08:43:16.380084+0000","last_clean":"2024-09-14T08:43:16.380084+0000","last_became_active":"2024-09-14T08:43:03.368746+0000","last_became_peered":"2024-09-14T08:43:03.368746+0000","last_unstale":"2024-09-14T08:43:16.380084+0000","last_undegraded":"2024-09-14T08:43:16.380084+0000","last_fullsized":"2024-09-14T08:43:16.380084+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:19.842971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000657852,"stat_sum":{"num_bytes":26077253,"num_objects":44,"num_object_clones":9,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":22,"num_read":52515,"num_read_kb":50286,"num_write":554,"num_write_kb":32325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":6496921,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.376033+0000","last_change":"2024-09-14T08:43:11.385079+0000","last_active":"2024-09-14T08:43:17.376033+0000","last_peered":"2024-09-14T08:43:17.376033+0000","last_clean":"2024-09-14T08:43:17.376033+0000","last_became_active":"2024-09-14T08:43:11.384762+0000","last_became_peered":"2024-09-14T08:43:11.384762+0000","last_unstale":"2024-09-14T08:43:17.376033+0000","last_undegraded":"2024-09-14T08:43:17.376033+0000","last_fullsized":"2024-09-14T08:43:17.376033+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:59.189410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"191'590","reported_seq":6294,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.383237+0000","last_change":"2024-09-14T08:43:15.382906+0000","last_active":"2024-09-14T08:43:16.383237+0000","last_peered":"2024-09-14T08:43:16.383237+0000","last_clean":"2024-09-14T08:43:16.383237+0000","last_became_active":"2024-09-14T08:43:05.385814+0000","last_became_peered":"2024-09-14T08:43:05.385814+0000","last_unstale":"2024-09-14T08:43:16.383237+0000","last_undegraded":"2024-09-14T08:43:16.383237+0000","last_fullsized":"2024-09-14T08:43:16.383237+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:12.835655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001532088,"stat_sum":{"num_bytes":38005903,"num_objects":38,"num_object_clones":4,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":23,"num_read":6259,"num_read_kb":17080,"num_write":586,"num_write_kb":20401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":6627757,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.383337+0000","last_change":"2024-09-14T08:42:59.735414+0000","last_active":"2024-09-14T08:43:16.383337+0000","last_peered":"2024-09-14T08:43:16.383337+0000","last_clean":"2024-09-14T08:43:16.383337+0000","last_became_active":"2024-09-14T08:42:59.734556+0000","last_became_peered":"2024-09-14T08:42:59.734556+0000","last_unstale":"2024-09-14T08:43:16.383337+0000","last_undegraded":"2024-09-14T08:43:16.383337+0000","last_fullsized":"2024-09-14T08:43:16.383337+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:09.696145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"191'746","reported_seq":10718,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.386989+0000","last_change":"2024-09-14T08:43:16.386989+0000","last_active":"2024-09-14T08:43:16.386989+0000","last_peered":"2024-09-14T08:43:16.386989+0000","last_clean":"2024-09-14T08:43:16.386989+0000","last_became_active":"2024-09-14T08:43:16.384133+0000","last_became_peered":"2024-09-14T08:43:16.384133+0000","last_unstale":"2024-09-14T08:43:16.386989+0000","last_undegraded":"2024-09-14T08:43:16.386989+0000","last_fullsized":"2024-09-14T08:43:16.386989+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:13:28.829869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237908,"stat_sum":{"num_bytes":15455976,"num_objects":46,"num_object_clones":7,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":26,"num_read":11077,"num_read_kb":43135,"num_write":1029,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":4578256,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.3","version":"192'1475","reported_seq":21146,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379432+0000","last_change":"2024-09-14T08:43:15.381495+0000","last_active":"2024-09-14T08:43:16.379432+0000","last_peered":"2024-09-14T08:43:16.379432+0000","last_clean":"2024-09-14T08:43:16.379432+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:43:16.379432+0000","last_undegraded":"2024-09-14T08:43:16.379432+0000","last_fullsized":"2024-09-14T08:43:16.379432+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1475,"log_dups_size":0,"ondisk_log_size":1475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:01.535592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002240742,"stat_sum":{"num_bytes":10275840,"num_objects":42,"num_object_clones":5,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":27,"num_read":24777,"num_read_kb":26968,"num_write":2341,"num_write_kb":5061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.2","version":"19'2","reported_seq":59,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.382912+0000","last_change":"2024-09-14T08:43:05.397691+0000","last_active":"2024-09-14T08:43:16.382912+0000","last_peered":"2024-09-14T08:43:16.382912+0000","last_clean":"2024-09-14T08:43:16.382912+0000","last_became_active":"2024-09-14T08:43:05.385764+0000","last_became_peered":"2024-09-14T08:43:05.385764+0000","last_unstale":"2024-09-14T08:43:16.382912+0000","last_undegraded":"2024-09-14T08:43:16.382912+0000","last_fullsized":"2024-09-14T08:43:16.382912+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:57.939626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"191'433","reported_seq":27813,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.382763+0000","last_change":"2024-09-14T08:43:15.381834+0000","last_active":"2024-09-14T08:43:16.382763+0000","last_peered":"2024-09-14T08:43:16.382763+0000","last_clean":"2024-09-14T08:43:16.382763+0000","last_became_active":"2024-09-14T08:43:04.374801+0000","last_became_peered":"2024-09-14T08:43:04.374801+0000","last_unstale":"2024-09-14T08:43:16.382763+0000","last_undegraded":"2024-09-14T08:43:16.382763+0000","last_fullsized":"2024-09-14T08:43:16.382763+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:11.750945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383081,"stat_sum":{"num_bytes":13491262,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":15,"num_read":26947,"num_read_kb":27579,"num_write":437,"num_write_kb":3537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":3380924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.1","version":"0'0","reported_seq":383,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379464+0000","last_change":"2024-09-14T08:42:59.737549+0000","last_active":"2024-09-14T08:43:16.379464+0000","last_peered":"2024-09-14T08:43:16.379464+0000","last_clean":"2024-09-14T08:43:16.379464+0000","last_became_active":"2024-09-14T08:42:59.737208+0000","last_became_peered":"2024-09-14T08:42:59.737208+0000","last_unstale":"2024-09-14T08:43:16.379464+0000","last_undegraded":"2024-09-14T08:43:16.379464+0000","last_fullsized":"2024-09-14T08:43:16.379464+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:23.174811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"191'411","reported_seq":8605,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.375527+0000","last_change":"2024-09-14T08:43:15.382117+0000","last_active":"2024-09-14T08:43:17.375527+0000","last_peered":"2024-09-14T08:43:17.375527+0000","last_clean":"2024-09-14T08:43:17.375527+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:43:17.375527+0000","last_undegraded":"2024-09-14T08:43:17.375527+0000","last_fullsized":"2024-09-14T08:43:17.375527+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:52.527691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010803880000000001,"stat_sum":{"num_bytes":34930725,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":13,"num_read":7742,"num_read_kb":16833,"num_write":417,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.0","version":"0'0","reported_seq":102,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.382629+0000","last_change":"2024-09-14T08:43:11.378457+0000","last_active":"2024-09-14T08:43:16.382629+0000","last_peered":"2024-09-14T08:43:16.382629+0000","last_clean":"2024-09-14T08:43:16.382629+0000","last_became_active":"2024-09-14T08:43:11.378113+0000","last_became_peered":"2024-09-14T08:43:11.378113+0000","last_unstale":"2024-09-14T08:43:16.382629+0000","last_undegraded":"2024-09-14T08:43:16.382629+0000","last_fullsized":"2024-09-14T08:43:16.382629+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:10.175793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"192'497","reported_seq":18362,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.382245+0000","last_change":"2024-09-14T08:43:15.382288+0000","last_active":"2024-09-14T08:43:16.382245+0000","last_peered":"2024-09-14T08:43:16.382245+0000","last_clean":"2024-09-14T08:43:16.382245+0000","last_became_active":"2024-09-14T08:43:14.384007+0000","last_became_peered":"2024-09-14T08:43:14.384007+0000","last_unstale":"2024-09-14T08:43:16.382245+0000","last_undegraded":"2024-09-14T08:43:16.382245+0000","last_fullsized":"2024-09-14T08:43:16.382245+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:01.251953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00153169,"stat_sum":{"num_bytes":31996069,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":17786,"num_read_kb":57260,"num_write":594,"num_write_kb":6796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":452,"num_bytes_recovered":15227317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"2.3","version":"17'1","reported_seq":299,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379760+0000","last_change":"2024-09-14T08:43:05.397167+0000","last_active":"2024-09-14T08:43:16.379760+0000","last_peered":"2024-09-14T08:43:16.379760+0000","last_clean":"2024-09-14T08:43:16.379760+0000","last_became_active":"2024-09-14T08:43:05.383499+0000","last_became_peered":"2024-09-14T08:43:05.383499+0000","last_unstale":"2024-09-14T08:43:16.379760+0000","last_undegraded":"2024-09-14T08:43:16.379760+0000","last_fullsized":"2024-09-14T08:43:16.379760+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:34.489242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":55,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.375596+0000","last_change":"2024-09-14T08:43:11.386530+0000","last_active":"2024-09-14T08:43:17.375596+0000","last_peered":"2024-09-14T08:43:17.375596+0000","last_clean":"2024-09-14T08:43:17.375596+0000","last_became_active":"2024-09-14T08:43:11.378014+0000","last_became_peered":"2024-09-14T08:43:11.378014+0000","last_unstale":"2024-09-14T08:43:17.375596+0000","last_undegraded":"2024-09-14T08:43:17.375596+0000","last_fullsized":"2024-09-14T08:43:17.375596+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:24.873378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"191'541","reported_seq":35283,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379340+0000","last_change":"2024-09-14T08:43:15.373706+0000","last_active":"2024-09-14T08:43:16.379340+0000","last_peered":"2024-09-14T08:43:16.379340+0000","last_clean":"2024-09-14T08:43:16.379340+0000","last_became_active":"2024-09-14T08:43:05.383845+0000","last_became_peered":"2024-09-14T08:43:05.383845+0000","last_unstale":"2024-09-14T08:43:16.379340+0000","last_undegraded":"2024-09-14T08:43:16.379340+0000","last_fullsized":"2024-09-14T08:43:16.379340+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:01.901931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014812689999999999,"stat_sum":{"num_bytes":11125875,"num_objects":32,"num_object_clones":2,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":16,"num_read":33080,"num_read_kb":35531,"num_write":430,"num_write_kb":3443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":2364662,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.9","version":"191'948","reported_seq":16301,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379136+0000","last_change":"2024-09-14T08:43:15.379696+0000","last_active":"2024-09-14T08:43:16.379136+0000","last_peered":"2024-09-14T08:43:16.379136+0000","last_clean":"2024-09-14T08:43:16.379136+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:43:16.379136+0000","last_undegraded":"2024-09-14T08:43:16.379136+0000","last_fullsized":"2024-09-14T08:43:16.379136+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:49.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026545850000000001,"stat_sum":{"num_bytes":20089446,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":23,"num_read":15547,"num_read_kb":32507,"num_write":783,"num_write_kb":8902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.a","version":"194'598","reported_seq":14028,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.387790+0000","last_change":"2024-09-14T08:43:16.388170+0000","last_active":"2024-09-14T08:43:16.387790+0000","last_peered":"2024-09-14T08:43:16.387790+0000","last_clean":"2024-09-14T08:43:16.387790+0000","last_became_active":"2024-09-14T08:43:16.382871+0000","last_became_peered":"2024-09-14T08:43:16.382871+0000","last_unstale":"2024-09-14T08:43:16.387790+0000","last_undegraded":"2024-09-14T08:43:16.387790+0000","last_fullsized":"2024-09-14T08:43:16.387790+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:56:43.386761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026515660000000002,"stat_sum":{"num_bytes":41086529,"num_objects":31,"num_object_clones":5,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":16,"num_read":14441,"num_read_kb":83640,"num_write":594,"num_write_kb":41440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":283,"num_bytes_recovered":18337410,"num_keys_recovered":105,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.b","version":"191'635","reported_seq":5818,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.383122+0000","last_change":"2024-09-14T08:43:15.382439+0000","last_active":"2024-09-14T08:43:16.383122+0000","last_peered":"2024-09-14T08:43:16.383122+0000","last_clean":"2024-09-14T08:43:16.383122+0000","last_became_active":"2024-09-14T08:43:03.368852+0000","last_became_peered":"2024-09-14T08:43:03.368852+0000","last_unstale":"2024-09-14T08:43:16.383122+0000","last_undegraded":"2024-09-14T08:43:16.383122+0000","last_fullsized":"2024-09-14T08:43:16.383122+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:29.816378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001377419,"stat_sum":{"num_bytes":12873760,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":17,"num_read":6322,"num_read_kb":21945,"num_write":809,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":387,"num_bytes_recovered":7762120,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.c","version":"195'969","reported_seq":44776,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.543836+0000","last_change":"2024-09-14T08:43:17.387796+0000","last_active":"2024-09-14T08:43:17.543836+0000","last_peered":"2024-09-14T08:43:17.543836+0000","last_clean":"2024-09-14T08:43:17.543836+0000","last_became_active":"2024-09-14T08:43:17.380948+0000","last_became_peered":"2024-09-14T08:43:17.380948+0000","last_unstale":"2024-09-14T08:43:17.543836+0000","last_undegraded":"2024-09-14T08:43:17.543836+0000","last_fullsized":"2024-09-14T08:43:17.543836+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:29.349543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031588269999999999,"stat_sum":{"num_bytes":24387623,"num_objects":43,"num_object_clones":7,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":25,"num_read":49255,"num_read_kb":102883,"num_write":763,"num_write_kb":9619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":466,"num_bytes_recovered":12466332,"num_keys_recovered":182,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.d","version":"191'645","reported_seq":7989,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379937+0000","last_change":"2024-09-14T08:43:15.387795+0000","last_active":"2024-09-14T08:43:16.379937+0000","last_peered":"2024-09-14T08:43:16.379937+0000","last_clean":"2024-09-14T08:43:16.379937+0000","last_became_active":"2024-09-14T08:43:15.380346+0000","last_became_peered":"2024-09-14T08:43:15.380346+0000","last_unstale":"2024-09-14T08:43:16.379937+0000","last_undegraded":"2024-09-14T08:43:16.379937+0000","last_fullsized":"2024-09-14T08:43:16.379937+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:26.563980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036837100000000002,"stat_sum":{"num_bytes":12927488,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":12,"num_read":8994,"num_read_kb":22539,"num_write":498,"num_write_kb":7328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":6800384,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.e","version":"191'306","reported_seq":7414,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379421+0000","last_change":"2024-09-14T08:43:15.380736+0000","last_active":"2024-09-14T08:43:16.379421+0000","last_peered":"2024-09-14T08:43:16.379421+0000","last_clean":"2024-09-14T08:43:16.379421+0000","last_became_active":"2024-09-14T08:43:08.375885+0000","last_became_peered":"2024-09-14T08:43:08.375885+0000","last_unstale":"2024-09-14T08:43:16.379421+0000","last_undegraded":"2024-09-14T08:43:16.379421+0000","last_fullsized":"2024-09-14T08:43:16.379421+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:10.580829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026032640000000001,"stat_sum":{"num_bytes":13799936,"num_objects":29,"num_object_clones":2,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":16,"num_read":6541,"num_read_kb":21437,"num_write":274,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":561152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.f","version":"191'539","reported_seq":9805,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.385552+0000","last_change":"2024-09-14T08:43:17.385552+0000","last_active":"2024-09-14T08:43:17.385552+0000","last_peered":"2024-09-14T08:43:17.385552+0000","last_clean":"2024-09-14T08:43:17.385552+0000","last_became_active":"2024-09-14T08:43:17.380806+0000","last_became_peered":"2024-09-14T08:43:17.380806+0000","last_unstale":"2024-09-14T08:43:17.385552+0000","last_undegraded":"2024-09-14T08:43:17.385552+0000","last_fullsized":"2024-09-14T08:43:17.385552+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:06.600302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022085500000000001,"stat_sum":{"num_bytes":40079376,"num_objects":47,"num_object_clones":12,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":26,"num_read":7835,"num_read_kb":43794,"num_write":488,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":636,"num_bytes_recovered":25134704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.10","version":"195'450","reported_seq":19730,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.375466+0000","last_change":"2024-09-14T08:43:15.382127+0000","last_active":"2024-09-14T08:43:17.375466+0000","last_peered":"2024-09-14T08:43:17.375466+0000","last_clean":"2024-09-14T08:43:17.375466+0000","last_became_active":"2024-09-14T08:43:08.375580+0000","last_became_peered":"2024-09-14T08:43:08.375580+0000","last_unstale":"2024-09-14T08:43:17.375466+0000","last_undegraded":"2024-09-14T08:43:17.375466+0000","last_fullsized":"2024-09-14T08:43:17.375466+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:16.940201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031778269999999998,"stat_sum":{"num_bytes":31244414,"num_objects":37,"num_object_clones":6,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":16,"num_read":19955,"num_read_kb":55711,"num_write":441,"num_write_kb":3477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":353,"num_bytes_recovered":2324520,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.11","version":"192'510","reported_seq":43982,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379282+0000","last_change":"2024-09-14T08:43:15.379493+0000","last_active":"2024-09-14T08:43:16.379282+0000","last_peered":"2024-09-14T08:43:16.379282+0000","last_clean":"2024-09-14T08:43:16.379282+0000","last_became_active":"2024-09-14T08:43:14.385923+0000","last_became_peered":"2024-09-14T08:43:14.385923+0000","last_unstale":"2024-09-14T08:43:16.379282+0000","last_undegraded":"2024-09-14T08:43:16.379282+0000","last_fullsized":"2024-09-14T08:43:16.379282+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:42.736630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020699749999999999,"stat_sum":{"num_bytes":4262479,"num_objects":38,"num_object_clones":7,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":24,"num_read":43989,"num_read_kb":101589,"num_write":410,"num_write_kb":14201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":14335213,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.12","version":"195'569","reported_seq":6586,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-14T08:43:17.384982+0000","last_change":"2024-09-14T08:43:17.384562+0000","last_active":"2024-09-14T08:43:17.384982+0000","last_peered":"2024-09-14T08:43:17.384982+0000","last_clean":"2024-09-14T08:43:17.384982+0000","last_became_active":"2024-09-14T08:43:17.381063+0000","last_became_peered":"2024-09-14T08:43:17.381063+0000","last_unstale":"2024-09-14T08:43:17.384982+0000","last_undegraded":"2024-09-14T08:43:17.384982+0000","last_fullsized":"2024-09-14T08:43:17.384982+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:37.855032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001341947,"stat_sum":{"num_bytes":7091826,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":20,"num_read":5523,"num_read_kb":20668,"num_write":572,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":17076794,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"3"}]},{"pgid":"3.13","version":"192'852","reported_seq":3956,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-14T08:43:16.379568+0000","last_change":"2024-09-14T08:43:15.374078+0000","last_active":"2024-09-14T08:43:16.379568+0000","last_peered":"2024-09-14T08:43:16.379568+0000","last_clean":"2024-09-14T08:43:16.379568+0000","last_became_active":"2024-09-14T08:43:14.380884+0000","last_became_peered":"2024-09-14T08:43:14.380884+0000","last_unstale":"2024-09-14T08:43:16.379568+0000","last_undegraded":"2024-09-14T08:43:16.379568+0000","last_fullsized":"2024-09-14T08:43:16.379568+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:00.437049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001468158,"stat_sum":{"num_bytes":12034180,"num_objects":41,"num_object_clones":5,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":23,"num_read":5554,"num_read_kb":13798,"num_write":1229,"num_write_kb":9128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":3502437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"18","length":"3"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":654025410,"num_objects":1190,"num_object_clones":192,"num_object_copies":2380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":638,"num_read":604482,"num_read_kb":1284457,"num_write":25397,"num_write_kb":295064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9203,"num_bytes_recovered":214886831,"num_keys_recovered":901,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123465728,"data_stored":144050286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},"log_size":22459,"ondisk_log_size":22459,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100284,"kb_used_data":28412,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94271556,"statfs":{"total":96636764160,"available":96534073344,"internally_reserved":0,"allocated":29093888,"data_stored":30914353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574903,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76816,"kb_used_data":27576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94295024,"statfs":{"total":96636764160,"available":96558104576,"internally_reserved":0,"allocated":28237824,"data_stored":30126466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149728,"kb_used_data":38020,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94222112,"statfs":{"total":96636764160,"available":96483442688,"internally_reserved":0,"allocated":38932480,"data_stored":44001183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":0,"seq":51539607607,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846610,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56032,"kb_used_data":22660,"kb_used_omap":22,"kb_used_meta":33321,"kb_avail":94315808,"statfs":{"total":96636764160,"available":96579387392,"internally_reserved":0,"allocated":23203840,"data_stored":24779061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":34121504},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20262912,"data_stored":23196986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38817792,"data_stored":46862762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19357696,"data_stored":20885848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11689984,"data_stored":14912681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26775552,"data_stored":29932872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6561792,"data_stored":8259137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:43:20.270 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T08:43:20.270 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:43:20.270 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-14T08:43:20.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-14T08:43:20.304 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.304 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.345352539999993, 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.344155454000003, 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:43:20.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.344092762000002, 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.318 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.344055014999995, 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:43:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:43:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:20.323 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.343957951999997, 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:20.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:20.328 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.343877105000004, 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:20.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:43:20.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:20.333 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 60.951870755999998, 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:43:20.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:43:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:43:20.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.623120620999998, 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.057207060999999997, 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.339 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681724+0000", 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.804e-06 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681734+0000", 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6490000000000003e-06 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681751+0000", 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7176999999999998e-05 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681760+0000", 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681849+0000", 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8837000000000003e-05 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681981+0000", 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013216700000000001 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.685622+0000", 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003641483 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.690759+0000", 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051364820000000004 2024-09-14T08:43:20.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738832+0000", 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.048073087 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738883+0000", 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1428000000000003e-05 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738930+0000", 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6471000000000003e-05 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.598648738999998, 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032695727000000001, 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.345 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for ondisk", 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706196+0000", 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.387e-06 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706206+0000", 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706218+0000", 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2092e-05 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706227+0000", 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6549999999999993e-06 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706292+0000", 2024-09-14T08:43:20.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5571e-05 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for ondisk", 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706626+0000", 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033403600000000001 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738890+0000", 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032263888999999997 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6051 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4012032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530211932999997, 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030933603, 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6051 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774632+0000", 2024-09-14T08:43:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774634+0000", 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774640+0000", 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9689999999999999e-06 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774645+0000", 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7359999999999998e-06 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805487+0000", 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030841179 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805527+0000", 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0442999999999999e-05 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805565+0000", 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7854e-05 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6052 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3667968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530191160999998, 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031002565999999999, 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6052 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774653+0000", 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.39e-07 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774655+0000", 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1560000000000002e-06 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774660+0000", 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774665+0000", 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805581+0000", 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030915857000000001 2024-09-14T08:43:20.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805617+0000", 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5985999999999997e-05 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805655+0000", 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7771000000000001e-05 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6053 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3790848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530170820999999, 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031072499, 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6053 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774673+0000", 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774675+0000", 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0729999999999999e-06 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774679+0000", 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1840000000000001e-06 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774682+0000", 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805671+0000", 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030988430000000001 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805706+0000", 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5685999999999997e-05 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805745+0000", 2024-09-14T08:43:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8637000000000003e-05 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6054 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3446784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530157107000001, 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031147358, 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6054 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774688+0000", 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.378e-06 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774692+0000", 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0249999999999996e-06 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774695+0000", 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8289999999999999e-06 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805761+0000", 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031066142000000001 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805797+0000", 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5942000000000002e-05 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805834+0000", 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6789999999999998e-05 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6055 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4134912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.367 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530145068000003, 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031224526999999998, 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6055 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774699+0000", 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774700+0000", 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2440000000000001e-06 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774704+0000", 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6120000000000001e-06 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774707+0000", 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8940000000000002e-06 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805849+0000", 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031141629000000001 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805887+0000", 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579000000000001e-05 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805923+0000", 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6207000000000001e-05 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6056 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3569664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530132401000003, 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031298725999999999, 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6056 2024-09-14T08:43:20.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.65e-07 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774712+0000", 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.238e-06 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774716+0000", 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.326e-06 2024-09-14T08:43:20.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774719+0000", 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8380000000000002e-06 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805938+0000", 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031219757000000001 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805973+0000", 2024-09-14T08:43:20.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4999999999999997e-05 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806010+0000", 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6301999999999999e-05 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6057 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3913728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530121190000003, 2024-09-14T08:43:20.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031394058000000002, 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6057 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774723+0000", 2024-09-14T08:43:20.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.175e-06 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774727+0000", 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8979999999999998e-06 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774731+0000", 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8870000000000002e-06 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806036+0000", 2024-09-14T08:43:20.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031304473999999999 2024-09-14T08:43:20.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806076+0000", 2024-09-14T08:43:20.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0037999999999999e-05 2024-09-14T08:43:20.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806116+0000", 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0363e-05 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6058 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4036608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530108396000003, 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031564481999999998, 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.381 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6058 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3900000000000001e-07 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774736+0000", 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.204e-06 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774740+0000", 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3589999999999999e-06 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774742+0000", 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806144+0000", 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031401815999999999 2024-09-14T08:43:20.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806220+0000", 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5556999999999995e-05 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806299+0000", 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9534000000000001e-05 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6059 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3692544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530097165999997, 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031762410999999997, 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6059 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.386 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774748+0000", 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2109999999999999e-06 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774751+0000", 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4060000000000001e-06 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774754+0000", 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806358+0000", 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031604039 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806434+0000", 2024-09-14T08:43:20.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6068000000000004e-05 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806509+0000", 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4629000000000007e-05 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6060 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3471360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:20.390 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530085116999999, 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031873437999999997, 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6060 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:20.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774759+0000", 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3200000000000005e-07 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774761+0000", 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774767+0000", 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4280000000000001e-06 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774773+0000", 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2020000000000001e-06 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806543+0000", 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031769144999999999 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806589+0000", 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6119999999999999e-05 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806632+0000", 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2852000000000002e-05 2024-09-14T08:43:20.394 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6061 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3815424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.530063048999999, 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032027014999999999, 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:20.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6061 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782424+0000", 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0076440379999999997 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782439+0000", 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4362000000000001e-05 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782448+0000", 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3929999999999997e-06 2024-09-14T08:43:20.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782454+0000", 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9900000000000002e-06 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806671+0000", 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024216615 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806739+0000", 2024-09-14T08:43:20.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8272e-05 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806807+0000", 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8344999999999997e-05 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:20.399 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:20.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:20.401 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:20.404+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:20.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:43:20.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:43:20.501 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:20.504+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:20.580 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:20.581 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:20.581 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:20.581 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:20.590 INFO:teuthology.orchestra.run.smithi089.stdout:moved 0 / 82 (0%) 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stdout:avg 20.5 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stdout:stddev 3.84057 -> 3.84057 (expected baseline 3.9211) 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stdout:min osd.2 with 17 -> 17 pgs (0.829268 -> 0.829268 * mean) 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stdout:max osd.1 with 27 -> 27 pgs (1.31707 -> 1.31707 * mean) 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stdout:oload 1000 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stdout:max_change 0.05 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stdout:max_change_osds 4 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stdout:average_utilization 0.0010 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stdout:overload_utilization 0.0101 2024-09-14T08:43:20.591 INFO:teuthology.orchestra.run.smithi089.stderr:no change 2024-09-14T08:43:20.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:43:20.616 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-14T08:43:20.616 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-09-14T08:43:20.616 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:20.617+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:20.637 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:20.657 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:20.657 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:20.676 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:20.676 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:20.697 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:20.697 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:20.702 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:20.704+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:20.717 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:20.717 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:20.738 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:20.738 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:20.743 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:20.744 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:20.761 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:43:20.808 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:20.809+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:20.904 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:20.904+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:20.914 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:20.914 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:20.928 INFO:teuthology.orchestra.run.smithi089.stdout:moved 0 / 82 (0%) 2024-09-14T08:43:20.928 INFO:teuthology.orchestra.run.smithi089.stdout:avg 20.5 2024-09-14T08:43:20.928 INFO:teuthology.orchestra.run.smithi089.stdout:stddev 3.84057 -> 3.84057 (expected baseline 3.9211) 2024-09-14T08:43:20.928 INFO:teuthology.orchestra.run.smithi089.stdout:min osd.2 with 17 -> 17 pgs (0.829268 -> 0.829268 * mean) 2024-09-14T08:43:20.928 INFO:teuthology.orchestra.run.smithi089.stdout:max osd.1 with 27 -> 27 pgs (1.31707 -> 1.31707 * mean) 2024-09-14T08:43:20.928 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:43:20.929 INFO:teuthology.orchestra.run.smithi089.stdout:oload 1000 2024-09-14T08:43:20.929 INFO:teuthology.orchestra.run.smithi089.stdout:max_change 0.05 2024-09-14T08:43:20.929 INFO:teuthology.orchestra.run.smithi089.stdout:max_change_osds 4 2024-09-14T08:43:20.929 INFO:teuthology.orchestra.run.smithi089.stdout:average_utilization 0.0010 2024-09-14T08:43:20.929 INFO:teuthology.orchestra.run.smithi089.stdout:overload_utilization 0.0101 2024-09-14T08:43:20.929 INFO:teuthology.orchestra.run.smithi089.stderr:no change 2024-09-14T08:43:20.930 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:20.946 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-14T08:43:20.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-14T08:43:21.005 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:21.008+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:21.042 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:21.042 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:21.057 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:21.105 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:21.105+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:21.170 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:21.170 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:21.183 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:21.223 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:21.225+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:21.268 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-14T08:43:21.272+0000 7fed676d0640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-14T08:43:21.269 INFO:teuthology.orchestra.run.smithi089.stdout:moved 10 / 82 (12.1951%) 2024-09-14T08:43:21.269 INFO:teuthology.orchestra.run.smithi089.stdout:avg 20.5 2024-09-14T08:43:21.269 INFO:teuthology.orchestra.run.smithi089.stdout:stddev 3.84057 -> 2.17945 (expected baseline 3.9211) 2024-09-14T08:43:21.269 INFO:teuthology.orchestra.run.smithi089.stdout:min osd.2 with 17 -> 21 pgs (0.829268 -> 1.02439 * mean) 2024-09-14T08:43:21.269 INFO:teuthology.orchestra.run.smithi089.stdout:max osd.1 with 27 -> 17 pgs (1.31707 -> 0.829268 * mean) 2024-09-14T08:43:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:43:21.269 INFO:teuthology.orchestra.run.smithi089.stdout:oload 110 2024-09-14T08:43:21.270 INFO:teuthology.orchestra.run.smithi089.stdout:max_change 1 2024-09-14T08:43:21.270 INFO:teuthology.orchestra.run.smithi089.stdout:max_change_osds 4 2024-09-14T08:43:21.270 INFO:teuthology.orchestra.run.smithi089.stdout:average_utilization 0.0010 2024-09-14T08:43:21.270 INFO:teuthology.orchestra.run.smithi089.stdout:overload_utilization 0.0011 2024-09-14T08:43:21.270 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 weight 1.0000 -> 0.6393 2024-09-14T08:43:21.270 INFO:teuthology.orchestra.run.smithi089.stderr:no change 2024-09-14T08:43:21.286 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-14T08:43:21.286 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2024-09-14T08:43:21.307 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:21.308+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:21.349 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:21.349 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:21.363 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:21.408 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:21.412+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:21.483 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:43:21.499 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:21.499 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:21.509 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:21.509+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:21.514 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:21.586 INFO:teuthology.orchestra.run.smithi089.stdout:moved 0 / 82 (0%) 2024-09-14T08:43:21.586 INFO:teuthology.orchestra.run.smithi089.stdout:avg 20.5 2024-09-14T08:43:21.586 INFO:teuthology.orchestra.run.smithi089.stdout:stddev 3.84057 -> 3.84057 (expected baseline 3.9211) 2024-09-14T08:43:21.586 INFO:teuthology.orchestra.run.smithi089.stdout:min osd.2 with 17 -> 17 pgs (0.829268 -> 0.829268 * mean) 2024-09-14T08:43:21.587 INFO:teuthology.orchestra.run.smithi089.stdout:max osd.1 with 27 -> 27 pgs (1.31707 -> 1.31707 * mean) 2024-09-14T08:43:21.587 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:43:21.587 INFO:teuthology.orchestra.run.smithi089.stdout:oload 1000 2024-09-14T08:43:21.587 INFO:teuthology.orchestra.run.smithi089.stdout:max_change 1 2024-09-14T08:43:21.587 INFO:teuthology.orchestra.run.smithi089.stdout:max_change_osds 4 2024-09-14T08:43:21.587 INFO:teuthology.orchestra.run.smithi089.stdout:average_utilization 0.0010 2024-09-14T08:43:21.587 INFO:teuthology.orchestra.run.smithi089.stdout:overload_utilization 0.0100 2024-09-14T08:43:21.587 INFO:teuthology.orchestra.run.smithi089.stderr:no change 2024-09-14T08:43:21.605 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-14T08:43:21.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-14T08:43:21.652 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:21.653+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:21.695 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:21.695 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:21.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:21.711 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:21.712+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:21.812 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:21.813+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:21.878 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:21.878 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:21.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:21.896 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-14T08:43:21.896+0000 7fed676d0640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-14T08:43:21.896 INFO:teuthology.orchestra.run.smithi089.stdout:moved 10 / 82 (12.1951%) 2024-09-14T08:43:21.896 INFO:teuthology.orchestra.run.smithi089.stdout:avg 20.5 2024-09-14T08:43:21.896 INFO:teuthology.orchestra.run.smithi089.stdout:stddev 3.84057 -> 2.17945 (expected baseline 3.9211) 2024-09-14T08:43:21.896 INFO:teuthology.orchestra.run.smithi089.stdout:min osd.2 with 17 -> 21 pgs (0.829268 -> 1.02439 * mean) 2024-09-14T08:43:21.896 INFO:teuthology.orchestra.run.smithi089.stdout:max osd.1 with 27 -> 17 pgs (1.31707 -> 0.829268 * mean) 2024-09-14T08:43:21.897 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:43:21.897 INFO:teuthology.orchestra.run.smithi089.stdout:oload 110 2024-09-14T08:43:21.897 INFO:teuthology.orchestra.run.smithi089.stdout:max_change 1 2024-09-14T08:43:21.897 INFO:teuthology.orchestra.run.smithi089.stdout:max_change_osds 4 2024-09-14T08:43:21.897 INFO:teuthology.orchestra.run.smithi089.stdout:average_utilization 0.0010 2024-09-14T08:43:21.897 INFO:teuthology.orchestra.run.smithi089.stdout:overload_utilization 0.0011 2024-09-14T08:43:21.897 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 weight 1.0000 -> 0.6335 2024-09-14T08:43:21.897 INFO:teuthology.orchestra.run.smithi089.stderr:no change 2024-09-14T08:43:21.912 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:21.913+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:22.011 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:22.011 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:22.014 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:22.013+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:22.025 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:22.114 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:22.116+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:22.187 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:22.187 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:22.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:22.214 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:22.213+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:22.315 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:22.316+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:22.369 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:22.369 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:22.383 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:22.424 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:22.428+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:22.517 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:22.517+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:22.555 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:22.555 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:22.571 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:22.618 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:22.617+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:22.690 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:22.690 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:22.705 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:22.748 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:22.752+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:22.766 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:43:22.821 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:22.821+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:22.831 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:22.831 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:22.846 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:22.919 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:22.919 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:22.921 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:22.924+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:22.936 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:22.936 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:22.954 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:22.955 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:22.973 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:22.973 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:22.976 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:22.976 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:22.988 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:22.997 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:23.000 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:23.018 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:23.018 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:23.022 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:23.024+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:23.107 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:23.107 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:23.107 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:23.107 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:23.108 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:23.122 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:23.122 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:23.121+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:23.222 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:23.221+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.328714469999994, 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.289 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.290 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:23.290 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.290 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:43:23.290 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:23.290 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:43:23.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.290 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.327517384000004, 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:43:23.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.327454692000003, 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:23.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:43:23.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:43:23.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:43:23.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.327416944999996, 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:23.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:43:23.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:43:23.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.327319881999998, 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:43:23.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 68.327239035000005, 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.313 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:43:23.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:43:23.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 63.935232685999999, 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:43:23.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:43:23.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.323 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.606482550999999, 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.057207060999999997, 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.324 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681724+0000", 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.804e-06 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681734+0000", 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6490000000000003e-06 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681751+0000", 2024-09-14T08:43:23.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7176999999999998e-05 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681760+0000", 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681849+0000", 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8837000000000003e-05 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681981+0000", 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013216700000000001 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.685622+0000", 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003641483 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.690759+0000", 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051364820000000004 2024-09-14T08:43:23.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738832+0000", 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.048073087 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738883+0000", 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1428000000000003e-05 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738930+0000", 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6471000000000003e-05 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.582010668999999, 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032695727000000001, 2024-09-14T08:43:23.330 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for ondisk", 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706196+0000", 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.387e-06 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706206+0000", 2024-09-14T08:43:23.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706218+0000", 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2092e-05 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706227+0000", 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6549999999999993e-06 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706292+0000", 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5571e-05 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for ondisk", 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706626+0000", 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033403600000000001 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738890+0000", 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032263888999999997 2024-09-14T08:43:23.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6051 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4012032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513573862999998, 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030933603, 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6051 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774632+0000", 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774634+0000", 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774640+0000", 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9689999999999999e-06 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774645+0000", 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7359999999999998e-06 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805487+0000", 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030841179 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805527+0000", 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0442999999999999e-05 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805565+0000", 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7854e-05 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6052 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3667968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:23.339 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513553090999999, 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031002565999999999, 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6052 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:23.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774653+0000", 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.39e-07 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774655+0000", 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1560000000000002e-06 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774660+0000", 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774665+0000", 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-14T08:43:23.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805581+0000", 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030915857000000001 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805617+0000", 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5985999999999997e-05 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805655+0000", 2024-09-14T08:43:23.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7771000000000001e-05 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6053 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3790848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513532751, 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031072499, 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.344 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6053 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774673+0000", 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774675+0000", 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0729999999999999e-06 2024-09-14T08:43:23.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774679+0000", 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1840000000000001e-06 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774682+0000", 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805671+0000", 2024-09-14T08:43:23.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030988430000000001 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805706+0000", 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5685999999999997e-05 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805745+0000", 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8637000000000003e-05 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6054 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3446784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513519037000002, 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031147358, 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6054 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.349 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:43:23.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774688+0000", 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.378e-06 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774692+0000", 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0249999999999996e-06 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774695+0000", 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8289999999999999e-06 2024-09-14T08:43:23.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805761+0000", 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031066142000000001 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805797+0000", 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5942000000000002e-05 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805834+0000", 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6789999999999998e-05 2024-09-14T08:43:23.352 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6055 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4134912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513506997999997, 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031224526999999998, 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.353 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6055 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774699+0000", 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774700+0000", 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2440000000000001e-06 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774704+0000", 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6120000000000001e-06 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774707+0000", 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8940000000000002e-06 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805849+0000", 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031141629000000001 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805887+0000", 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579000000000001e-05 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805923+0000", 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6207000000000001e-05 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.357 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6056 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3569664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513494330999997, 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031298725999999999, 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6056 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.358 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:23.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.65e-07 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774712+0000", 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.238e-06 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774716+0000", 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.326e-06 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774719+0000", 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8380000000000002e-06 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805938+0000", 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031219757000000001 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805973+0000", 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4999999999999997e-05 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806010+0000", 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6301999999999999e-05 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6057 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3913728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513483119999997, 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031394058000000002, 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.362 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6057 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:23.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774723+0000", 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.175e-06 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774727+0000", 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8979999999999998e-06 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774731+0000", 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8870000000000002e-06 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806036+0000", 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031304473999999999 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806076+0000", 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0037999999999999e-05 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806116+0000", 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0363e-05 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6058 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4036608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.366 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513470325999997, 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031564481999999998, 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6058 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3900000000000001e-07 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774736+0000", 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.204e-06 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774740+0000", 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3589999999999999e-06 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774742+0000", 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806144+0000", 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031401815999999999 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806220+0000", 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5556999999999995e-05 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806299+0000", 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9534000000000001e-05 2024-09-14T08:43:23.370 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6059 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3692544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513459095999998, 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031762410999999997, 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6059 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774748+0000", 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2109999999999999e-06 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774751+0000", 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4060000000000001e-06 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774754+0000", 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806358+0000", 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031604039 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806434+0000", 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6068000000000004e-05 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806509+0000", 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4629000000000007e-05 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6060 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3471360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513447047, 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031873437999999997, 2024-09-14T08:43:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6060 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774759+0000", 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3200000000000005e-07 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774761+0000", 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774767+0000", 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4280000000000001e-06 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774773+0000", 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2020000000000001e-06 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806543+0000", 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031769144999999999 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806589+0000", 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6119999999999999e-05 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806632+0000", 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2852000000000002e-05 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6061 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3815424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.513424979, 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032027014999999999, 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6061 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782424+0000", 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0076440379999999997 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782439+0000", 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4362000000000001e-05 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782448+0000", 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3929999999999997e-06 2024-09-14T08:43:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782454+0000", 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9900000000000002e-06 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806671+0000", 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024216615 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806739+0000", 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8272e-05 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806807+0000", 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8344999999999997e-05 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.384 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:23.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:23.386 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:23.388+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:23.487 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:23.485+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:23.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:43:23.564 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:23.564 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:23.564 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:23.564 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:23.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:43:23.624 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:23.625+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:23.688 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:23.692+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:23.700 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:23.700 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:23.700 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:23.700 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:23.700 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:23.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:43:23.803 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:23.805+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:23.883 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:23.883 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:23.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:23.883 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31814 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3396608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 206.95701700999999, 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076673677999999995, 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31814 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926295+0000", 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926296+0000", 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:43:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926298+0000", 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4389999999999999e-06 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926317+0000", 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9143e-05 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926324+0000", 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1240000000000002e-06 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002565+0000", 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076241336000000007 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002714+0000", 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014896899999999999 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.002969+0000", 2024-09-14T08:43:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025492400000000001 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4628.0:31815 3.6 3:63aa6ca2:::rbd_data.10f1c6465cc8.0000000000000004:8 [read 3405824~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 206.956962232, 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077017136999999999, 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4628", 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 31815 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926350+0000", 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926351+0000", 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926354+0000", 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926364+0000", 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0722e-05 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:56.926375+0000", 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0298e-05 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003056+0000", 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076681315 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003169+0000", 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011346200000000001 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:39:57.003367+0000", 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000197624 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4619.0:18119 3.7 e51/21 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head v 51'70, mlcod=38'68)", 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 193.52919177300001, 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.13033861299999999, 2024-09-14T08:43:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354120+0000", 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.354123+0000", 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7300000000000001e-06 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399509+0000", 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.045385970999999997 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399561+0000", 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1944000000000003e-05 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399585+0000", 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3592e-05 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399811+0000", 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000226333 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.399880+0000", 2024-09-14T08:43:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9497000000000002e-05 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484328+0000", 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.084447223000000002 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484459+0000", 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131323 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:837 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 170.53658770600001, 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.061039193, 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 837 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346724+0000", 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346726+0000", 2024-09-14T08:43:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8160000000000001e-06 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346732+0000", 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-06 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346748+0000", 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5894000000000001e-05 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346760+0000", 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1789e-05 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346819+0000", 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8964e-05 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.346829+0000", 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407588+0000", 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0607595400000001 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.407764+0000", 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017519000000000001 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5133.0:838 3.a 3:50903355:::rbd_data.10f1cefb7fdd.0000000000000009:head [sparse-read 4096~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 170.53574933499999, 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060787323, 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5133", 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/2460908916", 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 838 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347563+0000", 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347564+0000", 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347569+0000", 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0760000000000002e-06 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347582+0000", 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.359e-05 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347592+0000", 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6469999999999993e-06 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347637+0000", 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4706000000000002e-05 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:33.347644+0000", 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999998e-06 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408277+0000", 2024-09-14T08:43:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.060632617 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:34.408350+0000", 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3460999999999993e-05 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33894 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1398784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.517241234, 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076471563000000006, 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33894 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366071+0000", 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366349+0000", 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027808599999999998 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366353+0000", 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0010000000000003e-06 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366364+0000", 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0976e-05 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366372+0000", 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8720000000000002e-06 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442290+0000", 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075918020000000003 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442348+0000", 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8567999999999999e-05 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442542+0000", 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019404000000000001 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33895 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1411072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.516927025, 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076354057000000003, 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33895 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.366385+0000", 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367782+0000", 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013972360000000001 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367787+0000", 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7049999999999998e-06 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367808+0000", 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0822000000000002e-05 2024-09-14T08:43:23.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.367817+0000", 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1349999999999998e-06 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442560+0000", 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.074743211000000004 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442612+0000", 2024-09-14T08:43:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1931999999999997e-05 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.442739+0000", 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127016 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33901 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1484800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.515290699, 2024-09-14T08:43:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076411529000000006, 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33901 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:23.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368021+0000", 2024-09-14T08:43:23.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368205+0000", 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184055 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368209+0000", 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.963e-06 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368220+0000", 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0838e-05 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368227+0000", 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9689999999999997e-06 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444204+0000", 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075976642999999996 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444248+0000", 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4073000000000003e-05 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444433+0000", 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184988 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33902 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1497088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.51507273999999, 2024-09-14T08:43:23.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076470645000000004, 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33902 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368239+0000", 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368491+0000", 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025126800000000002 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368495+0000", 2024-09-14T08:43:23.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.211e-06 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368514+0000", 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9471999999999999e-05 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368522+0000", 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444464+0000", 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075942372999999994 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444512+0000", 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7688999999999997e-05 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444710+0000", 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019802099999999999 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.924 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33903 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1509376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.514777338, 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076420603000000004, 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33903 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368535+0000", 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368764+0000", 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000229213 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368768+0000", 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9890000000000003e-06 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368778+0000", 2024-09-14T08:43:23.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9280000000000005e-06 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368792+0000", 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4392999999999999e-05 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444726+0000", 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075933649000000006 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444771+0000", 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5269999999999999e-05 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444955+0000", 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018416099999999999 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:33904 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1521664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:23.929 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.51450650300001, 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076412253999999999, 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33904 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:23.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.368806+0000", 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369078+0000", 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027243900000000003 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369082+0000", 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369092+0000", 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0380000000000001e-05 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.369100+0000", 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.444987+0000", 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.075887184999999996 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445034+0000", 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6776000000000001e-05 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.445218+0000", 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000184234 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34957 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1861632~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.303315822, 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076664685999999996, 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.934 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34957 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579996+0000", 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579997+0000", 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.579999+0000", 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9709999999999998e-06 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580005+0000", 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2169999999999999e-06 2024-09-14T08:43:23.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580010+0000", 2024-09-14T08:43:23.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-14T08:43:23.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656298+0000", 2024-09-14T08:43:23.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076288506000000006 2024-09-14T08:43:23.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656396+0000", 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7311000000000004e-05 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656661+0000", 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026528599999999999 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34958 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1873920~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.303295788, 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077059047000000006, 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34958 2024-09-14T08:43:23.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580016+0000", 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580017+0000", 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580019+0000", 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2170000000000001e-06 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580025+0000", 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0639999999999999e-06 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580030+0000", 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7910000000000004e-06 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656704+0000", 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076674462999999998 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.656799+0000", 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4758000000000003e-05 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657075+0000", 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027635000000000002 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34959 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1886208~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.30327471, 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077449583000000002, 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.943 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34959 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580037+0000", 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580038+0000", 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580040+0000", 2024-09-14T08:43:23.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.939e-06 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580046+0000", 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209999999999997e-06 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580051+0000", 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9760000000000003e-06 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657126+0000", 2024-09-14T08:43:23.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077075276999999998 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657222+0000", 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5908000000000004e-05 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657487+0000", 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026514799999999999 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34960 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1898496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.303255116, 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077787913, 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34960 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580057+0000", 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580058+0000", 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580060+0000", 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9039999999999999e-06 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580066+0000", 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9510000000000003e-06 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580070+0000", 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9979999999999997e-06 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657530+0000", 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077460688999999999 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657626+0000", 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6057000000000005e-05 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657845+0000", 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021855799999999999 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34961 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1910784~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.303234962, 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078122146000000003, 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34961 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580077+0000", 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580078+0000", 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-14T08:43:23.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580080+0000", 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.007e-06 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580086+0000", 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580090+0000", 2024-09-14T08:43:23.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657895+0000", 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.077804400999999995 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.657986+0000", 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1333000000000001e-05 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658199+0000", 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000213236 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34962 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 1923072~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.30321556600001, 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.078538490000000002, 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34962 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.580097+0000", 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586336+0000", 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062398009999999997 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586341+0000", 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8110000000000002e-06 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586353+0000", 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1389999999999999e-05 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586361+0000", 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0479999999999999e-06 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658244+0000", 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.071883398000000001 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658357+0000", 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113009 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.658635+0000", 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027803300000000001 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34974 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2070528~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.960 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.296685766, 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076380898000000003, 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34974 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.961 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586626+0000", 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586627+0000", 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-14T08:43:23.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586629+0000", 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0710000000000002e-06 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586635+0000", 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8900000000000004e-06 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586640+0000", 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8409999999999999e-06 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662797+0000", 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076157358999999994 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.662892+0000", 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4537000000000006e-05 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663007+0000", 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115511 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34975 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2082816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.29666588000001, 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076612181000000001, 2024-09-14T08:43:23.965 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34975 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586646+0000", 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586647+0000", 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0400000000000002e-07 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586649+0000", 2024-09-14T08:43:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9429999999999999e-06 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586655+0000", 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1140000000000002e-06 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586659+0000", 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7369999999999997e-06 2024-09-14T08:43:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663055+0000", 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076395292000000004 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663148+0000", 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3738000000000003e-05 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663258+0000", 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109953 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5631.0:34976 3.6 3:66be1549:::rbd_data.10f12f878d5b.0000000000000001:1a [read 2095104~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e113)", 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 111.296646506, 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076866674999999995, 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5631", 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34976 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586666+0000", 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000002e-07 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586672+0000", 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8869999999999997e-06 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586678+0000", 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.285e-06 2024-09-14T08:43:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.586683+0000", 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0019999999999997e-06 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663306+0000", 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.076622903000000006 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663407+0000", 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010114 2024-09-14T08:43:23.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:23.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:23.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:23.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:32.663532+0000", 2024-09-14T08:43:23.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012506099999999999 2024-09-14T08:43:23.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:23.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:23.974 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:23.976 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:23.976 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:23.976+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:24.076 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:24.077+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:24.146 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:24.146 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:24.147 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:24.147 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:24.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:24.204 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:24.205+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:24.278 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:24.277+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:24.328 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:24.328 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:24.329 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:24.329 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:24.329 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:24.342 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:24.384 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:24.385+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:24.481 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:24.481+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:24.510 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:43:24.517 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:24.517 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:24.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:24.517 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:24.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.517 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:43:24.517 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:24.517 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 194.21187030999999, 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:43:24.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 161.94976013100001, 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.523 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:43:24.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.528 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:24.529 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:24.529 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 161.94961296, 2024-09-14T08:43:24.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:43:24.529 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.529 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.529 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.529 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.529 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:24.529 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 161.94947116, 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.534 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:43:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.386205393, 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:43:24.539 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.543 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.37791410299999, 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.544 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.377890862, 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:43:24.548 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:43:24.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.377871598, 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:43:24.553 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.557 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.377852322, 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:43:24.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.562 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.37763986900001, 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:43:24.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.370426776, 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:43:24.567 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:24.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:43:24.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.370405564, 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.572 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.37038621400001, 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:43:24.576 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:43:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:43:24.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.370359175, 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.370340025, 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:43:24.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.589 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.37031844099999, 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:43:24.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.37029903200001, 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:43:24.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.37028015600001, 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:43:24.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:43:24.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.36224932, 2024-09-14T08:43:24.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:43:24.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 101.36222292399999, 2024-09-14T08:43:24.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:43:24.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:24.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:24.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:24.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:43:24.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:43:24.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.610 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:24.610 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:24.610 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:24.611 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:24.613 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:24.613+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:24.712 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:24.713+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:24.745 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:24.745 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:24.745 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:24.745 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:24.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:24.813 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:24.813+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:24.883 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:24.883 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:24.897 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:24.913 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:24.913+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:25.014 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:25.013+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:25.017 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:25.017 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:25.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:25.017 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.770420347, 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:43:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:43:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:43:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.770364887, 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:43:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.770305267, 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.770223727, 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.770167399, 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:43:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:43:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.77009590399999, 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:43:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:43:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.770023033, 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:43:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:43:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.76998082099999, 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.769950991, 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.769922694, 2024-09-14T08:43:25.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:43:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.769881599, 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:43:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:43:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.76985256899999, 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.76982408500001, 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:43:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.769795945, 2024-09-14T08:43:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.76976724900001, 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:43:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:43:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.76973849199999, 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.76971044499999, 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 206.76968046799999, 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:43:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5914.0:814 3.f 3:f6536a47:::rbd_data.10f188ed37a0.000000000000005e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 430080~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 51.444061138000002, 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.94391447500000003, 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5914", 2024-09-14T08:43:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3720252961", 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 814 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574373+0000", 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574383+0000", 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0027000000000001e-05 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574405+0000", 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469000000000001e-05 2024-09-14T08:43:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574419+0000", 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543999999999999e-05 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574489+0000", 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0178999999999993e-05 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574497+0000", 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6320000000000008e-06 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508185+0000", 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.93368827499999996 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508493+0000", 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030869300000000002 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508838+0000", 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034456200000000003 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.512327+0000", 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034889330000000001 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518113+0000", 2024-09-14T08:43:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057857730000000001 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518217+0000", 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104319 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518285+0000", 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8139000000000006e-05 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:26441 3.a 3.fa1caca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.501936844999999, 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.86137544499999996, 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 26441 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516497+0000", 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3870000000000002e-06 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516508+0000", 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0740000000000001e-05 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516538+0000", 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9822999999999999e-05 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516552+0000", 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516623+0000", 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0345999999999994e-05 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516629+0000", 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3960000000000003e-06 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:10.377840+0000", 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.861210594 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:10.377870+0000", 2024-09-14T08:43:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0735999999999998e-05 2024-09-14T08:43:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:25.112 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:25.112 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:43:25.113 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:25.115 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:25.116+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:25.216 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:25.220+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:25.238 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:25.239 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:25.239 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:25.239 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:25.253 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:25.268 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:25.268 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:25.284 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-09-14T08:43:25.285 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T08:43:25.303 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:25.325 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:25.325 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:25.340 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:25.344+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:25.344 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:25.344 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:25.363 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:25.417 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:25.417+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:25.420 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:25.420 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:25.434 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:25.518 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:25.517+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:25.598 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:25.598 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:25.613 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:25.656 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:25.660+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:25.720 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:25.720+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:25.741 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:25.742 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:25.756 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:25.852 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:25.856+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:25.922 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:25.924+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:25.929 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:25.929 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:25.943 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:26.028 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:26.032+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:26.106 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:26.107 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:26.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:26.125 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:26.125+0000 7fd02af50640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25236) UID: 0 2024-09-14T08:43:26.226 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:26.225+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:26.251 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:26.251 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:26.266 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:26.352 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:26.353+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:26.426 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:26.427 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:26.427 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:26.425+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:26.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:26.527 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:26.529+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:26.612 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:26.612 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:26.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:43:26.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:26.668 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:26.669+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:26.729 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:26.729+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:26.831 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:26.832+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:26.831 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:26.831 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:26.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T08:43:26.914 INFO:tasks.thrashosds.thrasher:in_osds: [2, 4, 0, 1] out_osds: [5, 3] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 0] 2024-09-14T08:43:26.914 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T08:43:26.915 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [1, 2, 3, 4, 5, 0] 2024-09-14T08:43:26.915 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T08:43:26.915 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:43:26.931 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:26.932+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:27.013 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: exception getting command descriptions: exception: [Errno 104] Connection reset by peer 2024-09-14T08:43:27.016 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T08:43:27.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T08:43:27.032 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:27.036+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:27.120 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-14T08:43:27.123 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T08:43:27.123 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:27.168 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:27.172+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:27.234 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:27.233+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:27.255 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:27.255 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:27.270 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:27.335 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:27.333+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:27.383 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:43:27.436 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:27.440+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:27.437 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:27.438 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:27.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:27.522 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:43:27.537 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:27.537+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:27.545 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:27.545 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:27.628 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:27.628 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:27.638 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:27.637+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:27.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:27.739 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:27.740+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:27.764 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:27.765 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:27.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:27.839 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:27.837+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:27.940 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:27.941+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:27.945 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:27.945 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:27.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:28.040 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:28.044+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:28.080 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:28.080 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:28.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:28.184 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:28.188+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:28.242 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:28.244+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:28.261 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:28.261 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:28.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:28.360 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:28.364+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:28.442 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:28.442 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:28.443 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:28.441+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:28.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:28.548 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:28.552+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:28.624 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:28.625 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:28.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:28.680 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:28.684+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:28.745 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:28.745+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:28.770 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:28.770 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:28.770 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:28.771 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:28.785 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:28.846 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:28.848+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:28.947 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:28.948+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:28.953 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:28.953 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:28.953 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:28.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:29.048 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:29.049+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:29.095 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:29.095 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 74.134926711000006, 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:29.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:43:29.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 74.133729625000001, 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:29.100 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:29.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:43:29.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:43:29.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.104 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 74.133666933000001, 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:43:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:29.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.109 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 74.133629185999993, 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:43:29.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:43:29.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 74.133532122999995, 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:43:29.114 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:43:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 74.133451276000002, 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.119 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:43:29.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 69.741444927000003, 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.124 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:43:29.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.129 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.412694792000003, 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.057207060999999997, 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.130 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681724+0000", 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.804e-06 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681734+0000", 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6490000000000003e-06 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681751+0000", 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7176999999999998e-05 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681760+0000", 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681849+0000", 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8837000000000003e-05 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681981+0000", 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013216700000000001 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.685622+0000", 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003641483 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.690759+0000", 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051364820000000004 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738832+0000", 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.048073087 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738883+0000", 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1428000000000003e-05 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738930+0000", 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6471000000000003e-05 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.135 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.388222910000003, 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032695727000000001, 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for ondisk", 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706196+0000", 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.387e-06 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706206+0000", 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706218+0000", 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2092e-05 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706227+0000", 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6549999999999993e-06 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706292+0000", 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5571e-05 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for ondisk", 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706626+0000", 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033403600000000001 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738890+0000", 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032263888999999997 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.139 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6051 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4012032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319786104000002, 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030933603, 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.140 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6051 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774632+0000", 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774634+0000", 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774640+0000", 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9689999999999999e-06 2024-09-14T08:43:29.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774645+0000", 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7359999999999998e-06 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805487+0000", 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030841179 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805527+0000", 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0442999999999999e-05 2024-09-14T08:43:29.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805565+0000", 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7854e-05 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6052 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3667968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319765332000003, 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031002565999999999, 2024-09-14T08:43:29.144 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6052 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774653+0000", 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.39e-07 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774655+0000", 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1560000000000002e-06 2024-09-14T08:43:29.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774660+0000", 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774665+0000", 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805581+0000", 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030915857000000001 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805617+0000", 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5985999999999997e-05 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805655+0000", 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7771000000000001e-05 2024-09-14T08:43:29.148 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6053 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3790848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319744991999997, 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031072499, 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.149 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6053 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774673+0000", 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774675+0000", 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0729999999999999e-06 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774679+0000", 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1840000000000001e-06 2024-09-14T08:43:29.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774682+0000", 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805671+0000", 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030988430000000001 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805706+0000", 2024-09-14T08:43:29.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5685999999999997e-05 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805745+0000", 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8637000000000003e-05 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6054 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3446784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319731277999999, 2024-09-14T08:43:29.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031147358, 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6054 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:29.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774688+0000", 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.378e-06 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774692+0000", 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0249999999999996e-06 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774695+0000", 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8289999999999999e-06 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805761+0000", 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031066142000000001 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805797+0000", 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5942000000000002e-05 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805834+0000", 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6789999999999998e-05 2024-09-14T08:43:29.157 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6055 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4134912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319719239000001, 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031224526999999998, 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6055 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774699+0000", 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774700+0000", 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2440000000000001e-06 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774704+0000", 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6120000000000001e-06 2024-09-14T08:43:29.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774707+0000", 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8940000000000002e-06 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805849+0000", 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031141629000000001 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805887+0000", 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579000000000001e-05 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805923+0000", 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6207000000000001e-05 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6056 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3569664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:29.162 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319706572000001, 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031298725999999999, 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6056 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.65e-07 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774712+0000", 2024-09-14T08:43:29.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.238e-06 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774716+0000", 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.326e-06 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774719+0000", 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8380000000000002e-06 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805938+0000", 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031219757000000001 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805973+0000", 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4999999999999997e-05 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806010+0000", 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6301999999999999e-05 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.166 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6057 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3913728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319695361000001, 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031394058000000002, 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.167 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6057 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774723+0000", 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.175e-06 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774727+0000", 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8979999999999998e-06 2024-09-14T08:43:29.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774731+0000", 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8870000000000002e-06 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806036+0000", 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031304473999999999 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806076+0000", 2024-09-14T08:43:29.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0037999999999999e-05 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806116+0000", 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0363e-05 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6058 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4036608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:29.171 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319682567000001, 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031564481999999998, 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6058 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3900000000000001e-07 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774736+0000", 2024-09-14T08:43:29.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.204e-06 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774740+0000", 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3589999999999999e-06 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774742+0000", 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806144+0000", 2024-09-14T08:43:29.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031401815999999999 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806220+0000", 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5556999999999995e-05 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806299+0000", 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9534000000000001e-05 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6059 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3692544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319671337000003, 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031762410999999997, 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6059 2024-09-14T08:43:29.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774748+0000", 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2109999999999999e-06 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774751+0000", 2024-09-14T08:43:29.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4060000000000001e-06 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774754+0000", 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806358+0000", 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031604039 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806434+0000", 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6068000000000004e-05 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806509+0000", 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4629000000000007e-05 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6060 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3471360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.180 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319659287999997, 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031873437999999997, 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6060 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774759+0000", 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3200000000000005e-07 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774761+0000", 2024-09-14T08:43:29.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774767+0000", 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4280000000000001e-06 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774773+0000", 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2020000000000001e-06 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806543+0000", 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031769144999999999 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806589+0000", 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6119999999999999e-05 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806632+0000", 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2852000000000002e-05 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6061 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3815424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 50.319637219999997, 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032027014999999999, 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6061 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782424+0000", 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0076440379999999997 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782439+0000", 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4362000000000001e-05 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782448+0000", 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3929999999999997e-06 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782454+0000", 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9900000000000002e-06 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806671+0000", 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024216615 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806739+0000", 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8272e-05 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806807+0000", 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8344999999999997e-05 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:29.189 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:29.189 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:29.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:29.190 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:29.192+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:29.290 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:29.292+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:29.359 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:29.359 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:29.373 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:29.391 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:29.392+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:29.492 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:29.496+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:29.497 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:29.497 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:29.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:29.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T08:43:29.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-14T08:43:29.593 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:29.596+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:29.647 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:29.647 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:29.665 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:29.712 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:29.716+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:29.795 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:29.793+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:29.796 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:29.796 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:29.811 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:29.904 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:29.908+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:29.979 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:29.979 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:29.993 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:29.996 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:29.997+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:30.097 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:30.100+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:30.159 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:30.159 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:30.174 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:30.198 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:30.197+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:30.299 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:30.300+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:30.338 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:30.338 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:30.353 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:30.440 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:30.444+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:30.500 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:30.500+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:30.519 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:30.519 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:30.533 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-09-14T08:43:30.535 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:30.607 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:30.609+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:30.702 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:30.701+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:30.702 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:30.703 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:30.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:30.803 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:30.804+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:30.844 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:30.844 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:30.860 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:30.904 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:30.908+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:31.005 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:31.008+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:31.027 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:31.027 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:31.041 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:31.132 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:31.136+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:31.207 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:31.205+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:31.210 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:31.210 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:31.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:31.307 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:31.309+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:31.358 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:31.358 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:31.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:31.416 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:31.417+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:31.510 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:31.509+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:31.538 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:31.538 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:31.538 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:31.538 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:31.538 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:31.558 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:31.644 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:31.645+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:31.711 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:31.713+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:31.732 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:31.732 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:31.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:31.732 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:31.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.732 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:31.732 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:31.732 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 76.771254158999994, 2024-09-14T08:43:31.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:31.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:43:31.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:31.737 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 76.770057073000004, 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:31.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:43:31.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 76.769994381000004, 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:43:31.742 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:43:31.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 76.769956633999996, 2024-09-14T08:43:31.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:43:31.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 76.769859570999998, 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:43:31.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 76.769778724000005, 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:43:31.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.762 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 72.377772375000006, 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:31.763 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:43:31.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:43:31.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.049022239999999, 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.057207060999999997, 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.769 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681724+0000", 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.804e-06 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681734+0000", 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6490000000000003e-06 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681751+0000", 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7176999999999998e-05 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681760+0000", 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681849+0000", 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8837000000000003e-05 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681981+0000", 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013216700000000001 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.685622+0000", 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003641483 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.690759+0000", 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051364820000000004 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738832+0000", 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.048073087 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738883+0000", 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1428000000000003e-05 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738930+0000", 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6471000000000003e-05 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.024550357999999, 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032695727000000001, 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for ondisk", 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706196+0000", 2024-09-14T08:43:31.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.387e-06 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706206+0000", 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706218+0000", 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2092e-05 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706227+0000", 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6549999999999993e-06 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706292+0000", 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5571e-05 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for ondisk", 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706626+0000", 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033403600000000001 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738890+0000", 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032263888999999997 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6051 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4012032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.956113551999998, 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030933603, 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.779 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6051 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774632+0000", 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774634+0000", 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774640+0000", 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9689999999999999e-06 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774645+0000", 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7359999999999998e-06 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805487+0000", 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030841179 2024-09-14T08:43:31.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805527+0000", 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0442999999999999e-05 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805565+0000", 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7854e-05 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6052 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3667968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.956092779999999, 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031002565999999999, 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6052 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774653+0000", 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.39e-07 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774655+0000", 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1560000000000002e-06 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774660+0000", 2024-09-14T08:43:31.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774665+0000", 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805581+0000", 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030915857000000001 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805617+0000", 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5985999999999997e-05 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805655+0000", 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7771000000000001e-05 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6053 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3790848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:31.788 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.95607244, 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031072499, 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6053 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774673+0000", 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774675+0000", 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0729999999999999e-06 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774679+0000", 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1840000000000001e-06 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774682+0000", 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805671+0000", 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030988430000000001 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805706+0000", 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5685999999999997e-05 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805745+0000", 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8637000000000003e-05 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.792 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6054 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3446784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.956058726000002, 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031147358, 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.794 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6054 2024-09-14T08:43:31.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.794 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:31.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774688+0000", 2024-09-14T08:43:31.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.378e-06 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774692+0000", 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0249999999999996e-06 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774695+0000", 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8289999999999999e-06 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805761+0000", 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031066142000000001 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805797+0000", 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5942000000000002e-05 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805834+0000", 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6789999999999998e-05 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.798 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6055 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4134912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.956046686999997, 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031224526999999998, 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6055 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.799 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774699+0000", 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774700+0000", 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2440000000000001e-06 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774704+0000", 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6120000000000001e-06 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774707+0000", 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8940000000000002e-06 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805849+0000", 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031141629000000001 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805887+0000", 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579000000000001e-05 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805923+0000", 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6207000000000001e-05 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6056 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3569664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.956034019999997, 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031298725999999999, 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.803 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6056 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:31.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.65e-07 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774712+0000", 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.238e-06 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774716+0000", 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.326e-06 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774719+0000", 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8380000000000002e-06 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805938+0000", 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031219757000000001 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805973+0000", 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4999999999999997e-05 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806010+0000", 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6301999999999999e-05 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6057 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3913728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.956022808999997, 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031394058000000002, 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6057 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.808 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774723+0000", 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.175e-06 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774727+0000", 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8979999999999998e-06 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774731+0000", 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8870000000000002e-06 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806036+0000", 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031304473999999999 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806076+0000", 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0037999999999999e-05 2024-09-14T08:43:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806116+0000", 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0363e-05 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6058 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4036608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.956010014999997, 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031564481999999998, 2024-09-14T08:43:31.812 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6058 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3900000000000001e-07 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774736+0000", 2024-09-14T08:43:31.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.204e-06 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774740+0000", 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3589999999999999e-06 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774742+0000", 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806144+0000", 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031401815999999999 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806220+0000", 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5556999999999995e-05 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806299+0000", 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9534000000000001e-05 2024-09-14T08:43:31.816 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6059 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3692544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.955998784999998, 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031762410999999997, 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.817 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6059 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774748+0000", 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2109999999999999e-06 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774751+0000", 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4060000000000001e-06 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774754+0000", 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806358+0000", 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031604039 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806434+0000", 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6068000000000004e-05 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806509+0000", 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4629000000000007e-05 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.821 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6060 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3471360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.955986736, 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031873437999999997, 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.822 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6060 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774759+0000", 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3200000000000005e-07 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774761+0000", 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774767+0000", 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4280000000000001e-06 2024-09-14T08:43:31.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774773+0000", 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2020000000000001e-06 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806543+0000", 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031769144999999999 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806589+0000", 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6119999999999999e-05 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806632+0000", 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2852000000000002e-05 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6061 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3815424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:31.826 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.955964668, 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032027014999999999, 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6061 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:31.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782424+0000", 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0076440379999999997 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782439+0000", 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4362000000000001e-05 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782448+0000", 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3929999999999997e-06 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782454+0000", 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9900000000000002e-06 2024-09-14T08:43:31.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806671+0000", 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024216615 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806739+0000", 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8272e-05 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806807+0000", 2024-09-14T08:43:31.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8344999999999997e-05 2024-09-14T08:43:31.831 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.831 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.831 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.831 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:31.831 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:31.831 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:31.832 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:31.833+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:31.833 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:31.933 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:31.933+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:32.007 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:32.007 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:32.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:32.034 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:32.036+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:32.135 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:32.136+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:32.179 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:32.180 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:32.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:32.235 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:32.236+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:32.310 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:32.310 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:32.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:32.372 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:32.376+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:32.437 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:32.437+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:32.459 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:32.459 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:32.473 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:32.521 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-14T08:43:32.551 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:32.551 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:32.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T08:43:32.560 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:32.564+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:32.579 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:32.580 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:32.612 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:32.612 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:32.633 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:32.633 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:32.638 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:43:32.638 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:43:32.638 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:32.640+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:32.646 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:32.647 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:32.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:32.748 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:32.752+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:32.834 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:32.834 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:32.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:32.834 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:32.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58707582900001, 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.835 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58702036899999, 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.839 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:32.843 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58696074900001, 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:43:32.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58687920899999, 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.848 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.852 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58682288099999, 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:32.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:43:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.586751386, 2024-09-14T08:43:32.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:32.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:43:32.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:43:32.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58667851499999, 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:43:32.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58663630300001, 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:32.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:43:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58660647299999, 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.871 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:43:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58657817599999, 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:32.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:43:32.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:43:32.879 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58653708099999, 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:43:32.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58650805100001, 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:43:32.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.586479567, 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:32.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:43:32.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58645142699999, 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:43:32.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:43:32.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.586422731, 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.898 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:43:32.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.586393974, 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:43:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.586365927, 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.907 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:43:32.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 214.58633595000001, 2024-09-14T08:43:32.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:43:32.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.915 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5914.0:814 3.f 3:f6536a47:::rbd_data.10f188ed37a0.000000000000005e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 430080~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.260716619999997, 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.94391447500000003, 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5914", 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3720252961", 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 814 2024-09-14T08:43:32.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574373+0000", 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574383+0000", 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0027000000000001e-05 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574405+0000", 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469000000000001e-05 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574419+0000", 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543999999999999e-05 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574489+0000", 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0178999999999993e-05 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574497+0000", 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6320000000000008e-06 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508185+0000", 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.93368827499999996 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508493+0000", 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030869300000000002 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508838+0000", 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034456200000000003 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:32.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.512327+0000", 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034889330000000001 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518113+0000", 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057857730000000001 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518217+0000", 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104319 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518285+0000", 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8139000000000006e-05 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:26441 3.a 3.fa1caca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.318592327000001, 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.86137544499999996, 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:32.922 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 26441 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:32.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516497+0000", 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3870000000000002e-06 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516508+0000", 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0740000000000001e-05 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516538+0000", 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9822999999999999e-05 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516552+0000", 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516623+0000", 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0345999999999994e-05 2024-09-14T08:43:32.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516629+0000", 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3960000000000003e-06 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:10.377840+0000", 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.861210594 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:10.377870+0000", 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0735999999999998e-05 2024-09-14T08:43:32.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:32.927 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:32.927 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:32.928 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:32.929 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:32.932+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:33.016 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T08:43:33.016 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.1 2024-09-14T08:43:33.016 INFO:tasks.thrashosds.thrasher:remote for osd 1 is ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:43:33.016 DEBUG:teuthology.orchestra.run.smithi089:> type ceph-objectstore-tool 2024-09-14T08:43:33.022 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T08:43:33.022 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op list-pgs 2024-09-14T08:43:33.029 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:33.032+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:33.099 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:33.099 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:33.099 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:33.099 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:33.113 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:33.156 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:33.160+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:33.231 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:33.233+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:33.281 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:33.281 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:33.281 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:33.281 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:33.281 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:33.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:33.331 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:33.333+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:33.364 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-09-14T08:43:33.418 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:43:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 197.68555892099999, 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:43:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.14980509599999, 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:43:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:43:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.115140212, 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:43:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:43:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 142.114939241, 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:43:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:43:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.214263852, 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:43:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.214229637, 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.21418814800001, 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:43:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:43:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.21412966600001, 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:43:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:43:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.214099987, 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.21407077800001, 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:43:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:43:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.206464483, 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:43:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:43:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.206436493, 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.206408161, 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.206366402, 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:43:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.206337523, 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:43:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:43:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:43:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.206303714, 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:43:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.206271355, 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:43:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:43:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:43:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.198143552, 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:43:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:43:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:43:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:43:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:43:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:43:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.198112567, 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:43:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:43:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 124.198083661, 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:33.512 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:33.514 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:33.514 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:33.516+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:33.615 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:33.613+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:33.688 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:33.688 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:33.702 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:33.748 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:33.751+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:33.817 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:33.819+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:33.824 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:33.824 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:33.824 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:33.824 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:33.824 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:33.835 INFO:teuthology.orchestra.run.smithi089.stdout:3.f 2024-09-14T08:43:33.835 INFO:teuthology.orchestra.run.smithi089.stdout:3.e 2024-09-14T08:43:33.835 INFO:teuthology.orchestra.run.smithi089.stdout:3.7 2024-09-14T08:43:33.835 INFO:teuthology.orchestra.run.smithi089.stdout:3.6 2024-09-14T08:43:33.835 INFO:teuthology.orchestra.run.smithi089.stdout:3.5 2024-09-14T08:43:33.835 INFO:teuthology.orchestra.run.smithi089.stdout:3.4 2024-09-14T08:43:33.835 INFO:teuthology.orchestra.run.smithi089.stdout:3.c 2024-09-14T08:43:33.835 INFO:teuthology.orchestra.run.smithi089.stdout:3.2 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:3.1d 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:1.0 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:2.4 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:2.2 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:3.b 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:3.1c 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:2.1 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:3.0 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:3.1e 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:3.19 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:2.3 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:3.a 2024-09-14T08:43:33.836 INFO:teuthology.orchestra.run.smithi089.stdout:2.0 2024-09-14T08:43:33.837 INFO:teuthology.orchestra.run.smithi089.stdout:2.6 2024-09-14T08:43:33.837 INFO:teuthology.orchestra.run.smithi089.stdout:3.12 2024-09-14T08:43:33.837 INFO:teuthology.orchestra.run.smithi089.stdout:3.10 2024-09-14T08:43:33.837 INFO:teuthology.orchestra.run.smithi089.stdout:3.8 2024-09-14T08:43:33.837 INFO:teuthology.orchestra.run.smithi089.stdout:3.16 2024-09-14T08:43:33.837 INFO:teuthology.orchestra.run.smithi089.stdout:3.1a 2024-09-14T08:43:33.838 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:33.917 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:33.917+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:34.005 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 212.92916179400001, 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 212.92910459000001, 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:43:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:43:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 212.92904570600001, 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:43:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:43:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 212.92898077999999, 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:43:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:43:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 212.928919329, 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:43:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:43:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:43:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 212.92885979499999, 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 212.92880048500001, 2024-09-14T08:43:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 212.92872845299999, 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:43:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:43:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 188.77402807600001, 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:43:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:43:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 188.773996651, 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:43:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:43:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:43:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 144.41013303099999, 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:43:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 144.410073681, 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:43:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 144.41003372899999, 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:43:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:43:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:43:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.926610776, 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:43:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:43:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:43:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:43:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:43:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:43:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 120.92021821, 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:43:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:43:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.16062879, 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 112.119889388, 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:43:34.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:43:34.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:34.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:34.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.85231830399999, 2024-09-14T08:43:34.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.096 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.78851441, 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.097 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:43:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:43:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:43:34.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:43:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:43:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 111.76104271200001, 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:34.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:43:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:43:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:43:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:43:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:34.110 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:34.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:34.111 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:34.111+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:34.125 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op export --pgid 3.0 --file /var/log/ceph/exp.3.0.1 2024-09-14T08:43:34.211 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:34.211+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:34.239 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:34.239 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:34.239 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:34.239 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:34.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:34.312 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:34.313+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:34.374 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:34.374 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:34.374 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:34.375 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:34.375 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:34.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:34.413 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:34.415+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:34.513 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:34.513+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:34.560 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4337.0:20429 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:34.560 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 79.601714169999994, 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0040279480000001, 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4337", 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20429 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959491+0000", 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959492+0000", 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.751e-06 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959500+0000", 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4329999999999998e-06 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959513+0000", 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3078000000000001e-05 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.959531+0000", 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7708999999999999e-05 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971116+0000", 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01158553 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971126+0000", 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6560000000000004e-06 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963508+0000", 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99238175100000003 2024-09-14T08:43:34.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963519+0000", 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1039999999999999e-05 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3130 3.15 3.b982a575 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 79.600517084000003, 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0028633730000001, 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.565 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3130 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960688+0000", 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960689+0000", 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.347e-06 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960697+0000", 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5429999999999996e-06 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960714+0000", 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7691000000000001e-05 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960725+0000", 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1001e-05 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971164+0000", 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010438782000000001 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971172+0000", 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3719999999999999e-06 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963543+0000", 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237166200000004 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963551+0000", 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.569 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3131 3.6 3.f58652c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 79.600454392000003, 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.002157508, 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3131 2024-09-14T08:43:34.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960751+0000", 2024-09-14T08:43:34.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960755+0000", 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4910000000000001e-06 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960763+0000", 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3389999999999993e-06 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960770+0000", 2024-09-14T08:43:34.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6669999999999999e-06 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968638+0000", 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078681419999999998 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.968647+0000", 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9800000000000004e-06 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962895+0000", 2024-09-14T08:43:34.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99424837700000002 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.962908+0000", 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2926e-05 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3132 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 79.600416644999996, 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027908379999999, 2024-09-14T08:43:34.574 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3132 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960788+0000", 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960789+0000", 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2499999999999995e-07 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960792+0000", 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.252e-06 2024-09-14T08:43:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960799+0000", 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.092e-06 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960804+0000", 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.011e-06 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971194+0000", 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01039021 2024-09-14T08:43:34.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971200+0000", 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6180000000000003e-06 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963572+0000", 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99237209900000001 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963579+0000", 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-14T08:43:34.578 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3134 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 79.600319581999997, 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0027209290000001, 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3134 2024-09-14T08:43:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960885+0000", 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960886+0000", 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960890+0000", 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.856e-06 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960904+0000", 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4630000000000001e-05 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960911+0000", 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8109999999999997e-06 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971354+0000", 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010443031 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971363+0000", 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5639999999999997e-06 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963599+0000", 2024-09-14T08:43:34.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223657200000004 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963606+0000", 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9110000000000004e-06 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:3135 3.15 3.b982a575 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 79.600238735000005, 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0026687569999999, 2024-09-14T08:43:34.583 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3135 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960966+0000", 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960967+0000", 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4799999999999998e-07 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960970+0000", 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5219999999999999e-06 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960981+0000", 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0393e-05 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.960987+0000", 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.947e-06 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971392+0000", 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010405162000000001 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:14.971396+0000", 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.442e-06 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963628+0000", 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99223179399999994 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:15.963635+0000", 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9489999999999999e-06 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.587 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6069.0:5861 3.c 3:35b9038d:::rbd_data.10f18f8e41e.0000000000000000:head [read 1048576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e141)", 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.208232386000006, 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.023870931, 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6069", 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1880336350", 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 5861 2024-09-14T08:43:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352973+0000", 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352975+0000", 2024-09-14T08:43:34.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8320000000000002e-06 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.352987+0000", 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559000000000001e-05 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353017+0000", 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9887999999999999e-05 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353044+0000", 2024-09-14T08:43:34.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7066000000000001e-05 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353209+0000", 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016518199999999999 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op must wait for map", 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.353228+0000", 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8468e-05 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359503+0000", 2024-09-14T08:43:34.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006275887 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:19.359523+0000", 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0001999999999999e-05 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376285+0000", 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.016761182 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376585+0000", 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000300239 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:20.376843+0000", 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025862599999999997 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.879482250999999, 2024-09-14T08:43:34.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.057207060999999997, 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681723+0000", 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681724+0000", 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.804e-06 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681734+0000", 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6490000000000003e-06 2024-09-14T08:43:34.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681751+0000", 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7176999999999998e-05 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681760+0000", 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4759999999999998e-06 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681849+0000", 2024-09-14T08:43:34.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8837000000000003e-05 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.681981+0000", 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013216700000000001 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.685622+0000", 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003641483 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:34.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.690759+0000", 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051364820000000004 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738832+0000", 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.048073087 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738883+0000", 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1428000000000003e-05 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738930+0000", 2024-09-14T08:43:34.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6471000000000003e-05 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:3492 3.6 3:60f35f84:::rbd_object_map.10f16ef41219:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.855010368999999, 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032695727000000001, 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for ondisk", 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.599 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 3492 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706195+0000", 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706196+0000", 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.387e-06 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706206+0000", 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0097e-05 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706218+0000", 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2092e-05 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706227+0000", 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6549999999999993e-06 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706292+0000", 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5571e-05 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for ondisk", 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.706626+0000", 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033403600000000001 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.738890+0000", 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032263888999999997 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6051 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4012032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786573562999997, 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030933603, 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.603 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6051 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774631+0000", 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774632+0000", 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4900000000000001e-07 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774634+0000", 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.973e-06 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774640+0000", 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9689999999999999e-06 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774645+0000", 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7359999999999998e-06 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805487+0000", 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030841179 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805527+0000", 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0442999999999999e-05 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805565+0000", 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7854e-05 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.607 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6052 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3667968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786552790999998, 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031002565999999999, 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6052 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774652+0000", 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774653+0000", 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.39e-07 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774655+0000", 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1560000000000002e-06 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774660+0000", 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774665+0000", 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805581+0000", 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030915857000000001 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805617+0000", 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5985999999999997e-05 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805655+0000", 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7771000000000001e-05 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.611 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6053 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3790848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786532450999999, 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031072499, 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6053 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.612 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774672+0000", 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774673+0000", 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5499999999999998e-07 2024-09-14T08:43:34.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774675+0000", 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0729999999999999e-06 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774679+0000", 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1840000000000001e-06 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774682+0000", 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0340000000000001e-06 2024-09-14T08:43:34.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805671+0000", 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.030988430000000001 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805706+0000", 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5685999999999997e-05 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805745+0000", 2024-09-14T08:43:34.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8637000000000003e-05 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6054 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3446784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786518737000002, 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031147358, 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.616 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6054 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774686+0000", 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5199999999999998e-07 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774688+0000", 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.378e-06 2024-09-14T08:43:34.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774692+0000", 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0249999999999996e-06 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774695+0000", 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8289999999999999e-06 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805761+0000", 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031066142000000001 2024-09-14T08:43:34.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805797+0000", 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5942000000000002e-05 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805834+0000", 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6789999999999998e-05 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.620 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6055 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4134912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786506697999997, 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031224526999999998, 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6055 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774698+0000", 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774699+0000", 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6199999999999999e-07 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774700+0000", 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2440000000000001e-06 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774704+0000", 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6120000000000001e-06 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774707+0000", 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8940000000000002e-06 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805849+0000", 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031141629000000001 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805887+0000", 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7579000000000001e-05 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805923+0000", 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6207000000000001e-05 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.624 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6056 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3569664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786494030999997, 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031298725999999999, 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.625 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6056 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774711+0000", 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.65e-07 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774712+0000", 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.238e-06 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774716+0000", 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.326e-06 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774719+0000", 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8380000000000002e-06 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805938+0000", 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031219757000000001 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.805973+0000", 2024-09-14T08:43:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4999999999999997e-05 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806010+0000", 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6301999999999999e-05 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6057 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3913728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786482820000003, 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031394058000000002, 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6057 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774722+0000", 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.23e-07 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774723+0000", 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.175e-06 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774727+0000", 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8979999999999998e-06 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774731+0000", 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8870000000000002e-06 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806036+0000", 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031304473999999999 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806076+0000", 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0037999999999999e-05 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806116+0000", 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0363e-05 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6058 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 4036608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786470026000003, 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031564481999999998, 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.634 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6058 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774735+0000", 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3900000000000001e-07 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774736+0000", 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.204e-06 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774740+0000", 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3589999999999999e-06 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774742+0000", 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.773e-06 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806144+0000", 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031401815999999999 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806220+0000", 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5556999999999995e-05 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806299+0000", 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9534000000000001e-05 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6059 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3692544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786458795999998, 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031762410999999997, 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6059 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774746+0000", 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.34e-07 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774748+0000", 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2109999999999999e-06 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774751+0000", 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4060000000000001e-06 2024-09-14T08:43:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774754+0000", 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.824e-06 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806358+0000", 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031604039 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806434+0000", 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6068000000000004e-05 2024-09-14T08:43:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806509+0000", 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4629000000000007e-05 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6060 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3471360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786446746999999, 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031873437999999997, 2024-09-14T08:43:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6060 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774758+0000", 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774759+0000", 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3200000000000005e-07 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774761+0000", 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774767+0000", 2024-09-14T08:43:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4280000000000001e-06 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774773+0000", 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2020000000000001e-06 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806543+0000", 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.031769144999999999 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806589+0000", 2024-09-14T08:43:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6119999999999999e-05 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806632+0000", 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2852000000000002e-05 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.6324.0:6061 3.6 3:62c6ff9e:::rbd_data.10f18f8e41e.0000000000000001:22 [read 3815424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e156)", 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 55.786424679, 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.032027014999999999, 2024-09-14T08:43:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.6324", 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3412266134", 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 6061 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.774780+0000", 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782424+0000", 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0076440379999999997 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782439+0000", 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4362000000000001e-05 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782448+0000", 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3929999999999997e-06 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.782454+0000", 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9900000000000002e-06 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806671+0000", 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.024216615 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806739+0000", 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8272e-05 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:42:38.806807+0000", 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8344999999999997e-05 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:34.650 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:34.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:43:34.652 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:34.653+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:34.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:34.753 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:34.755+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:34.821 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:34.822 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:34.822 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:34.822 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:34.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:34.840 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:34.840 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:34.840 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-14T08:43:34.853 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:34.855+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:34.872 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:34.873 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:34.894 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:34.929 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:34.929 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:34.955 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:34.955+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:34.957 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:34.957 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:34.965 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:34.965 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:34.969 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:43:34.969 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:43:34.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:34.975 INFO:teuthology.orchestra.run.smithi089.stderr:Exporting 3.0 info 3.0( v 204'453 (0'0,204'453] local-lis/les=181/182 n=22 ec=21/21 lis/c=181/181 les/c/f=182/182/0 sis=181) 2024-09-14T08:43:34.979 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:00aa9f52:::rbd_data.10f15daa646d.000000000000016b:head# 2024-09-14T08:43:34.979 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:00c65a94:::rbd_data.10f15daa646d.000000000000019d:head# 2024-09-14T08:43:34.979 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:00fc172f:::rbd_data.10f14aaf0423.00000000000001dd:head# 2024-09-14T08:43:34.979 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:020a2bf0:::rbd_data.10f1c460e0d1.000000000000001e:6# 2024-09-14T08:43:34.980 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:020a2bf0:::rbd_data.10f1c460e0d1.000000000000001e:head# 2024-09-14T08:43:34.980 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0254f8de:::rbd_data.10f15daa646d.00000000000001df:head# 2024-09-14T08:43:34.980 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:028a9a12:::rbd_data.10f18b35ff50.0000000000000039:head# 2024-09-14T08:43:34.980 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0332c4ff:::rbd_data.10f1ff52bd5e.0000000000000001:head# 2024-09-14T08:43:34.980 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0339726e:::rbd_data.10f1c460e0d1.00000000000001c7:6# 2024-09-14T08:43:34.981 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0339726e:::rbd_data.10f1c460e0d1.00000000000001c7:head# 2024-09-14T08:43:34.981 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:03995c04:::rbd_id.image_client.0-clone9:head# 2024-09-14T08:43:34.981 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:04479396:::rbd_id.image_client.0-clone2:head# 2024-09-14T08:43:34.982 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:05e88aa0:::rbd_data.10f1c460e0d1.000000000000001a:head# 2024-09-14T08:43:34.982 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:05ec6510:::rbd_data.10f15daa646d.0000000000000198:head# 2024-09-14T08:43:34.982 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:head# 2024-09-14T08:43:34.986 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:06d84648:::rbd_data.10f1c460e0d1.0000000000000035:head# 2024-09-14T08:43:34.986 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:06e0cd4b:::rbd_data.10f1663ce16c.0000000000000040:a# 2024-09-14T08:43:34.988 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:06e0cd4b:::rbd_data.10f1663ce16c.0000000000000040:head# 2024-09-14T08:43:34.988 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:070f34ec:::rbd_data.10f1e730a19e.000000000000007a:head# 2024-09-14T08:43:34.988 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:07bfe3f8:::rbd_data.10f15daa646d.0000000000000193:head# 2024-09-14T08:43:34.988 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:07e43839:::rbd_data.10f1c460e0d1.0000000000000013:6# 2024-09-14T08:43:34.988 INFO:teuthology.orchestra.run.smithi089.stderr:Read #3:07e43839:::rbd_data.10f1c460e0d1.0000000000000013:head# 2024-09-14T08:43:34.988 INFO:teuthology.orchestra.run.smithi089.stderr:Export successful 2024-09-14T08:43:35.056 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:35.059+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:35.085 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:35.085 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:35.097 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:35.156 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:35.159+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:35.228 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:35.228 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:35.243 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:35.276 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --force --op remove --pgid 3.0 2024-09-14T08:43:35.288 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:35.291+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:35.358 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:35.357+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:35.394 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:43:35.409 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:35.410 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:35.424 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:35.468 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:35.471+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:35.541 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:35.541 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:35.556 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:35.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-14T08:43:35.604 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:35.607+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:35.660 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:35.661+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:35.732 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:35.732 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:35.746 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:35.761 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:35.761+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:35.862 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:35.863+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:35.870 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:35.870 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:35.884 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:35.972 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:35.975+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:36.050 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:36.050 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:36.063 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:36.063+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:36.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:36.164 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:36.165+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:36.229 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:36.230 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:36.244 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:36.288 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:36.291+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:36.360 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:36.360 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:36.364 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:36.367+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:36.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:36.465 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:36.465+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:36.541 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:36.542 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:36.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:36.565 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:36.567+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:36.566 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:43:36.666 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:36.667+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:36.706 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:36.706 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:36.722 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:36.767 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:36.767+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:36.842 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:36.842 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:36.856 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:36.899 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:36.900+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:36.969 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:36.971+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:36.969 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T08:43:36.972 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:36.972 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:36.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:37.070 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:37.071+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:37.117 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:37.117 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:37.117 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-14T08:43:37.134 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:37.134 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:37.154 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:37.154 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:37.154 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:37.154 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:37.154 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:37.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:37.171 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:37.171+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:37.175 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:37.176 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:37.197 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:37.197 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:37.200 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:43:37.201 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:43:37.271 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:37.271+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:37.280 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:37.281 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:37.281 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-14T08:43:37.281 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-14T08:43:37.281 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:37.294 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:37.372 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:37.372+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4619.0:18119 3.7 3:e13eb629:::rbd_data.10f15d5c7697.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,truncate 27331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 207.11675983000001, 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.17943689500000001, 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.423 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4619", 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18119 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305557+0000", 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.305560+0000", 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.627e-06 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349367+0000", 2024-09-14T08:43:37.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.043806853 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349419+0000", 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2661000000000003e-05 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349439+0000", 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9448000000000001e-05 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349627+0000", 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000187992 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.349886+0000", 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000259609 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.353836+0000", 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039498490000000001 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.445758+0000", 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091921356999999995 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484824+0000", 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.039066515000000003 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484923+0000", 2024-09-14T08:43:37.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.857e-05 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:10.484994+0000", 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1414000000000004e-05 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:166 3.d 3:b109d608:::rbd_data.10f1d2e99d18.0000000000000000:10 [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 174.85464965099999, 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86937080300000003, 2024-09-14T08:43:37.429 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 166 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567667+0000", 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567670+0000", 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6189999999999998e-06 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567683+0000", 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.27e-05 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567742+0000", 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9138000000000002e-05 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567768+0000", 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5859000000000001e-05 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568024+0000", 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025653600000000003 2024-09-14T08:43:37.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568055+0000", 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0258999999999999e-05 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436710+0000", 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86865508800000002 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.436878+0000", 2024-09-14T08:43:37.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016861299999999999 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437038+0000", 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015999100000000001 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:167 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 174.85450248000001, 2024-09-14T08:43:37.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86978537899999997, 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 167 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567815+0000", 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567816+0000", 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.483e-06 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567823+0000", 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-14T08:43:37.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567846+0000", 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3609e-05 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567861+0000", 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.52e-05 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568154+0000", 2024-09-14T08:43:37.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000292541 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568181+0000", 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7216000000000002e-05 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437412+0000", 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86923081300000005 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437520+0000", 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108336 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437600+0000", 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9691999999999995e-05 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5005.0:168 3.d 3:b6d20de0:::rbd_data.10f1d2e99d18.0000000000000001:10 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-14T08:43:37.439 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 174.85436068000001, 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86983429899999998, 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5005", 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/3419767160", 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 168 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567956+0000", 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567958+0000", 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.03e-06 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.567970+0000", 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1202999999999999e-05 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568001+0000", 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1674999999999997e-05 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568023+0000", 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1423000000000001e-05 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568606+0000", 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058283 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:42.568629+0000", 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3319000000000002e-05 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437634+0000", 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.86900470399999996 2024-09-14T08:43:37.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437706+0000", 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2340000000000002e-05 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:40:43.437791+0000", 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4775000000000001e-05 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.444 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16588 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3248128~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.29109491299999, 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096947929000000002, 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16588 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.131222+0000", 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138750+0000", 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075276190000000002 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138757+0000", 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3039999999999999e-06 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138782+0000", 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5412e-05 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.138792+0000", 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1050000000000001e-06 2024-09-14T08:43:37.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227665+0000", 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.088873116000000002 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.227939+0000", 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274572 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.228170+0000", 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023080099999999999 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16607 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3598336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.28280362300001, 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097006279000000001, 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.449 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16607 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139513+0000", 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139514+0000", 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1600000000000001e-07 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139517+0000", 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7520000000000001e-06 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139524+0000", 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139529+0000", 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4269999999999999e-06 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236223+0000", 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096694112999999998 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236369+0000", 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236520+0000", 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015030499999999999 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.453 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16608 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3616768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.282780382, 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097602412, 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16608 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139537+0000", 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0600000000000001e-07 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139539+0000", 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2079999999999999e-06 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139545+0000", 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5879999999999997e-06 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139550+0000", 2024-09-14T08:43:37.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9960000000000001e-06 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236649+0000", 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097098851 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.236908+0000", 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025918099999999998 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237139+0000", 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231182 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16609 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3635200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.282761118, 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097979256000000001, 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.458 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16609 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139556+0000", 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1399999999999997e-07 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139558+0000", 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1059999999999998e-06 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139564+0000", 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5720000000000002e-06 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139569+0000", 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1760000000000001e-06 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237223+0000", 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097653881999999997 2024-09-14T08:43:37.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237369+0000", 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145668 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237535+0000", 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016643800000000001 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16610 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3653632~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.28274184199999, 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098465977999999996, 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16610 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139575+0000", 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139720+0000", 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014444600000000001 2024-09-14T08:43:37.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139726+0000", 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7020000000000004e-06 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139740+0000", 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3807e-05 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139768+0000", 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7773999999999999e-05 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237626+0000", 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097857945000000002 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.237820+0000", 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019413300000000001 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238041+0000", 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022117099999999999 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16611 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3672064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.282529389, 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098664768999999999, 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.467 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16611 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.139788+0000", 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146445+0000", 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066569209999999997 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146454+0000", 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0860000000000008e-06 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146473+0000", 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8960000000000001e-05 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.146484+0000", 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1436e-05 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238127+0000", 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.091642891000000004 2024-09-14T08:43:37.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238272+0000", 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000145375 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.238452+0000", 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018009999999999999 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.471 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16623 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3893248~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.275316296, 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097003467999999995, 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16623 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147001+0000", 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5600000000000001e-07 2024-09-14T08:43:37.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147003+0000", 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147009+0000", 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5119999999999999e-06 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147015+0000", 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4420000000000003e-06 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243675+0000", 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096659607999999994 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.243828+0000", 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152731 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244004+0000", 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017671700000000001 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16624 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3911680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.27529508400001, 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097461708999999994, 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.476 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16624 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147022+0000", 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147023+0000", 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000004e-07 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147025+0000", 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0020000000000001e-06 2024-09-14T08:43:37.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147030+0000", 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6319999999999996e-06 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147035+0000", 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244093+0000", 2024-09-14T08:43:37.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097058154999999993 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244276+0000", 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018297300000000001 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244484+0000", 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16625 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3930112~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.275275734, 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097839582999999994, 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16625 2024-09-14T08:43:37.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147041+0000", 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147042+0000", 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147050+0000", 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.738e-06 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147057+0000", 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2389999999999999e-06 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147062+0000", 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244565+0000", 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097502986 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244711+0000", 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014604799999999999 2024-09-14T08:43:37.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244881+0000", 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017023400000000001 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16626 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3948544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.275248695, 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098311212999999995, 2024-09-14T08:43:37.485 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16626 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147068+0000", 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147069+0000", 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5400000000000002e-07 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147071+0000", 2024-09-14T08:43:37.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1299999999999999e-06 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147077+0000", 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.626e-06 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147081+0000", 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6920000000000001e-06 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.244969+0000", 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.09788732 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245172+0000", 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000203334 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245380+0000", 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020765700000000001 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16627 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3966976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.275229545, 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098697001000000006, 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.490 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16627 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147088+0000", 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2599999999999998e-07 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147090+0000", 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147098+0000", 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.926e-06 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147103+0000", 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.848e-06 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245462+0000", 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098358446000000002 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245615+0000", 2024-09-14T08:43:37.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000153707 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245785+0000", 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016925800000000001 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16628 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 3985408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.27520796100001, 2024-09-14T08:43:37.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099156073999999997, 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16628 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147109+0000", 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147110+0000", 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.32e-07 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147112+0000", 2024-09-14T08:43:37.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2120000000000002e-06 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147118+0000", 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8019999999999997e-06 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147123+0000", 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0000000000000004e-06 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.245874+0000", 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.098751324000000001 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246058+0000", 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018387699999999999 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246265+0000", 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020742699999999999 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.498 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16629 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4003840~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.275188552, 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099550145000000007, 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.499 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16629 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147128+0000", 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147129+0000", 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5200000000000002e-07 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147131+0000", 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8139999999999999e-06 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147136+0000", 2024-09-14T08:43:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6160000000000001e-06 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147141+0000", 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7339999999999999e-06 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246368+0000", 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.099226868999999995 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246513+0000", 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144845 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246679+0000", 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016581500000000001 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16630 3.a 3:543fb163:::rbd_data.10f1d326df17.0000000000000002:1c [read 4022272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.503 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.275169676, 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.100014716, 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16630 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.147147+0000", 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154658+0000", 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0075102779999999996 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154666+0000", 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3599999999999996e-06 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154687+0000", 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.084e-05 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.154697+0000", 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6670000000000008e-06 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246767+0000", 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.092070453999999996 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.246957+0000", 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018967499999999999 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.247162+0000", 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020544199999999999 2024-09-14T08:43:37.507 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16650 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.26713884, 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097060454000000004, 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16650 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155178+0000", 2024-09-14T08:43:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155179+0000", 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155182+0000", 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6079999999999998e-06 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155189+0000", 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155197+0000", 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252186+0000", 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.096989350000000002 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252239+0000", 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2562000000000003e-05 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.5479.0:16651 3.a 3.c68dfc2a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 114.26711244400001, 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.097091823999999993, 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-14T08:43:37.512 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.5479", 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 16651 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.155205+0000", 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162535+0000", 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007329922 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162542+0000", 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1300000000000003e-06 2024-09-14T08:43:37.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162562+0000", 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9949000000000002e-05 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.162570+0000", 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8179999999999993e-06 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252279+0000", 2024-09-14T08:43:37.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.089708974999999996 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-14T08:41:43.252296+0000", 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7030000000000001e-05 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-14T08:43:37.516 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:37.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:37.518 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:37.519+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:37.619 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:37.619+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:37.654 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:37.655 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:37.655 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:37.655 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:37.669 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:37.719 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:37.716+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:37.820 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:37.820+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:37.835 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:37.835 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:37.835 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:37.835 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:37.835 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:37.849 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:37.921 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:37.923+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38209 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4101120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72861053599999, 2024-09-14T08:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095925053999999996, 2024-09-14T08:43:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38209 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248012+0000", 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248013+0000", 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1930000000000001e-06 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248018+0000", 2024-09-14T08:43:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1959999999999999e-06 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248035+0000", 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7255e-05 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248049+0000", 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3978000000000001e-05 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343457+0000", 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095407965999999997 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343675+0000", 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021762600000000001 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.343937+0000", 2024-09-14T08:43:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026184 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38210 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4097024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72855507599999, 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096449241000000005, 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38210 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248067+0000", 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248068+0000", 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248073+0000", 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9439999999999996e-06 2024-09-14T08:43:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248090+0000", 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6784000000000001e-05 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248103+0000", 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3002e-05 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344023+0000", 2024-09-14T08:43:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.095920674999999997 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344242+0000", 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218311 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344516+0000", 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000274579 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38211 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4112384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72849545599999, 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096806070999999994, 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38211 2024-09-14T08:43:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248127+0000", 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248128+0000", 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.063e-06 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248134+0000", 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2759999999999997e-06 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248172+0000", 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7839000000000001e-05 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248186+0000", 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799e-05 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344625+0000", 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096439275000000005 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344766+0000", 2024-09-14T08:43:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014091400000000001 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.344933+0000", 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016690499999999999 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38212 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4108288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72841391599999, 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097327761999999998, 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38212 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248208+0000", 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248209+0000", 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.207e-06 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248215+0000", 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7930000000000003e-06 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248232+0000", 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7167999999999999e-05 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248246+0000", 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3918e-05 2024-09-14T08:43:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345032+0000", 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.096785812999999998 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345265+0000", 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000232671 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345536+0000", 2024-09-14T08:43:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027119200000000002 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38213 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72835758799999, 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097645675000000001, 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38213 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248264+0000", 2024-09-14T08:43:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248266+0000", 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248271+0000", 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0889999999999999e-06 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248287+0000", 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6818000000000001e-05 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248300+0000", 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2822e-05 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345624+0000", 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097324094999999999 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345744+0000", 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119567 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.345910+0000", 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016619099999999999 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38214 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4119552~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72828609300001, 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098160452999999995, 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38214 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248336+0000", 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248337+0000", 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.093e-06 2024-09-14T08:43:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248343+0000", 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7559999999999996e-06 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248360+0000", 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7308000000000001e-05 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248373+0000", 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3355e-05 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346001+0000", 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.097627847000000004 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346220+0000", 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000218526 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346496+0000", 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027656799999999999 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38215 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4134912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72821322199999, 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098726483000000004, 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38215 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248409+0000", 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248410+0000", 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1370000000000001e-06 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248416+0000", 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7130000000000002e-06 2024-09-14T08:43:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248431+0000", 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5141e-05 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248440+0000", 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7560000000000005e-06 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346620+0000", 2024-09-14T08:43:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098180017999999994 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.346832+0000", 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021280600000000001 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347135+0000", 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030291200000000002 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38216 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4130816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72817101000001, 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099233271999999997, 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38216 2024-09-14T08:43:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248451+0000", 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248452+0000", 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248455+0000", 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3400000000000002e-06 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248464+0000", 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9919999999999996e-06 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248471+0000", 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.306e-06 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347204+0000", 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098732439000000005 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347422+0000", 2024-09-14T08:43:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021776200000000001 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347684+0000", 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000262773 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38217 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4146176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72814117999999, 2024-09-14T08:43:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099851375000000006, 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38217 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248481+0000", 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248482+0000", 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248484+0000", 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9529999999999999e-06 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248493+0000", 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4330000000000004e-06 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248500+0000", 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.347802+0000", 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099302294999999999 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348042+0000", 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023962199999999999 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348332+0000", 2024-09-14T08:43:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029028700000000002 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38218 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4142080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72811288299999, 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100191637, 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38218 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248509+0000", 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248510+0000", 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248523+0000", 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3371e-05 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248533+0000", 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4390000000000006e-06 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248540+0000", 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1860000000000003e-06 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348440+0000", 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099899443000000004 2024-09-14T08:43:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348547+0000", 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107944 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348701+0000", 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153327 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38219 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4157440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72807178799999, 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100774551, 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38219 2024-09-14T08:43:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248550+0000", 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248551+0000", 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8999999999999995e-07 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248554+0000", 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8329999999999998e-06 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248563+0000", 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7490000000000004e-06 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248570+0000", 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1160000000000001e-06 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.348807+0000", 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100237141 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349038+0000", 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023078700000000001 2024-09-14T08:43:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349325+0000", 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00028713499999999999 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38220 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4153344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72804275799999, 2024-09-14T08:43:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101099763, 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38220 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248579+0000", 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248580+0000", 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8400000000000004e-07 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248583+0000", 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8959999999999999e-06 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248591+0000", 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4530000000000002e-06 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248598+0000", 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1319999999999996e-06 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349397+0000", 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10079891000000001 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349507+0000", 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109238 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349679+0000", 2024-09-14T08:43:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017244999999999999 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38221 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4168704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.728014274, 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10143113500000001, 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38221 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248608+0000", 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5000000000000002e-07 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248611+0000", 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248620+0000", 2024-09-14T08:43:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5690000000000005e-06 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248627+0000", 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0559999999999999e-06 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349755+0000", 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101128553 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.349883+0000", 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350039+0000", 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155422 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38222 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4164608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72798613399999, 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101710517, 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38222 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248636+0000", 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248637+0000", 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9699999999999995e-07 2024-09-14T08:43:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248639+0000", 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8619999999999999e-06 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248648+0000", 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4689999999999997e-06 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248655+0000", 2024-09-14T08:43:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4930000000000001e-06 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350094+0000", 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101438771 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350204+0000", 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109981 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350346+0000", 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142244 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38223 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.727957438, 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102041057, 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38223 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248665+0000", 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248666+0000", 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2699999999999998e-07 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248668+0000", 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8100000000000002e-06 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248677+0000", 2024-09-14T08:43:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4659999999999999e-06 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248684+0000", 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350407+0000", 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101723096 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350530+0000", 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012281299999999999 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350706+0000", 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017567 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38224 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4175872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72792868100001, 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10231907799999999, 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38224 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248693+0000", 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248694+0000", 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8700000000000005e-07 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248697+0000", 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6570000000000001e-06 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248705+0000", 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3620000000000006e-06 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248712+0000", 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350766+0000", 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102054251 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.350875+0000", 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010877 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351012+0000", 2024-09-14T08:43:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013727499999999999 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38225 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4191232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72790063400001, 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102615811, 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38225 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248721+0000", 2024-09-14T08:43:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248722+0000", 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6700000000000003e-07 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248725+0000", 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8559999999999998e-06 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248733+0000", 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4290000000000001e-06 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248741+0000", 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1430000000000001e-06 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351077+0000", 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102336858 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351193+0000", 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115591 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351337+0000", 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014426700000000001 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:38226 3.14 3:2aeff516:::rbd_data.10f1c6465cc8.0000000000000000:8 [read 4187136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 219.72787065700001, 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10287294399999999, 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 38226 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248751+0000", 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248752+0000", 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6000000000000003e-07 2024-09-14T08:43:38.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248755+0000", 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248763+0000", 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3259999999999996e-06 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.248770+0000", 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1250000000000004e-06 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351374+0000", 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102603389 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351484+0000", 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109898 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:39:58.351624+0000", 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014056 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5914.0:814 3.f 3:f6536a47:::rbd_data.10f188ed37a0.000000000000005e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 430080~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.402251327000002, 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.94391447500000003, 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.057 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5914", 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3720252961", 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 814 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574371+0000", 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574373+0000", 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9300000000000002e-06 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574383+0000", 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0027000000000001e-05 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574405+0000", 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2469000000000001e-05 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574419+0000", 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3543999999999999e-05 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574489+0000", 2024-09-14T08:43:38.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0178999999999993e-05 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:33.574497+0000", 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6320000000000008e-06 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508185+0000", 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.93368827499999996 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508493+0000", 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030869300000000002 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.508838+0000", 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034456200000000003 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.512327+0000", 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034889330000000001 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518113+0000", 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057857730000000001 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518217+0000", 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104319 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:42:34.518285+0000", 2024-09-14T08:43:38.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8139000000000006e-05 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:26441 3.a 3.fa1caca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.460127033999999, 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.86137544499999996, 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 26441 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516495+0000", 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516497+0000", 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3870000000000002e-06 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516508+0000", 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0740000000000001e-05 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516538+0000", 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9822999999999999e-05 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516552+0000", 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516623+0000", 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0345999999999994e-05 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:38.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:09.516629+0000", 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3960000000000003e-06 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:10.377840+0000", 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.861210594 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:43:10.377870+0000", 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0735999999999998e-05 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.068 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.069 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.069 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:38.070 INFO:teuthology.orchestra.run.smithi089.stdout: marking collection for removal 2024-09-14T08:43:38.070 INFO:teuthology.orchestra.run.smithi089.stdout:setting '_remove' omap key 2024-09-14T08:43:38.070 INFO:teuthology.orchestra.run.smithi089.stdout:finish_remove_pgs 3.0_head removing 3.0 2024-09-14T08:43:38.071 INFO:teuthology.orchestra.run.smithi089.stdout:Remove successful 2024-09-14T08:43:38.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:38.071 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:38.071+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:38.171 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:38.172+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:38.240 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:38.241 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:38.241 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:38.241 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:38.254 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:38.272 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:38.272+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:38.373 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:38.375+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:38.376 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:38.376 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:38.377 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:38.377 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:38.377 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:38.391 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:38.474 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:38.472+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:38.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.0.1 2024-09-14T08:43:38.554 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:38.554 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:38.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:38.555 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:38.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.555 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4619.0:82493 3.1c 3:3984362b:::rbd_object_map.10f15d5c7697:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-14T08:43:38.555 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:38.555 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 202.823393837, 2024-09-14T08:43:38.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99988881200000002, 2024-09-14T08:43:38.555 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.555 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4619", 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3975565214", 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 82493 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733600+0000", 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733602+0000", 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8920000000000001e-06 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733611+0000", 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6649999999999998e-06 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733633+0000", 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2008e-05 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733645+0000", 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1691999999999999e-05 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733751+0000", 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106486 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:15.733771+0000", 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9145000000000001e-05 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729093+0000", 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.99532213999999997 2024-09-14T08:43:38.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.729676+0000", 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058291799999999998 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.730697+0000", 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010209419999999999 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.732286+0000", 2024-09-14T08:43:38.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015895 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733322+0000", 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001036078 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733418+0000", 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6362999999999999e-05 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:16.733488+0000", 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9982999999999997e-05 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11815 3.9 3:970d6697:::rbd_header.10f1b8e048d3:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 147.287640012, 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.341442152, 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.562 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:38.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:38.563 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11815 2024-09-14T08:43:38.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.563 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:38.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269353+0000", 2024-09-14T08:43:38.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269355+0000", 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1179999999999999e-06 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269359+0000", 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6210000000000003e-06 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269370+0000", 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1019000000000001e-05 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269378+0000", 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9910000000000002e-06 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269433+0000", 2024-09-14T08:43:38.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4669000000000001e-05 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.269440+0000", 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1609999999999997e-06 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.609763+0000", 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.340322815 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610091+0000", 2024-09-14T08:43:38.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032780299999999999 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.610796+0000", 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070495499999999995 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:107 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 147.252975128, 2024-09-14T08:43:38.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30809092599999999, 2024-09-14T08:43:38.569 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.569 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.569 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:38.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:38.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:38.569 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304018+0000", 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304019+0000", 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8700000000000005e-07 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304022+0000", 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3060000000000002e-06 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304031+0000", 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6610000000000006e-06 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304038+0000", 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5679999999999996e-06 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304119+0000", 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1615999999999999e-05 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304130+0000", 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0825000000000001e-05 2024-09-14T08:43:38.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.611805+0000", 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30767532199999997 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612109+0000", 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030384100000000001 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5284.0:123 3.9 3:934c624d:::rbd_data.10f12785a04b.0000000000000009:head [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 147.252774157, 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.30828189499999997, 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5284", 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1348670659", 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 123 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304219+0000", 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304220+0000", 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4000000000000002e-07 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304223+0000", 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8370000000000001e-06 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304232+0000", 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1940000000000004e-06 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304238+0000", 2024-09-14T08:43:38.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5880000000000003e-06 2024-09-14T08:43:38.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304299+0000", 2024-09-14T08:43:38.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0544000000000002e-05 2024-09-14T08:43:38.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:38.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.304309+0000", 2024-09-14T08:43:38.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7699999999999996e-06 2024-09-14T08:43:38.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612148+0000", 2024-09-14T08:43:38.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.307839262 2024-09-14T08:43:38.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:11.612501+0000", 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035315999999999999 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24013 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2623488~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.35209876799999, 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16934207300000001, 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.581 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.581 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.581 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.581 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.581 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24013 2024-09-14T08:43:38.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204895+0000", 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4300000000000002e-07 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204899+0000", 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204910+0000", 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.173e-05 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204919+0000", 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9870000000000005e-06 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373482+0000", 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16856220499999999 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.373720+0000", 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023818400000000001 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374237+0000", 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00051708099999999996 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.585 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24014 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2635776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.586 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:38.586 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.35206455299999, 2024-09-14T08:43:38.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16994100500000001, 2024-09-14T08:43:38.586 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.586 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.586 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.586 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.586 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.586 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24014 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204929+0000", 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204930+0000", 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0400000000000005e-07 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204933+0000", 2024-09-14T08:43:38.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204944+0000", 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1226999999999999e-05 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204951+0000", 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0759999999999997e-06 2024-09-14T08:43:38.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374343+0000", 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16939162799999999 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374489+0000", 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146172 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374870+0000", 2024-09-14T08:43:38.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038066199999999998 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24015 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2648064~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.35202306400001, 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170779078, 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.591 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24015 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204970+0000", 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204971+0000", 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8999999999999995e-07 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.204975+0000", 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5599999999999998e-06 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205008+0000", 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2722999999999998e-05 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205017+0000", 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.374973+0000", 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169956567 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375222+0000", 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000248729 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375750+0000", 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052751999999999996 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24016 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2660352~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.35196458199999, 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171281558, 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.595 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24016 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205029+0000", 2024-09-14T08:43:38.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205030+0000", 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.16e-07 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205033+0000", 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2569999999999999e-06 2024-09-14T08:43:38.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205042+0000", 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1030000000000008e-06 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205049+0000", 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2269999999999996e-06 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375796+0000", 2024-09-14T08:43:38.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17074653100000001 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.375923+0000", 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012759300000000001 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376310+0000", 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038703099999999997 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.600 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24017 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2672640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.600 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:38.600 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.351934903, 2024-09-14T08:43:38.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17216594700000001, 2024-09-14T08:43:38.600 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.600 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24017 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:38.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205059+0000", 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205063+0000", 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3359999999999999e-06 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205071+0000", 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3869999999999995e-06 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205078+0000", 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1330000000000001e-06 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376421+0000", 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171342676 2024-09-14T08:43:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.376682+0000", 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026137799999999999 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377225+0000", 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054231699999999995 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24018 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2684928~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.35190569400001, 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17262608500000001, 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24018 2024-09-14T08:43:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.606 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:38.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.205088+0000", 2024-09-14T08:43:38.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212451+0000", 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073630370000000002 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212465+0000", 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005999999999999e-05 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212495+0000", 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0403e-05 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212510+0000", 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4868999999999999e-05 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377261+0000", 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16475094800000001 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377387+0000", 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012580299999999999 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.377714+0000", 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032701900000000001 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24024 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2758656~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.34429939899999, 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169086234, 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24024 2024-09-14T08:43:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212694+0000", 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212695+0000", 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1399999999999996e-07 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212698+0000", 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212706+0000", 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4360000000000002e-06 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212713+0000", 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6270000000000002e-06 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381207+0000", 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16849444599999999 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381345+0000", 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138119 2024-09-14T08:43:38.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381780+0000", 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00043510199999999998 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24025 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2770944~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.34427140899999, 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16965753, 2024-09-14T08:43:38.614 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.615 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.615 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.615 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24025 2024-09-14T08:43:38.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.615 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212722+0000", 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212723+0000", 2024-09-14T08:43:38.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8999999999999996e-07 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212726+0000", 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7659999999999999e-06 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212734+0000", 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3829999999999992e-06 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212741+0000", 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.007e-06 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381862+0000", 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16912087000000001 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.381994+0000", 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013229499999999999 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382380+0000", 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038551900000000002 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24026 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2783232~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.34424307699999, 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170196135, 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.619 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24026 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212750+0000", 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212751+0000", 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7400000000000003e-07 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212766+0000", 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4525999999999999e-05 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212775+0000", 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2599999999999994e-06 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212782+0000", 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382454+0000", 2024-09-14T08:43:38.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.169672032 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382593+0000", 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013845200000000001 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.382947+0000", 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035398800000000001 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.623 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24027 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2795520~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.34420131799999, 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17070196100000001, 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24027 2024-09-14T08:43:38.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212792+0000", 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212793+0000", 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1999999999999999e-07 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212796+0000", 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.083e-06 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212804+0000", 2024-09-14T08:43:38.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3100000000000001e-06 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212811+0000", 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7700000000000004e-06 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383030+0000", 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17021857800000001 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383159+0000", 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129345 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383494+0000", 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033515500000000001 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24028 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2807808~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.628 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.344172439, 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171258569, 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24028 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212821+0000", 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212822+0000", 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2600000000000002e-07 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212825+0000", 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212838+0000", 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3004e-05 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212845+0000", 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1230000000000002e-06 2024-09-14T08:43:38.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383571+0000", 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170726658 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.383703+0000", 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131099 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384080+0000", 2024-09-14T08:43:38.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037702900000000003 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24029 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2820096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.34413863, 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.171822318, 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24029 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212855+0000", 2024-09-14T08:43:38.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212856+0000", 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5600000000000005e-07 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212859+0000", 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0539999999999999e-06 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212870+0000", 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1666e-05 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212877+0000", 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9469999999999997e-06 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384149+0000", 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17127194700000001 2024-09-14T08:43:38.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384291+0000", 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014167300000000001 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384677+0000", 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386275 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24030 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2832384~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.34410627099999, 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.17238141800000001, 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24030 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.212887+0000", 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220656+0000", 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077692400000000002 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220667+0000", 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0190000000000001e-05 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220693+0000", 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6818999999999999e-05 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.220708+0000", 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4633e-05 2024-09-14T08:43:38.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384757+0000", 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16404840700000001 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.384890+0000", 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133826 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.385269+0000", 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037830300000000003 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24039 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2942976~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.33597846800001, 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16924610700000001, 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24039 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221015+0000", 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221016+0000", 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8599999999999997e-07 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221019+0000", 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0869999999999998e-06 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221029+0000", 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079e-05 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221036+0000", 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3069999999999997e-06 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389756+0000", 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.168720119 2024-09-14T08:43:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.389883+0000", 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000126883 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390261+0000", 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037774599999999998 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24040 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2955264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.33594748300001, 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16977328899999999, 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24040 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.647 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221046+0000", 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221047+0000", 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.54e-07 2024-09-14T08:43:38.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221050+0000", 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221059+0000", 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221066+0000", 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8859999999999998e-06 2024-09-14T08:43:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390338+0000", 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16927245499999999 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390463+0000", 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012495599999999999 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390819+0000", 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035636199999999999 2024-09-14T08:43:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:24041 3.11 3:8eaa58dd:::rbd_data.10f12f878d5b.0000000000000000:1a [read 2967552~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e110)", 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 129.335918577, 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.170279231, 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:38.651 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24041 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:38.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.221075+0000", 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228736+0000", 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076610810000000001 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228747+0000", 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1286e-05 2024-09-14T08:43:38.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228776+0000", 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8365999999999999e-05 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.228791+0000", 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5593000000000001e-05 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.390895+0000", 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.16210339800000001 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391027+0000", 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013202600000000001 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:29.391354+0000", 2024-09-14T08:43:38.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032748100000000002 2024-09-14T08:43:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:38.656 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:38.656 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:38.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:43:38.658 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:38.658 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:38.659+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:38.758 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:38.759+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:38.834 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:38.834 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:38.834 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-14T08:43:38.834 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:38.848 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:38.892 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:38.895+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:38.959 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:38.956+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:39.014 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:39.014 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-14T08:43:39.014 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-14T08:43:39.014 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-14T08:43:39.014 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:39.030 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:39.076 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:39.079+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:39.157 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-14T08:43:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-14T08:43:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-14T08:43:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-14T08:43:39.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54094 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5678080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 218.079132724, 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098640697999999999, 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54094 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078956+0000", 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078957+0000", 2024-09-14T08:43:39.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2330000000000001e-06 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078963+0000", 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6760000000000004e-06 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078981+0000", 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8547999999999999e-05 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.078995+0000", 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3529e-05 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177010+0000", 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098014893000000006 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177239+0000", 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022944799999999999 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177597+0000", 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035737099999999999 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54095 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5689344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 218.07907552, 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099241932000000005, 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54095 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079013+0000", 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079014+0000", 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.203e-06 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079020+0000", 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3959999999999997e-06 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079039+0000", 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:43:39.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079053+0000", 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4005000000000001e-05 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177678+0000", 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098624768000000002 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.177899+0000", 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022084900000000001 2024-09-14T08:43:39.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178255+0000", 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035588299999999998 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54096 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5700608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 218.07901663600001, 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099836419999999995, 2024-09-14T08:43:39.166 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54096 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079072+0000", 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079073+0000", 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2130000000000001e-06 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079079+0000", 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4090000000000002e-06 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079101+0000", 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2354999999999999e-05 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079119+0000", 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7683999999999999e-05 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178342+0000", 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099222988999999998 2024-09-14T08:43:39.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178553+0000", 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021151300000000001 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178908+0000", 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035525699999999999 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54097 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5711872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 218.07895171000001, 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100417202, 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54097 2024-09-14T08:43:39.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079137+0000", 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079138+0000", 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4699999999999999e-06 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079144+0000", 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9329999999999998e-06 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079162+0000", 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7405e-05 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079175+0000", 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3311e-05 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.178995+0000", 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099820437999999997 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179211+0000", 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215126 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179554+0000", 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034351899999999997 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54098 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5723136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 218.07889025899999, 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.100993759, 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.175 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54098 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079198+0000", 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079200+0000", 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.26e-06 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079205+0000", 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5489999999999997e-06 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079226+0000", 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1114000000000001e-05 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079239+0000", 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3236e-05 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179638+0000", 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10039848 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.179847+0000", 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209347 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180192+0000", 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034477299999999999 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54099 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5734400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:39.179 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 218.07883072499999, 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101600202, 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54099 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:39.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079258+0000", 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079259+0000", 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.119e-06 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079264+0000", 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4099999999999999e-06 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079284+0000", 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9828000000000001e-05 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079298+0000", 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3908e-05 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180276+0000", 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.1009775 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180507+0000", 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023143 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180858+0000", 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035100700000000002 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54100 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5745664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 218.07877141500001, 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.10218276799999999, 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54100 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079317+0000", 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079318+0000", 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2160000000000001e-06 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079324+0000", 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3530000000000002e-06 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079350+0000", 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6636999999999999e-05 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079365+0000", 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5136e-05 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.180943+0000", 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.101577266 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181153+0000", 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000210373 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181500+0000", 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034678699999999999 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4628.0:54101 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 5756928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 218.07869938299999, 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102758234, 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.188 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4628", 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1090415700", 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54101 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079389+0000", 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079391+0000", 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3570000000000001e-06 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079396+0000", 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6690000000000003e-06 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079413+0000", 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6756e-05 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.079443+0000", 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0165999999999999e-05 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181580+0000", 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.102137082 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.181800+0000", 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021936899999999999 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:01.182147+0000", 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034783500000000001 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24687 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3132416~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 193.923999006, 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098911552, 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:43:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24687 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234090+0000", 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6300000000000004e-07 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234093+0000", 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0170000000000001e-06 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234103+0000", 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4429999999999992e-06 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234110+0000", 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5129999999999999e-06 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332591+0000", 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098480575000000001 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.332744+0000", 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152745 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333001+0000", 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025749600000000002 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4816.0:24688 3.c 3:355573ab:::rbd_data.10f1c6465cc8.0000000000000003:8 [read 3143680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 193.923967581, 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.099403290000000005, 2024-09-14T08:43:39.197 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4816", 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1421238214", 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 24688 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234121+0000", 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234122+0000", 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7999999999999993e-07 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234125+0000", 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.993e-06 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234134+0000", 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4499999999999993e-06 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.234142+0000", 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.126e-06 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333056+0000", 2024-09-14T08:43:39.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.098913973000000002 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333250+0000", 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019410599999999999 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:40:25.333524+0000", 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027466200000000001 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4337.0:11720 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139993318534384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 149.56010396100001, 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04995492, 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4337", 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/429933836", 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 11720 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597985+0000", 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597987+0000", 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0590000000000001e-06 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.597993+0000", 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5729999999999996e-06 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598008+0000", 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.449e-05 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598017+0000", 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7480000000000005e-06 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598121+0000", 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103138 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598132+0000", 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1703e-05 2024-09-14T08:43:39.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.642802+0000", 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0446699310000001 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.643478+0000", 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067542999999999998 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647940+0000", 2024-09-14T08:43:39.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004461848 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2134 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [call rbd.snapshot_add in=15b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 149.560044611, 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.050519741, 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.207 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2134 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598044+0000", 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598045+0000", 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6700000000000003e-07 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598049+0000", 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0119999999999999e-06 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598056+0000", 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7300000000000005e-06 2024-09-14T08:43:39.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598061+0000", 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8879999999999996e-06 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598170+0000", 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109097 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:39.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598176+0000", 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5890000000000002e-06 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645139+0000", 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.046962808 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645376+0000", 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000236956 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.645929+0000", 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00055340000000000001 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.647048+0000", 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011188000000000001 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648249+0000", 2024-09-14T08:43:39.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012014020000000001 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648385+0000", 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013584299999999999 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648564+0000", 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017844900000000001 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.213 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5490.0:2135 3.c 3:351bb8bb:::rbd_header.10f1d55a57ec:head [watch reconnect cookie 139923189856304 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 149.56000465899999, 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.052532791, 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5490", 2024-09-14T08:43:39.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1623479489", 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2135 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598084+0000", 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5700000000000002e-07 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598087+0000", 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3999999999999999e-06 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598095+0000", 2024-09-14T08:43:39.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598100+0000", 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2320000000000001e-06 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598198+0000", 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7355999999999994e-05 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:39.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:09.598202+0000", 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4599999999999996e-06 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646507+0000", 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.04830541 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for rw locks", 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.646849+0000", 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000341672 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648611+0000", 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001761409 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.648747+0000", 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013661399999999999 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:10.650617+0000", 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018695319999999999 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35243 3.4 3:20cc3c30:::rbd_data.10f1b915d14f.00000000000001c2:head [set-alloc-hint object_size 524288 write_size 524288,write 5632~9216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 126.076581706, 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72418864999999999, 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:39.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35243 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081507+0000", 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081510+0000", 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7530000000000002e-06 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081536+0000", 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6305999999999999e-05 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081558+0000", 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1843000000000001e-05 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081572+0000", 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3796e-05 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081752+0000", 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180769 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.081784+0000", 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999000000000003e-05 2024-09-14T08:43:39.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800751+0000", 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71896690600000002 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.800889+0000", 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000137847 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:39.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.801011+0000", 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121957 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802091+0000", 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010799620000000001 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805594+0000", 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035027080000000002 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805640+0000", 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5967000000000002e-05 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.805696+0000", 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5837000000000001e-05 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5631.0:35252 3.4 3:21c8a462:::rbd_data.10f1b915d14f.00000000000001c5:head [set-alloc-hint object_size 524288 write_size 524288,write 4096~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:39.226 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 126.07018914, 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.72025921599999998, 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5631", 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/3248464538", 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35252 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087899+0000", 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087901+0000", 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0269999999999998e-06 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087930+0000", 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8385999999999999e-05 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087955+0000", 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4782000000000001e-05 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.087969+0000", 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4497e-05 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088096+0000", 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012657599999999999 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.088111+0000", 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5682999999999999e-05 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802127+0000", 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.71401572800000002 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802227+0000", 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9412000000000003e-05 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.802332+0000", 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105271 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.807494+0000", 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051625589999999997 2024-09-14T08:43:39.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808070+0000", 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057581400000000001 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808109+0000", 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8818e-05 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:33.808159+0000", 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9663000000000002e-05 2024-09-14T08:43:39.232 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15705 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 117.31059972, 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0153392429999999, 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:39.233 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15705 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847489+0000", 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847491+0000", 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.187e-06 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847500+0000", 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4950000000000008e-06 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847516+0000", 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6192999999999999e-05 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847526+0000", 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0545e-05 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847595+0000", 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8608000000000004e-05 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.847609+0000", 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3767999999999999e-05 2024-09-14T08:43:39.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.853806+0000", 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0061978110000001 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.854187+0000", 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038104099999999999 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.855301+0000", 2024-09-14T08:43:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011133130000000001 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859832+0000", 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045314140000000001 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862624+0000", 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027913930000000001 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862706+0000", 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2608000000000006e-05 2024-09-14T08:43:39.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862828+0000", 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121867 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15706 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 117.269860318, 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.974854522, 2024-09-14T08:43:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15706 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888228+0000", 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888231+0000", 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3760000000000002e-06 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888239+0000", 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.977e-06 2024-09-14T08:43:39.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888259+0000", 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0061e-05 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888268+0000", 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3919999999999992e-06 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888351+0000", 2024-09-14T08:43:39.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2718000000000003e-05 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:41.888365+0000", 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4191e-05 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857166+0000", 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.96880055700000001 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857384+0000", 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021879399999999999 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.857980+0000", 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059547300000000001 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862514+0000", 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045344039999999997 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:39.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862901+0000", 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038640300000000001 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862974+0000", 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3238000000000006e-05 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863083+0000", 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010893800000000001 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15707 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 117.002289234, 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70746537300000001, 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:39.246 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15707 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155799+0000", 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155802+0000", 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.79e-06 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155815+0000", 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2782999999999999e-05 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155848+0000", 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3238999999999998e-05 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155865+0000", 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6399999999999999e-05 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.155995+0000", 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013067600000000001 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.156014+0000", 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8814e-05 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858853+0000", 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.70283849300000001 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.858942+0000", 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9807000000000003e-05 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859318+0000", 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037582099999999998 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862603+0000", 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032851930000000001 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863097+0000", 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049337800000000005 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863169+0000", 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2062000000000002e-05 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863265+0000", 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5916999999999997e-05 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15708 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 116.93848534, 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64862674099999995, 2024-09-14T08:43:39.252 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15708 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219603+0000", 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219606+0000", 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.05e-06 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219618+0000", 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1727e-05 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219641+0000", 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3328000000000001e-05 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219656+0000", 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4782e-05 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219840+0000", 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000184243 2024-09-14T08:43:39.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.219882+0000", 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1554000000000002e-05 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.859915+0000", 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.64003351799999997 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860060+0000", 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144537 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.860730+0000", 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067025699999999995 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.863643+0000", 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029124289999999998 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868048+0000", 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044058109999999999 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868133+0000", 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4134000000000005e-05 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868230+0000", 2024-09-14T08:43:39.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7371e-05 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.5479.0:15709 3.13 3:cceafea2:::rbd_object_map.10f18b35ff50:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 116.911013642, 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.62129873999999996, 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-14T08:43:39.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.5479", 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.188:0/1103132010", 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 15709 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247075+0000", 2024-09-14T08:43:39.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247078+0000", 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6970000000000002e-06 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247090+0000", 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2031000000000001e-05 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247113+0000", 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3428999999999999e-05 2024-09-14T08:43:39.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247128+0000", 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5361000000000001e-05 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247242+0000", 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113325 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.247257+0000", 2024-09-14T08:43:39.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5421e-05 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861547+0000", 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.614289372 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.861635+0000", 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8783999999999996e-05 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.862017+0000", 2024-09-14T08:43:39.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038182999999999999 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.864241+0000", 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022242949999999998 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868245+0000", 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040037420000000002 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-14T08:43:39.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868307+0000", 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1654000000000003e-05 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-14T08:41:42.868374+0000", 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6798999999999995e-05 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-14T08:43:39.265 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-14T08:43:39.266 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T08:43:39.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:39.267 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:39.267+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:39.367 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:39.367+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:39.396 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:39.397 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:39.397 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:39.397 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:39.412 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:39.428 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-09-14T08:43:39.428 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T08:43:39.429 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-14T08:43:39.446 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-09-14T08:43:39.446 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T08:43:39.467 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-09-14T08:43:39.468+0000 7f7a49d4c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25238) UID: 0 2024-09-14T08:43:39.468 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3: {} 2024-09-14T08:43:39.468 INFO:teuthology.orchestra.run.smithi089.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T08:43:39.497 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4: {} 2024-09-14T08:43:39.497 INFO:teuthology.orchestra.run.smithi089.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T08:43:39.519 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5: {} 2024-09-14T08:43:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T08:43:39.523 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T08:43:39.523 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T08:43:39.533 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:39.533 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:39.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:39.585 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:43:39.586 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-14T08:43:39.584+0000 7f6d7105f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38823) UID: 0 2024-09-14T08:43:39.669 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-14T08:43:39.671+0000 7f14f4c7d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25288) UID: 0 2024-09-14T08:43:39.698 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:39.699 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:39.711 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T08:43:39.770 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-14T08:43:39.771+0000 7f254bb30640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25284) UID: 0 2024-09-14T08:43:39.795 INFO:teuthology.orchestra.run.smithi188.stdout:All operations completed A-OK! 2024-09-14T08:43:39.827 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:39.828 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:39.841 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T08:43:39.871 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-14T08:43:39.871+0000 7f783bb7c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25285) UID: 0 2024-09-14T08:43:39.873 DEBUG:teuthology.parallel:result is None 2024-09-14T08:43:39.874 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-14T08:43:39.882 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-14T08:43:39.954 INFO:tasks.thrashosds:joining thrashosds 2024-09-14T08:43:39.963 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:39.963 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:39.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T08:43:40.097 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:40.098 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:40.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T08:43:40.236 INFO:teuthology.orchestra.run.smithi089.stdout:get_pg_num_history pg_num_history pg_num_history(e204 pg_nums {1={13=1},2={16=8},3={21=32}} deleted_pools ) 2024-09-14T08:43:40.236 INFO:teuthology.orchestra.run.smithi089.stdout:Importing pgid 3.0 2024-09-14T08:43:40.236 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:00aa9f52:::rbd_data.10f15daa646d.000000000000016b:head# 2024-09-14T08:43:40.236 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 5=[]:{} 2024-09-14T08:43:40.237 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:00c65a94:::rbd_data.10f15daa646d.000000000000019d:head# 2024-09-14T08:43:40.237 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 5=[]:{} 2024-09-14T08:43:40.238 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:00fc172f:::rbd_data.10f14aaf0423.00000000000001dd:head# 2024-09-14T08:43:40.238 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 0=[]:{} 2024-09-14T08:43:40.243 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:020a2bf0:::rbd_data.10f1c460e0d1.000000000000001e:6# 2024-09-14T08:43:40.244 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:40.244 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:40.246 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:020a2bf0:::rbd_data.10f1c460e0d1.000000000000001e:head# 2024-09-14T08:43:40.246 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 6=[]:{6=[6]} 2024-09-14T08:43:40.249 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0254f8de:::rbd_data.10f15daa646d.00000000000001df:head# 2024-09-14T08:43:40.249 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 5=[]:{} 2024-09-14T08:43:40.251 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:028a9a12:::rbd_data.10f18b35ff50.0000000000000039:head# 2024-09-14T08:43:40.251 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 1d=[]:{} 2024-09-14T08:43:40.254 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0332c4ff:::rbd_data.10f1ff52bd5e.0000000000000001:head# 2024-09-14T08:43:40.254 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 24=[]:{} 2024-09-14T08:43:40.256 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0339726e:::rbd_data.10f1c460e0d1.00000000000001c7:6# 2024-09-14T08:43:40.258 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T08:43:40.259 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0339726e:::rbd_data.10f1c460e0d1.00000000000001c7:head# 2024-09-14T08:43:40.259 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 6=[]:{6=[6]} 2024-09-14T08:43:40.260 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:03995c04:::rbd_id.image_client.0-clone9:head# 2024-09-14T08:43:40.260 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 0=[]:{} 2024-09-14T08:43:40.260 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:04479396:::rbd_id.image_client.0-clone2:head# 2024-09-14T08:43:40.260 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 0=[]:{} 2024-09-14T08:43:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:05e88aa0:::rbd_data.10f1c460e0d1.000000000000001a:head# 2024-09-14T08:43:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 6=[]:{} 2024-09-14T08:43:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:05ec6510:::rbd_data.10f15daa646d.0000000000000198:head# 2024-09-14T08:43:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 5=[]:{} 2024-09-14T08:43:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:0600353c:::rbd_data.10f1c6465cc8.0000000000000005:head# 2024-09-14T08:43:40.264 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 0=[]:{} 2024-09-14T08:43:40.274 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:06d84648:::rbd_data.10f1c460e0d1.0000000000000035:head# 2024-09-14T08:43:40.274 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 6=[]:{} 2024-09-14T08:43:40.274 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:06e0cd4b:::rbd_data.10f1663ce16c.0000000000000040:a# 2024-09-14T08:43:40.279 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:06e0cd4b:::rbd_data.10f1663ce16c.0000000000000040:head# 2024-09-14T08:43:40.279 INFO:teuthology.orchestra.run.smithi089.stdout:snapset a=[]:{a=[a]} 2024-09-14T08:43:40.279 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:070f34ec:::rbd_data.10f1e730a19e.000000000000007a:head# 2024-09-14T08:43:40.280 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 1e=[]:{} 2024-09-14T08:43:40.280 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:07bfe3f8:::rbd_data.10f15daa646d.0000000000000193:head# 2024-09-14T08:43:40.280 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 5=[]:{} 2024-09-14T08:43:40.280 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:07e43839:::rbd_data.10f1c460e0d1.0000000000000013:6# 2024-09-14T08:43:40.282 INFO:teuthology.orchestra.run.smithi089.stdout:Write #3:07e43839:::rbd_data.10f1c460e0d1.0000000000000013:head# 2024-09-14T08:43:40.282 INFO:teuthology.orchestra.run.smithi089.stdout:snapset 6=[]:{6=[6]} 2024-09-14T08:43:40.282 INFO:teuthology.orchestra.run.smithi089.stdout:write_pg epoch 204 info 3.0( v 204'453 (0'0,204'453] local-lis/les=181/182 n=22 ec=21/21 lis/c=181/181 les/c/f=182/182/0 sis=181) 2024-09-14T08:43:40.285 INFO:teuthology.orchestra.run.smithi089.stdout:Import successful 2024-09-14T08:43:40.383 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:40.383 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:40.397 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T08:43:40.520 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:40.520 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:40.534 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T08:43:40.653 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:40.653 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:40.667 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T08:43:40.782 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:40.783 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:40.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T08:43:40.821 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /var/log/ceph/exp.3.0.1 2024-09-14T08:43:40.922 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:40.923 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:40.937 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T08:43:41.060 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:41.060 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:41.074 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T08:43:41.191 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:41.191 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:41.206 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T08:43:41.330 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:41.331 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:41.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T08:43:41.477 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:41.477 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:41.491 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T08:43:41.608 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:41.609 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:41.611 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T08:43:41.624 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T08:43:41.789 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-14T08:43:41.789 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T08:43:41.985 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-09-14T08:43:42.007 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T08:43:42.997 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-09-14T08:43:45.837 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-14T08:43:45.837 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-09-14T08:43:45.837 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T08:43:45.838 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T08:43:45.841 INFO:tasks.ceph.osd.1:Started 2024-09-14T08:43:45.841 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:no valid command found; 10 closest matches: 2024-09-14T08:43:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:0 2024-09-14T08:43:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:1 2024-09-14T08:43:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:2 2024-09-14T08:43:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:abort 2024-09-14T08:43:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:assert 2024-09-14T08:43:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:config diff 2024-09-14T08:43:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:config diff get 2024-09-14T08:43:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:config get 2024-09-14T08:43:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:config help [] 2024-09-14T08:43:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:config set ... 2024-09-14T08:43:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: invalid command 2024-09-14T08:43:45.970 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T08:43:45.970 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-14T08:43:46.902 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:46.900+0000 7f89667b57c0 -1 Falling back to public interface 2024-09-14T08:43:50.920 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:50.920+0000 7f89667b57c0 -1 osd.1 204 log_to_monitors true 2024-09-14T08:43:50.972 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:51.076 INFO:teuthology.orchestra.run.smithi089.stderr:no valid command found; 10 closest matches: 2024-09-14T08:43:51.076 INFO:teuthology.orchestra.run.smithi089.stderr:0 2024-09-14T08:43:51.076 INFO:teuthology.orchestra.run.smithi089.stderr:1 2024-09-14T08:43:51.076 INFO:teuthology.orchestra.run.smithi089.stderr:2 2024-09-14T08:43:51.076 INFO:teuthology.orchestra.run.smithi089.stderr:abort 2024-09-14T08:43:51.076 INFO:teuthology.orchestra.run.smithi089.stderr:assert 2024-09-14T08:43:51.076 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs debug_inject_read_zeros 2024-09-14T08:43:51.076 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs files list 2024-09-14T08:43:51.076 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs stats 2024-09-14T08:43:51.077 INFO:teuthology.orchestra.run.smithi089.stderr:bluestore allocator dump block 2024-09-14T08:43:51.077 INFO:teuthology.orchestra.run.smithi089.stderr:bluestore allocator fragmentation block 2024-09-14T08:43:51.077 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: invalid command 2024-09-14T08:43:51.078 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T08:43:51.079 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-14T08:43:51.455 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-09-14T08:43:51.452+0000 7f895a590640 -1 osd.1 220 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T08:43:56.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T08:43:56.211 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:43:56.211 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-14T08:43:56.212 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-14T08:43:56.212 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:43:56.227 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-14T08:43:56.227 INFO:tasks.thrashosds.thrasher:Adding osd 5 2024-09-14T08:43:56.227 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 5 2024-09-14T08:43:56.542 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-14T08:43:56.540+0000 7f7148add640 -1 mon.a@0(leader).osd e222 definitely_dead 0 2024-09-14T08:43:57.452 INFO:teuthology.orchestra.run.smithi089.stderr:marked in osd.5. 2024-09-14T08:43:57.483 INFO:tasks.thrashosds.thrasher:Added osd 5 2024-09-14T08:43:57.483 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-14T08:43:57.484 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-14T08:43:57.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-14T08:43:57.781 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-14T08:43:57.780+0000 7f7148add640 -1 mon.a@0(leader).osd e223 definitely_dead 0 2024-09-14T08:43:58.370 INFO:teuthology.orchestra.run.smithi089.stderr:marked in osd.3. 2024-09-14T08:43:58.404 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-14T08:43:58.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-14T08:43:58.528 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a: {} 2024-09-14T08:43:58.528 INFO:teuthology.orchestra.run.smithi089.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T08:43:58.541 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b: {} 2024-09-14T08:43:58.541 INFO:teuthology.orchestra.run.smithi089.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T08:43:58.550 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c: {} 2024-09-14T08:43:58.550 INFO:teuthology.orchestra.run.smithi089.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T08:43:58.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T08:43:59.387 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T08:43:59.435 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-14T08:44:00.376 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-14T08:44:00.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T08:44:01.386 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T08:44:01.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-14T08:44:02.381 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-14T08:44:02.409 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T08:44:03.373 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T08:44:03.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-14T08:44:04.376 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-14T08:44:04.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T08:44:05.396 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T08:44:05.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-14T08:44:06.383 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-14T08:44:06.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T08:44:07.387 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T08:44:07.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-14T08:44:08.375 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-14T08:44:08.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T08:44:09.378 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T08:44:09.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-14T08:44:10.518 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-14T08:44:10.542 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-14T08:44:10.542 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-14T08:44:10.542 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-14T08:44:10.543 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-14T08:44:10.543 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T08:44:10.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T08:44:10.848 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:44:10.849 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":236,"fsid":"57b092b7-5550-41a0-8f78-531de0e7c469","created":"2024-09-14T08:38:48.610112+0000","modified":"2024-09-14T08:44:10.509456+0000","last_up_change":"2024-09-14T08:43:52.422551+0000","last_in_change":"2024-09-14T08:43:58.369219+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T08:39:00.306403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T08:39:06.370159+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T08:39:16.437713+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":38,"snap_epoch":217,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":105,"last_clean_end":115,"up_from":127,"up_thru":234,"down_at":117,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6801","nonce":1732765385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6803","nonce":1732765385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6807","nonce":1732765385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6805","nonce":1732765385}]},"public_addr":"172.21.15.89:6801/1732765385","cluster_addr":"172.21.15.89:6803/1732765385","heartbeat_back_addr":"172.21.15.89:6807/1732765385","heartbeat_front_addr":"172.21.15.89:6805/1732765385","state":["exists","up"]},{"osd":1,"uuid":"09ba1390-a0d1-48a3-9342-5f5aa64e2217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":204,"up_from":221,"up_thru":231,"down_at":205,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6809","nonce":3885254412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6811","nonce":3885254412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6815","nonce":3885254412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6813","nonce":3885254412}]},"public_addr":"172.21.15.89:6809/3885254412","cluster_addr":"172.21.15.89:6811/3885254412","heartbeat_back_addr":"172.21.15.89:6815/3885254412","heartbeat_front_addr":"172.21.15.89:6813/3885254412","state":["exists","up"]},{"osd":2,"uuid":"a7cd8610-d8e1-44e7-a423-4419cad90d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6817","nonce":1157205327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6819","nonce":1157205327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6823","nonce":1157205327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6821","nonce":1157205327}]},"public_addr":"172.21.15.89:6817/1157205327","cluster_addr":"172.21.15.89:6819/1157205327","heartbeat_back_addr":"172.21.15.89:6823/1157205327","heartbeat_front_addr":"172.21.15.89:6821/1157205327","state":["exists","up"]},{"osd":3,"uuid":"1339fb05-5d1c-4c0a-8388-314119543bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":234,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6809","nonce":1656791341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6811","nonce":1656791341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6815","nonce":1656791341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6813","nonce":1656791341}]},"public_addr":"172.21.15.112:6809/1656791341","cluster_addr":"172.21.15.112:6811/1656791341","heartbeat_back_addr":"172.21.15.112:6815/1656791341","heartbeat_front_addr":"172.21.15.112:6813/1656791341","state":["exists","up"]},{"osd":4,"uuid":"0cebba54-9019-47bd-870f-306664e390e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6817","nonce":1186206237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6819","nonce":1186206237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6823","nonce":1186206237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6821","nonce":1186206237}]},"public_addr":"172.21.15.112:6817/1186206237","cluster_addr":"172.21.15.112:6819/1186206237","heartbeat_back_addr":"172.21.15.112:6823/1186206237","heartbeat_front_addr":"172.21.15.112:6821/1186206237","state":["exists","up"]},{"osd":5,"uuid":"e571e73b-0e9d-417d-b01c-59b651016763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6801","nonce":796623465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6803","nonce":796623465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6807","nonce":796623465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6805","nonce":796623465}]},"public_addr":"172.21.15.112:6801/796623465","cluster_addr":"172.21.15.112:6803/796623465","heartbeat_back_addr":"172.21.15.112:6807/796623465","heartbeat_front_addr":"172.21.15.112:6805/796623465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.174731+0000","dead_epoch":117},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.475467+0000","dead_epoch":205},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.606174+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.835957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.753547+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.284212+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.4","osds":[5,1]},{"pgid":"3.a","osds":[2,5]},{"pgid":"3.16","osds":[4,3]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T08:44:10.867 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T08:44:10.867 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T08:44:11.176 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:44:11.177 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":236,"fsid":"57b092b7-5550-41a0-8f78-531de0e7c469","created":"2024-09-14T08:38:48.610112+0000","modified":"2024-09-14T08:44:10.509456+0000","last_up_change":"2024-09-14T08:43:52.422551+0000","last_in_change":"2024-09-14T08:43:58.369219+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T08:39:00.306403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T08:39:06.370159+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T08:39:16.437713+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":38,"snap_epoch":217,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":105,"last_clean_end":115,"up_from":127,"up_thru":234,"down_at":117,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6801","nonce":1732765385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6803","nonce":1732765385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6807","nonce":1732765385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6805","nonce":1732765385}]},"public_addr":"172.21.15.89:6801/1732765385","cluster_addr":"172.21.15.89:6803/1732765385","heartbeat_back_addr":"172.21.15.89:6807/1732765385","heartbeat_front_addr":"172.21.15.89:6805/1732765385","state":["exists","up"]},{"osd":1,"uuid":"09ba1390-a0d1-48a3-9342-5f5aa64e2217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":204,"up_from":221,"up_thru":231,"down_at":205,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6809","nonce":3885254412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6811","nonce":3885254412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6815","nonce":3885254412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6813","nonce":3885254412}]},"public_addr":"172.21.15.89:6809/3885254412","cluster_addr":"172.21.15.89:6811/3885254412","heartbeat_back_addr":"172.21.15.89:6815/3885254412","heartbeat_front_addr":"172.21.15.89:6813/3885254412","state":["exists","up"]},{"osd":2,"uuid":"a7cd8610-d8e1-44e7-a423-4419cad90d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6817","nonce":1157205327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6819","nonce":1157205327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6823","nonce":1157205327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6821","nonce":1157205327}]},"public_addr":"172.21.15.89:6817/1157205327","cluster_addr":"172.21.15.89:6819/1157205327","heartbeat_back_addr":"172.21.15.89:6823/1157205327","heartbeat_front_addr":"172.21.15.89:6821/1157205327","state":["exists","up"]},{"osd":3,"uuid":"1339fb05-5d1c-4c0a-8388-314119543bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":234,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6809","nonce":1656791341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6811","nonce":1656791341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6815","nonce":1656791341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6813","nonce":1656791341}]},"public_addr":"172.21.15.112:6809/1656791341","cluster_addr":"172.21.15.112:6811/1656791341","heartbeat_back_addr":"172.21.15.112:6815/1656791341","heartbeat_front_addr":"172.21.15.112:6813/1656791341","state":["exists","up"]},{"osd":4,"uuid":"0cebba54-9019-47bd-870f-306664e390e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6817","nonce":1186206237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6819","nonce":1186206237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6823","nonce":1186206237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6821","nonce":1186206237}]},"public_addr":"172.21.15.112:6817/1186206237","cluster_addr":"172.21.15.112:6819/1186206237","heartbeat_back_addr":"172.21.15.112:6823/1186206237","heartbeat_front_addr":"172.21.15.112:6821/1186206237","state":["exists","up"]},{"osd":5,"uuid":"e571e73b-0e9d-417d-b01c-59b651016763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6801","nonce":796623465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6803","nonce":796623465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6807","nonce":796623465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6805","nonce":796623465}]},"public_addr":"172.21.15.112:6801/796623465","cluster_addr":"172.21.15.112:6803/796623465","heartbeat_back_addr":"172.21.15.112:6807/796623465","heartbeat_front_addr":"172.21.15.112:6805/796623465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.174731+0000","dead_epoch":117},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.475467+0000","dead_epoch":205},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.606174+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.835957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.753547+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.284212+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.4","osds":[5,1]},{"pgid":"3.a","osds":[2,5]},{"pgid":"3.16","osds":[4,3]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T08:44:11.195 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T08:44:11.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T08:44:11.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T08:44:11.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T08:44:11.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T08:44:11.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T08:44:11.378 INFO:teuthology.orchestra.run.smithi089.stdout:949187772421 2024-09-14T08:44:11.379 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T08:44:11.388 INFO:teuthology.orchestra.run.smithi089.stdout:55834574914 2024-09-14T08:44:11.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T08:44:11.435 INFO:teuthology.orchestra.run.smithi089.stdout:55834574916 2024-09-14T08:44:11.436 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T08:44:11.436 INFO:teuthology.orchestra.run.smithi089.stdout:51539607619 2024-09-14T08:44:11.437 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T08:44:11.438 INFO:teuthology.orchestra.run.smithi089.stdout:545460846621 2024-09-14T08:44:11.439 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T08:44:11.452 INFO:teuthology.orchestra.run.smithi089.stdout:55834574916 2024-09-14T08:44:11.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T08:44:11.763 INFO:teuthology.orchestra.run.smithi089.stdout:55834574913 2024-09-14T08:44:11.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574914 got 55834574913 for osd.3 2024-09-14T08:44:11.805 INFO:teuthology.orchestra.run.smithi089.stdout:55834574914 2024-09-14T08:44:11.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574914 for osd.4 2024-09-14T08:44:11.848 INFO:teuthology.orchestra.run.smithi089.stdout:949187772420 2024-09-14T08:44:11.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 949187772421 got 949187772420 for osd.1 2024-09-14T08:44:11.919 INFO:teuthology.orchestra.run.smithi089.stdout:545460846620 2024-09-14T08:44:11.921 INFO:teuthology.orchestra.run.smithi089.stdout:51539607617 2024-09-14T08:44:11.921 INFO:teuthology.orchestra.run.smithi089.stdout:55834574914 2024-09-14T08:44:11.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 545460846621 got 545460846620 for osd.0 2024-09-14T08:44:11.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607619 got 51539607617 for osd.5 2024-09-14T08:44:11.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574914 for osd.2 2024-09-14T08:44:12.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T08:44:12.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T08:44:12.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T08:44:12.942 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T08:44:12.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T08:44:12.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T08:44:13.100 INFO:teuthology.orchestra.run.smithi089.stdout:55834574915 2024-09-14T08:44:13.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574914 got 55834574915 for osd.3 2024-09-14T08:44:13.120 DEBUG:teuthology.parallel:result is None 2024-09-14T08:44:13.243 INFO:teuthology.orchestra.run.smithi089.stdout:545460846621 2024-09-14T08:44:13.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 545460846621 got 545460846621 for osd.0 2024-09-14T08:44:13.260 DEBUG:teuthology.parallel:result is None 2024-09-14T08:44:13.268 INFO:teuthology.orchestra.run.smithi089.stdout:55834574916 2024-09-14T08:44:13.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574916 for osd.4 2024-09-14T08:44:13.286 DEBUG:teuthology.parallel:result is None 2024-09-14T08:44:13.308 INFO:teuthology.orchestra.run.smithi089.stdout:949187772422 2024-09-14T08:44:13.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 949187772421 got 949187772422 for osd.1 2024-09-14T08:44:13.325 DEBUG:teuthology.parallel:result is None 2024-09-14T08:44:13.392 INFO:teuthology.orchestra.run.smithi089.stdout:55834574916 2024-09-14T08:44:13.396 INFO:teuthology.orchestra.run.smithi089.stdout:51539607619 2024-09-14T08:44:13.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574916 for osd.2 2024-09-14T08:44:13.413 DEBUG:teuthology.parallel:result is None 2024-09-14T08:44:13.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607619 got 51539607619 for osd.5 2024-09-14T08:44:13.415 DEBUG:teuthology.parallel:result is None 2024-09-14T08:44:13.415 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T08:44:13.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:44:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:44:13.749 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:44:13.765 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-09-14T08:44:12.352839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":472,"num_object_clones":0,"num_object_copies":944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":472,"num_whiteouts":464,"num_read":609890,"num_read_kb":1289084,"num_write":26590,"num_write_kb":296965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11164,"num_bytes_recovered":218429077,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24093,"ondisk_log_size":24093,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":331056,"kb_used_data":17832,"kb_used_omap":70,"kb_used_meta":313017,"kb_avail":565899984,"statfs":{"total":579820584960,"available":579481583616,"internally_reserved":0,"allocated":18259968,"data_stored":8457048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71786,"internal_metadata":320530326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-891,"num_objects_misplaced":-143,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":600,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.960315"},"pg_stats":[{"pgid":"3.1f","version":"217'460","reported_seq":5330,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894001+0000","last_change":"2024-09-14T08:44:08.390806+0000","last_active":"2024-09-14T08:44:10.894001+0000","last_peered":"2024-09-14T08:44:10.894001+0000","last_clean":"2024-09-14T08:44:10.894001+0000","last_became_active":"2024-09-14T08:44:08.389408+0000","last_became_peered":"2024-09-14T08:44:08.389408+0000","last_unstale":"2024-09-14T08:44:10.894001+0000","last_undegraded":"2024-09-14T08:44:10.894001+0000","last_fullsized":"2024-09-14T08:44:10.894001+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:56.620484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016438780000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":3901,"num_read_kb":17036,"num_write":490,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":482,"num_bytes_recovered":8172556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"222'381","reported_seq":30464,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525981+0000","last_change":"2024-09-14T08:44:06.408757+0000","last_active":"2024-09-14T08:44:10.525981+0000","last_peered":"2024-09-14T08:44:10.525981+0000","last_clean":"2024-09-14T08:44:10.525981+0000","last_became_active":"2024-09-14T08:44:06.406436+0000","last_became_peered":"2024-09-14T08:44:06.406436+0000","last_unstale":"2024-09-14T08:44:10.525981+0000","last_undegraded":"2024-09-14T08:44:10.525981+0000","last_fullsized":"2024-09-14T08:44:10.525981+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:37.062114+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.042684857,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":28761,"num_read_kb":35233,"num_write":368,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":355,"num_bytes_recovered":515120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"222'750","reported_seq":8689,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898303+0000","last_change":"2024-09-14T08:44:07.416202+0000","last_active":"2024-09-14T08:44:10.898303+0000","last_peered":"2024-09-14T08:44:10.898303+0000","last_clean":"2024-09-14T08:44:10.898303+0000","last_became_active":"2024-09-14T08:44:07.410893+0000","last_became_peered":"2024-09-14T08:44:07.410893+0000","last_unstale":"2024-09-14T08:44:10.898303+0000","last_undegraded":"2024-09-14T08:44:10.898303+0000","last_fullsized":"2024-09-14T08:44:10.898303+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:26.339107+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.049489020000000002,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":10164,"num_read_kb":40300,"num_write":735,"num_write_kb":5110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":1147934,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"222'760","reported_seq":9287,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898348+0000","last_change":"2024-09-14T08:44:07.422741+0000","last_active":"2024-09-14T08:44:10.898348+0000","last_peered":"2024-09-14T08:44:10.898348+0000","last_clean":"2024-09-14T08:44:10.898348+0000","last_became_active":"2024-09-14T08:44:07.415742+0000","last_became_peered":"2024-09-14T08:44:07.415742+0000","last_unstale":"2024-09-14T08:44:10.898348+0000","last_undegraded":"2024-09-14T08:44:10.898348+0000","last_fullsized":"2024-09-14T08:44:10.898348+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:37.288749+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.059401431999999997,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":15,"num_read":8755,"num_read_kb":53187,"num_write":901,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":3698222,"num_keys_recovered":59,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"215'929","reported_seq":11250,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894125+0000","last_change":"2024-09-14T08:43:39.658480+0000","last_active":"2024-09-14T08:44:10.894125+0000","last_peered":"2024-09-14T08:44:10.894125+0000","last_clean":"2024-09-14T08:44:10.894125+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:44:10.894125+0000","last_undegraded":"2024-09-14T08:44:10.894125+0000","last_fullsized":"2024-09-14T08:44:10.894125+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:14.682609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001641146,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":11941,"num_read_kb":55626,"num_write":963,"num_write_kb":5928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"222'535","reported_seq":12802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897623+0000","last_change":"2024-09-14T08:43:53.753438+0000","last_active":"2024-09-14T08:44:10.897623+0000","last_peered":"2024-09-14T08:44:10.897623+0000","last_clean":"2024-09-14T08:44:10.897623+0000","last_became_active":"2024-09-14T08:43:53.474287+0000","last_became_peered":"2024-09-14T08:43:53.474287+0000","last_unstale":"2024-09-14T08:44:10.897623+0000","last_undegraded":"2024-09-14T08:44:10.897623+0000","last_fullsized":"2024-09-14T08:44:10.897623+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:17.015900+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.058553644000000002,"stat_sum":{"num_bytes":19,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":11827,"num_read_kb":31605,"num_write":546,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":6116492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"222'755","reported_seq":7459,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525223+0000","last_change":"2024-09-14T08:43:53.556657+0000","last_active":"2024-09-14T08:44:10.525223+0000","last_peered":"2024-09-14T08:44:10.525223+0000","last_clean":"2024-09-14T08:44:10.525223+0000","last_became_active":"2024-09-14T08:43:53.452873+0000","last_became_peered":"2024-09-14T08:43:53.452873+0000","last_unstale":"2024-09-14T08:44:10.525223+0000","last_undegraded":"2024-09-14T08:44:10.525223+0000","last_fullsized":"2024-09-14T08:44:10.525223+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:35.049723+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.036162803,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7603,"num_read_kb":22143,"num_write":748,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":3588110,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"214'592","reported_seq":7881,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524932+0000","last_change":"2024-09-14T08:43:39.592789+0000","last_active":"2024-09-14T08:44:10.524932+0000","last_peered":"2024-09-14T08:44:10.524932+0000","last_clean":"2024-09-14T08:44:10.524932+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:44:10.524932+0000","last_undegraded":"2024-09-14T08:44:10.524932+0000","last_fullsized":"2024-09-14T08:44:10.524932+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:25.103017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018468670000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":7942,"num_read_kb":29510,"num_write":481,"num_write_kb":3303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"216'791","reported_seq":7561,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894118+0000","last_change":"2024-09-14T08:44:05.406114+0000","last_active":"2024-09-14T08:44:10.894118+0000","last_peered":"2024-09-14T08:44:10.894118+0000","last_clean":"2024-09-14T08:44:10.894118+0000","last_became_active":"2024-09-14T08:44:05.404094+0000","last_became_peered":"2024-09-14T08:44:05.404094+0000","last_unstale":"2024-09-14T08:44:10.894118+0000","last_undegraded":"2024-09-14T08:44:10.894118+0000","last_fullsized":"2024-09-14T08:44:10.894118+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:04:22.949426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001891085,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":8172,"num_read_kb":36701,"num_write":1066,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":397,"num_bytes_recovered":4642734,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"222'664","reported_seq":7139,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897892+0000","last_change":"2024-09-14T08:44:02.406710+0000","last_active":"2024-09-14T08:44:10.897892+0000","last_peered":"2024-09-14T08:44:10.897892+0000","last_clean":"2024-09-14T08:44:10.897892+0000","last_became_active":"2024-09-14T08:44:02.400561+0000","last_became_peered":"2024-09-14T08:44:02.400561+0000","last_unstale":"2024-09-14T08:44:10.897892+0000","last_undegraded":"2024-09-14T08:44:10.897892+0000","last_fullsized":"2024-09-14T08:44:10.897892+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:44.768637+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050148086000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":31023,"num_read_kb":35394,"num_write":669,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":3628604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"216'1107","reported_seq":8313,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527890+0000","last_change":"2024-09-14T08:44:09.401728+0000","last_active":"2024-09-14T08:44:10.527890+0000","last_peered":"2024-09-14T08:44:10.527890+0000","last_clean":"2024-09-14T08:44:10.527890+0000","last_became_active":"2024-09-14T08:44:09.397717+0000","last_became_peered":"2024-09-14T08:44:09.397717+0000","last_unstale":"2024-09-14T08:44:10.527890+0000","last_undegraded":"2024-09-14T08:44:10.527890+0000","last_fullsized":"2024-09-14T08:44:10.527890+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.117371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371021,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12242,"num_read_kb":26406,"num_write":1299,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":535,"num_bytes_recovered":14245931,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"217'414","reported_seq":33294,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527734+0000","last_change":"2024-09-14T08:44:01.399150+0000","last_active":"2024-09-14T08:44:10.527734+0000","last_peered":"2024-09-14T08:44:10.527734+0000","last_clean":"2024-09-14T08:44:10.527734+0000","last_became_active":"2024-09-14T08:44:01.395419+0000","last_became_peered":"2024-09-14T08:44:01.395419+0000","last_unstale":"2024-09-14T08:44:10.527734+0000","last_undegraded":"2024-09-14T08:44:10.527734+0000","last_fullsized":"2024-09-14T08:44:10.527734+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:46.518606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052741680000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":32260,"num_read_kb":39536,"num_write":469,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":2619100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528347+0000","last_change":"2024-09-14T08:43:59.418934+0000","last_active":"2024-09-14T08:44:10.528347+0000","last_peered":"2024-09-14T08:44:10.528347+0000","last_clean":"2024-09-14T08:44:10.528347+0000","last_became_active":"2024-09-14T08:43:59.412933+0000","last_became_peered":"2024-09-14T08:43:59.412933+0000","last_unstale":"2024-09-14T08:44:10.528347+0000","last_undegraded":"2024-09-14T08:44:10.528347+0000","last_fullsized":"2024-09-14T08:44:10.528347+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:09.547187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"222'2432","reported_seq":59036,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894044+0000","last_change":"2024-09-14T08:43:53.823293+0000","last_active":"2024-09-14T08:44:10.894044+0000","last_peered":"2024-09-14T08:44:10.894044+0000","last_clean":"2024-09-14T08:44:10.894044+0000","last_became_active":"2024-09-14T08:43:53.493591+0000","last_became_peered":"2024-09-14T08:43:53.493591+0000","last_unstale":"2024-09-14T08:44:10.894044+0000","last_undegraded":"2024-09-14T08:44:10.894044+0000","last_fullsized":"2024-09-14T08:44:10.894044+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2432,"log_dups_size":0,"ondisk_log_size":2432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:38.040189+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.066703469000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":67566,"num_read_kb":68156,"num_write":3798,"num_write_kb":9140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":455,"num_bytes_recovered":11715346,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526107+0000","last_change":"2024-09-14T08:43:59.420342+0000","last_active":"2024-09-14T08:44:10.526107+0000","last_peered":"2024-09-14T08:44:10.526107+0000","last_clean":"2024-09-14T08:44:10.526107+0000","last_became_active":"2024-09-14T08:43:59.417188+0000","last_became_peered":"2024-09-14T08:43:59.417188+0000","last_unstale":"2024-09-14T08:44:10.526107+0000","last_undegraded":"2024-09-14T08:44:10.526107+0000","last_fullsized":"2024-09-14T08:44:10.526107+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:19.062815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"222'771","reported_seq":59115,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526084+0000","last_change":"2024-09-14T08:43:53.590126+0000","last_active":"2024-09-14T08:44:10.526084+0000","last_peered":"2024-09-14T08:44:10.526084+0000","last_clean":"2024-09-14T08:44:10.526084+0000","last_became_active":"2024-09-14T08:43:53.485749+0000","last_became_peered":"2024-09-14T08:43:53.485749+0000","last_unstale":"2024-09-14T08:44:10.526084+0000","last_undegraded":"2024-09-14T08:44:10.526084+0000","last_fullsized":"2024-09-14T08:44:10.526084+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:40:38.092608+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.029629143,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":52542,"num_read_kb":50304,"num_write":575,"num_write_kb":32325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":262,"num_bytes_recovered":6496921,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528066+0000","last_change":"2024-09-14T08:43:59.410903+0000","last_active":"2024-09-14T08:44:10.528066+0000","last_peered":"2024-09-14T08:44:10.528066+0000","last_clean":"2024-09-14T08:44:10.528066+0000","last_became_active":"2024-09-14T08:43:59.410081+0000","last_became_peered":"2024-09-14T08:43:59.410081+0000","last_unstale":"2024-09-14T08:44:10.528066+0000","last_undegraded":"2024-09-14T08:44:10.528066+0000","last_fullsized":"2024-09-14T08:44:10.528066+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:07.401067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"222'641","reported_seq":6465,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898822+0000","last_change":"2024-09-14T08:44:07.414796+0000","last_active":"2024-09-14T08:44:10.898822+0000","last_peered":"2024-09-14T08:44:10.898822+0000","last_clean":"2024-09-14T08:44:10.898822+0000","last_became_active":"2024-09-14T08:44:07.405923+0000","last_became_peered":"2024-09-14T08:44:07.405923+0000","last_unstale":"2024-09-14T08:44:10.898822+0000","last_undegraded":"2024-09-14T08:44:10.898822+0000","last_fullsized":"2024-09-14T08:44:10.898822+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:57.074695+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.040351541999999997,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":6460,"num_read_kb":17251,"num_write":625,"num_write_kb":20411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":498,"num_bytes_recovered":6627757,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525679+0000","last_change":"2024-09-14T08:43:53.481113+0000","last_active":"2024-09-14T08:44:10.525679+0000","last_peered":"2024-09-14T08:44:10.525679+0000","last_clean":"2024-09-14T08:44:10.525679+0000","last_became_active":"2024-09-14T08:43:53.480382+0000","last_became_peered":"2024-09-14T08:43:53.480382+0000","last_unstale":"2024-09-14T08:44:10.525679+0000","last_undegraded":"2024-09-14T08:44:10.525679+0000","last_fullsized":"2024-09-14T08:44:10.525679+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:40.958509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"222'805","reported_seq":11063,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898417+0000","last_change":"2024-09-14T08:44:07.411700+0000","last_active":"2024-09-14T08:44:10.898417+0000","last_peered":"2024-09-14T08:44:10.898417+0000","last_clean":"2024-09-14T08:44:10.898417+0000","last_became_active":"2024-09-14T08:44:07.406747+0000","last_became_peered":"2024-09-14T08:44:07.406747+0000","last_unstale":"2024-09-14T08:44:10.898417+0000","last_undegraded":"2024-09-14T08:44:10.898417+0000","last_fullsized":"2024-09-14T08:44:10.898417+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:31.593890+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.034384078999999998,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":11288,"num_read_kb":43310,"num_write":1070,"num_write_kb":21593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":311,"num_bytes_recovered":4578256,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"217'1582","reported_seq":21530,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898225+0000","last_change":"2024-09-14T08:43:39.607463+0000","last_active":"2024-09-14T08:44:10.898225+0000","last_peered":"2024-09-14T08:44:10.898225+0000","last_clean":"2024-09-14T08:44:10.898225+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:44:10.898225+0000","last_undegraded":"2024-09-14T08:44:10.898225+0000","last_fullsized":"2024-09-14T08:44:10.898225+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1582,"log_dups_size":0,"ondisk_log_size":1582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:50.821083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050029469999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":22,"num_read":24909,"num_read_kb":27100,"num_write":2438,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":69,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898104+0000","last_change":"2024-09-14T08:44:07.404347+0000","last_active":"2024-09-14T08:44:10.898104+0000","last_peered":"2024-09-14T08:44:10.898104+0000","last_clean":"2024-09-14T08:44:10.898104+0000","last_became_active":"2024-09-14T08:44:07.403501+0000","last_became_peered":"2024-09-14T08:44:07.403501+0000","last_unstale":"2024-09-14T08:44:10.898104+0000","last_undegraded":"2024-09-14T08:44:10.898104+0000","last_fullsized":"2024-09-14T08:44:10.898104+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:22:14.375160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"222'466","reported_seq":28009,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525210+0000","last_change":"2024-09-14T08:43:53.620465+0000","last_active":"2024-09-14T08:44:10.525210+0000","last_peered":"2024-09-14T08:44:10.525210+0000","last_clean":"2024-09-14T08:44:10.525210+0000","last_became_active":"2024-09-14T08:43:53.464437+0000","last_became_peered":"2024-09-14T08:43:53.464437+0000","last_unstale":"2024-09-14T08:44:10.525210+0000","last_undegraded":"2024-09-14T08:44:10.525210+0000","last_fullsized":"2024-09-14T08:44:10.525210+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:53.362716+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.055535908000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":26972,"num_read_kb":27595,"num_write":457,"num_write_kb":3537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":3380924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":477,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525243+0000","last_change":"2024-09-14T08:43:53.459922+0000","last_active":"2024-09-14T08:44:10.525243+0000","last_peered":"2024-09-14T08:44:10.525243+0000","last_clean":"2024-09-14T08:44:10.525243+0000","last_became_active":"2024-09-14T08:43:53.458867+0000","last_became_peered":"2024-09-14T08:43:53.458867+0000","last_unstale":"2024-09-14T08:44:10.525243+0000","last_undegraded":"2024-09-14T08:44:10.525243+0000","last_fullsized":"2024-09-14T08:44:10.525243+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:58.597461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"214'425","reported_seq":8808,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893899+0000","last_change":"2024-09-14T08:43:39.657773+0000","last_active":"2024-09-14T08:44:10.893899+0000","last_peered":"2024-09-14T08:44:10.893899+0000","last_clean":"2024-09-14T08:44:10.893899+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:44:10.893899+0000","last_undegraded":"2024-09-14T08:44:10.893899+0000","last_fullsized":"2024-09-14T08:44:10.893899+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:15.972399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001097399,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7748,"num_read_kb":16836,"num_write":423,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527639+0000","last_change":"2024-09-14T08:43:59.401455+0000","last_active":"2024-09-14T08:44:10.527639+0000","last_peered":"2024-09-14T08:44:10.527639+0000","last_clean":"2024-09-14T08:44:10.527639+0000","last_became_active":"2024-09-14T08:43:59.398475+0000","last_became_peered":"2024-09-14T08:43:59.398475+0000","last_unstale":"2024-09-14T08:44:10.527639+0000","last_undegraded":"2024-09-14T08:44:10.527639+0000","last_fullsized":"2024-09-14T08:44:10.527639+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:07.678890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"222'533","reported_seq":18802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525614+0000","last_change":"2024-09-14T08:44:03.397964+0000","last_active":"2024-09-14T08:44:10.525614+0000","last_peered":"2024-09-14T08:44:10.525614+0000","last_clean":"2024-09-14T08:44:10.525614+0000","last_became_active":"2024-09-14T08:44:03.395670+0000","last_became_peered":"2024-09-14T08:44:03.395670+0000","last_unstale":"2024-09-14T08:44:10.525614+0000","last_undegraded":"2024-09-14T08:44:10.525614+0000","last_fullsized":"2024-09-14T08:44:10.525614+0000","mapping_epoch":228,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":229,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:11.528255+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.040148494999999999,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":17829,"num_read_kb":57289,"num_write":620,"num_write_kb":6801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":569,"num_bytes_recovered":15227317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":383,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898157+0000","last_change":"2024-09-14T08:44:07.409575+0000","last_active":"2024-09-14T08:44:10.898157+0000","last_peered":"2024-09-14T08:44:10.898157+0000","last_clean":"2024-09-14T08:44:10.898157+0000","last_became_active":"2024-09-14T08:44:07.408549+0000","last_became_peered":"2024-09-14T08:44:07.408549+0000","last_unstale":"2024-09-14T08:44:10.898157+0000","last_undegraded":"2024-09-14T08:44:10.898157+0000","last_fullsized":"2024-09-14T08:44:10.898157+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:28.425168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":39,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527628+0000","last_change":"2024-09-14T08:43:59.432210+0000","last_active":"2024-09-14T08:44:10.527628+0000","last_peered":"2024-09-14T08:44:10.527628+0000","last_clean":"2024-09-14T08:44:10.527628+0000","last_became_active":"2024-09-14T08:43:59.418428+0000","last_became_peered":"2024-09-14T08:43:59.418428+0000","last_unstale":"2024-09-14T08:44:10.527628+0000","last_undegraded":"2024-09-14T08:44:10.527628+0000","last_fullsized":"2024-09-14T08:44:10.527628+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:56:57.805159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"222'613","reported_seq":35728,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524989+0000","last_change":"2024-09-14T08:43:53.686001+0000","last_active":"2024-09-14T08:44:10.524989+0000","last_peered":"2024-09-14T08:44:10.524989+0000","last_clean":"2024-09-14T08:44:10.524989+0000","last_became_active":"2024-09-14T08:43:53.487405+0000","last_became_peered":"2024-09-14T08:43:53.487405+0000","last_unstale":"2024-09-14T08:44:10.524989+0000","last_undegraded":"2024-09-14T08:44:10.524989+0000","last_fullsized":"2024-09-14T08:44:10.524989+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:20.351169+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.024367663000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":33488,"num_read_kb":35878,"num_write":489,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":2364662,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"214'1053","reported_seq":16852,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897513+0000","last_change":"2024-09-14T08:43:39.605741+0000","last_active":"2024-09-14T08:44:10.897513+0000","last_peered":"2024-09-14T08:44:10.897513+0000","last_clean":"2024-09-14T08:44:10.897513+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:44:10.897513+0000","last_undegraded":"2024-09-14T08:44:10.897513+0000","last_fullsized":"2024-09-14T08:44:10.897513+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:59.457424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052773719999999998,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":16233,"num_read_kb":33099,"num_write":859,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"222'681","reported_seq":14472,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525569+0000","last_change":"2024-09-14T08:44:05.402563+0000","last_active":"2024-09-14T08:44:10.525569+0000","last_peered":"2024-09-14T08:44:10.525569+0000","last_clean":"2024-09-14T08:44:10.525569+0000","last_became_active":"2024-09-14T08:44:05.398159+0000","last_became_peered":"2024-09-14T08:44:05.398159+0000","last_unstale":"2024-09-14T08:44:10.525569+0000","last_undegraded":"2024-09-14T08:44:10.525569+0000","last_fullsized":"2024-09-14T08:44:10.525569+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:12.499363+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050530626000000002,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":14875,"num_read_kb":84017,"num_write":659,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":18337410,"num_keys_recovered":105,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"222'658","reported_seq":5999,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525728+0000","last_change":"2024-09-14T08:43:53.646871+0000","last_active":"2024-09-14T08:44:10.525728+0000","last_peered":"2024-09-14T08:44:10.525728+0000","last_clean":"2024-09-14T08:44:10.525728+0000","last_became_active":"2024-09-14T08:43:53.480067+0000","last_became_peered":"2024-09-14T08:43:53.480067+0000","last_unstale":"2024-09-14T08:44:10.525728+0000","last_undegraded":"2024-09-14T08:44:10.525728+0000","last_fullsized":"2024-09-14T08:44:10.525728+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:54.483372+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.051150345999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6328,"num_read_kb":21947,"num_write":820,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":389,"num_bytes_recovered":7762120,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"222'1049","reported_seq":45235,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898566+0000","last_change":"2024-09-14T08:44:07.422801+0000","last_active":"2024-09-14T08:44:10.898566+0000","last_peered":"2024-09-14T08:44:10.898566+0000","last_clean":"2024-09-14T08:44:10.898566+0000","last_became_active":"2024-09-14T08:44:07.414903+0000","last_became_peered":"2024-09-14T08:44:07.414903+0000","last_unstale":"2024-09-14T08:44:10.898566+0000","last_undegraded":"2024-09-14T08:44:10.898566+0000","last_fullsized":"2024-09-14T08:44:10.898566+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.984066+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.068642173000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":49733,"num_read_kb":103295,"num_write":819,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":12466332,"num_keys_recovered":182,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"214'694","reported_seq":8302,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528148+0000","last_change":"2024-09-14T08:44:06.414747+0000","last_active":"2024-09-14T08:44:10.528148+0000","last_peered":"2024-09-14T08:44:10.528148+0000","last_clean":"2024-09-14T08:44:10.528148+0000","last_became_active":"2024-09-14T08:44:06.407599+0000","last_became_peered":"2024-09-14T08:44:06.407599+0000","last_unstale":"2024-09-14T08:44:10.528148+0000","last_undegraded":"2024-09-14T08:44:10.528148+0000","last_fullsized":"2024-09-14T08:44:10.528148+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:09.433157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014175520000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":9196,"num_read_kb":22714,"num_write":526,"num_write_kb":7334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":391,"num_bytes_recovered":6800384,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"222'321","reported_seq":7626,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898657+0000","last_change":"2024-09-14T08:44:07.412670+0000","last_active":"2024-09-14T08:44:10.898657+0000","last_peered":"2024-09-14T08:44:10.898657+0000","last_clean":"2024-09-14T08:44:10.898657+0000","last_became_active":"2024-09-14T08:44:07.408742+0000","last_became_peered":"2024-09-14T08:44:07.408742+0000","last_unstale":"2024-09-14T08:44:10.898657+0000","last_undegraded":"2024-09-14T08:44:10.898657+0000","last_fullsized":"2024-09-14T08:44:10.898657+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:02.288720+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.035863521000000002,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":6541,"num_read_kb":21437,"num_write":285,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":561152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"222'572","reported_seq":10035,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898548+0000","last_change":"2024-09-14T08:44:07.415164+0000","last_active":"2024-09-14T08:44:10.898548+0000","last_peered":"2024-09-14T08:44:10.898548+0000","last_clean":"2024-09-14T08:44:10.898548+0000","last_became_active":"2024-09-14T08:44:07.406874+0000","last_became_peered":"2024-09-14T08:44:07.406874+0000","last_unstale":"2024-09-14T08:44:10.898548+0000","last_undegraded":"2024-09-14T08:44:10.898548+0000","last_fullsized":"2024-09-14T08:44:10.898548+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:38.272726+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053448875,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":7838,"num_read_kb":43795,"num_write":497,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":640,"num_bytes_recovered":25134704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"222'509","reported_seq":20077,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897511+0000","last_change":"2024-09-14T08:44:07.407192+0000","last_active":"2024-09-14T08:44:10.897511+0000","last_peered":"2024-09-14T08:44:10.897511+0000","last_clean":"2024-09-14T08:44:10.897511+0000","last_became_active":"2024-09-14T08:44:07.403507+0000","last_became_peered":"2024-09-14T08:44:07.403507+0000","last_unstale":"2024-09-14T08:44:10.897511+0000","last_undegraded":"2024-09-14T08:44:10.897511+0000","last_fullsized":"2024-09-14T08:44:10.897511+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:16.328502+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.050693604000000003,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20159,"num_read_kb":55886,"num_write":485,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":360,"num_bytes_recovered":2324520,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"214'552","reported_seq":44239,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527808+0000","last_change":"2024-09-14T08:44:08.397958+0000","last_active":"2024-09-14T08:44:10.527808+0000","last_peered":"2024-09-14T08:44:10.527808+0000","last_clean":"2024-09-14T08:44:10.527808+0000","last_became_active":"2024-09-14T08:44:08.392150+0000","last_became_peered":"2024-09-14T08:44:08.392150+0000","last_unstale":"2024-09-14T08:44:10.527808+0000","last_undegraded":"2024-09-14T08:44:10.527808+0000","last_fullsized":"2024-09-14T08:44:10.527808+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:21.006773+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.0046849040000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":44159,"num_read_kb":101736,"num_write":433,"num_write_kb":14207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":14335213,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"222'639","reported_seq":7204,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893897+0000","last_change":"2024-09-14T08:44:09.396495+0000","last_active":"2024-09-14T08:44:10.893897+0000","last_peered":"2024-09-14T08:44:10.893897+0000","last_clean":"2024-09-14T08:44:10.893897+0000","last_became_active":"2024-09-14T08:44:09.394635+0000","last_became_peered":"2024-09-14T08:44:09.394635+0000","last_unstale":"2024-09-14T08:44:10.893897+0000","last_undegraded":"2024-09-14T08:44:10.893897+0000","last_fullsized":"2024-09-14T08:44:10.893897+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:32.203345+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.041958433000000003,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5789,"num_read_kb":20892,"num_write":624,"num_write_kb":8469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":542,"num_bytes_recovered":17076794,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"214'884","reported_seq":4179,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527655+0000","last_change":"2024-09-14T08:44:06.415948+0000","last_active":"2024-09-14T08:44:10.527655+0000","last_peered":"2024-09-14T08:44:10.527655+0000","last_clean":"2024-09-14T08:44:10.527655+0000","last_became_active":"2024-09-14T08:44:06.410917+0000","last_became_peered":"2024-09-14T08:44:06.410917+0000","last_unstale":"2024-09-14T08:44:10.527655+0000","last_undegraded":"2024-09-14T08:44:10.527655+0000","last_fullsized":"2024-09-14T08:44:10.527655+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:53.099036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000881582,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":5580,"num_read_kb":13815,"num_write":1250,"num_write_kb":9128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":379,"num_bytes_recovered":3502437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":464,"num_read":609824,"num_read_kb":1289029,"num_write":26487,"num_write_kb":295335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11149,"num_bytes_recovered":214886831,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30533,"internal_metadata":0},"log_size":24018,"ondisk_log_size":24018,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65900,"kb_used_data":2772,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94305940,"statfs":{"total":96636764160,"available":96569282560,"internally_reserved":0,"allocated":2838528,"data_stored":1209373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52600,"kb_used_data":3360,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319240,"statfs":{"total":96636764160,"available":96582901760,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56180,"kb_used_data":2780,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315660,"statfs":{"total":96636764160,"available":96579235840,"internally_reserved":0,"allocated":2846720,"data_stored":1214382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":221,"seq":949187772422,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":2788,"kb_used_omap":41,"kb_used_meta":30102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":2854912,"data_stored":1214420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42656,"internal_metadata":30824800},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607619,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82548,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94289292,"statfs":{"total":96636764160,"available":96552235008,"internally_reserved":0,"allocated":2850816,"data_stored":1214401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846621,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40872,"kb_used_data":3348,"kb_used_omap":22,"kb_used_meta":37481,"kb_avail":94330968,"statfs":{"total":96636764160,"available":96594911232,"internally_reserved":0,"allocated":3428352,"data_stored":1799722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":38381344},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17459,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:44:13.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:44:14.050 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:44:14.051 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:44:14.067 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-09-14T08:44:12.352839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":472,"num_object_clones":0,"num_object_copies":944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":472,"num_whiteouts":464,"num_read":609890,"num_read_kb":1289084,"num_write":26590,"num_write_kb":296965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11164,"num_bytes_recovered":218429077,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24093,"ondisk_log_size":24093,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":331056,"kb_used_data":17832,"kb_used_omap":70,"kb_used_meta":313017,"kb_avail":565899984,"statfs":{"total":579820584960,"available":579481583616,"internally_reserved":0,"allocated":18259968,"data_stored":8457048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71786,"internal_metadata":320530326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-891,"num_objects_misplaced":-143,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":600,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.960315"},"pg_stats":[{"pgid":"3.1f","version":"217'460","reported_seq":5330,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894001+0000","last_change":"2024-09-14T08:44:08.390806+0000","last_active":"2024-09-14T08:44:10.894001+0000","last_peered":"2024-09-14T08:44:10.894001+0000","last_clean":"2024-09-14T08:44:10.894001+0000","last_became_active":"2024-09-14T08:44:08.389408+0000","last_became_peered":"2024-09-14T08:44:08.389408+0000","last_unstale":"2024-09-14T08:44:10.894001+0000","last_undegraded":"2024-09-14T08:44:10.894001+0000","last_fullsized":"2024-09-14T08:44:10.894001+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:56.620484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016438780000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":3901,"num_read_kb":17036,"num_write":490,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":482,"num_bytes_recovered":8172556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"222'381","reported_seq":30464,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525981+0000","last_change":"2024-09-14T08:44:06.408757+0000","last_active":"2024-09-14T08:44:10.525981+0000","last_peered":"2024-09-14T08:44:10.525981+0000","last_clean":"2024-09-14T08:44:10.525981+0000","last_became_active":"2024-09-14T08:44:06.406436+0000","last_became_peered":"2024-09-14T08:44:06.406436+0000","last_unstale":"2024-09-14T08:44:10.525981+0000","last_undegraded":"2024-09-14T08:44:10.525981+0000","last_fullsized":"2024-09-14T08:44:10.525981+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:37.062114+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.042684857,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":28761,"num_read_kb":35233,"num_write":368,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":355,"num_bytes_recovered":515120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"222'750","reported_seq":8689,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898303+0000","last_change":"2024-09-14T08:44:07.416202+0000","last_active":"2024-09-14T08:44:10.898303+0000","last_peered":"2024-09-14T08:44:10.898303+0000","last_clean":"2024-09-14T08:44:10.898303+0000","last_became_active":"2024-09-14T08:44:07.410893+0000","last_became_peered":"2024-09-14T08:44:07.410893+0000","last_unstale":"2024-09-14T08:44:10.898303+0000","last_undegraded":"2024-09-14T08:44:10.898303+0000","last_fullsized":"2024-09-14T08:44:10.898303+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:26.339107+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.049489020000000002,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":10164,"num_read_kb":40300,"num_write":735,"num_write_kb":5110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":1147934,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"222'760","reported_seq":9287,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898348+0000","last_change":"2024-09-14T08:44:07.422741+0000","last_active":"2024-09-14T08:44:10.898348+0000","last_peered":"2024-09-14T08:44:10.898348+0000","last_clean":"2024-09-14T08:44:10.898348+0000","last_became_active":"2024-09-14T08:44:07.415742+0000","last_became_peered":"2024-09-14T08:44:07.415742+0000","last_unstale":"2024-09-14T08:44:10.898348+0000","last_undegraded":"2024-09-14T08:44:10.898348+0000","last_fullsized":"2024-09-14T08:44:10.898348+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:37.288749+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.059401431999999997,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":15,"num_read":8755,"num_read_kb":53187,"num_write":901,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":3698222,"num_keys_recovered":59,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"215'929","reported_seq":11250,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894125+0000","last_change":"2024-09-14T08:43:39.658480+0000","last_active":"2024-09-14T08:44:10.894125+0000","last_peered":"2024-09-14T08:44:10.894125+0000","last_clean":"2024-09-14T08:44:10.894125+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:44:10.894125+0000","last_undegraded":"2024-09-14T08:44:10.894125+0000","last_fullsized":"2024-09-14T08:44:10.894125+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:14.682609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001641146,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":11941,"num_read_kb":55626,"num_write":963,"num_write_kb":5928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"222'535","reported_seq":12802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897623+0000","last_change":"2024-09-14T08:43:53.753438+0000","last_active":"2024-09-14T08:44:10.897623+0000","last_peered":"2024-09-14T08:44:10.897623+0000","last_clean":"2024-09-14T08:44:10.897623+0000","last_became_active":"2024-09-14T08:43:53.474287+0000","last_became_peered":"2024-09-14T08:43:53.474287+0000","last_unstale":"2024-09-14T08:44:10.897623+0000","last_undegraded":"2024-09-14T08:44:10.897623+0000","last_fullsized":"2024-09-14T08:44:10.897623+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:17.015900+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.058553644000000002,"stat_sum":{"num_bytes":19,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":11827,"num_read_kb":31605,"num_write":546,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":6116492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"222'755","reported_seq":7459,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525223+0000","last_change":"2024-09-14T08:43:53.556657+0000","last_active":"2024-09-14T08:44:10.525223+0000","last_peered":"2024-09-14T08:44:10.525223+0000","last_clean":"2024-09-14T08:44:10.525223+0000","last_became_active":"2024-09-14T08:43:53.452873+0000","last_became_peered":"2024-09-14T08:43:53.452873+0000","last_unstale":"2024-09-14T08:44:10.525223+0000","last_undegraded":"2024-09-14T08:44:10.525223+0000","last_fullsized":"2024-09-14T08:44:10.525223+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:35.049723+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.036162803,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7603,"num_read_kb":22143,"num_write":748,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":3588110,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"214'592","reported_seq":7881,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524932+0000","last_change":"2024-09-14T08:43:39.592789+0000","last_active":"2024-09-14T08:44:10.524932+0000","last_peered":"2024-09-14T08:44:10.524932+0000","last_clean":"2024-09-14T08:44:10.524932+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:44:10.524932+0000","last_undegraded":"2024-09-14T08:44:10.524932+0000","last_fullsized":"2024-09-14T08:44:10.524932+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:25.103017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018468670000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":7942,"num_read_kb":29510,"num_write":481,"num_write_kb":3303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"216'791","reported_seq":7561,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894118+0000","last_change":"2024-09-14T08:44:05.406114+0000","last_active":"2024-09-14T08:44:10.894118+0000","last_peered":"2024-09-14T08:44:10.894118+0000","last_clean":"2024-09-14T08:44:10.894118+0000","last_became_active":"2024-09-14T08:44:05.404094+0000","last_became_peered":"2024-09-14T08:44:05.404094+0000","last_unstale":"2024-09-14T08:44:10.894118+0000","last_undegraded":"2024-09-14T08:44:10.894118+0000","last_fullsized":"2024-09-14T08:44:10.894118+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:04:22.949426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001891085,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":8172,"num_read_kb":36701,"num_write":1066,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":397,"num_bytes_recovered":4642734,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"222'664","reported_seq":7139,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897892+0000","last_change":"2024-09-14T08:44:02.406710+0000","last_active":"2024-09-14T08:44:10.897892+0000","last_peered":"2024-09-14T08:44:10.897892+0000","last_clean":"2024-09-14T08:44:10.897892+0000","last_became_active":"2024-09-14T08:44:02.400561+0000","last_became_peered":"2024-09-14T08:44:02.400561+0000","last_unstale":"2024-09-14T08:44:10.897892+0000","last_undegraded":"2024-09-14T08:44:10.897892+0000","last_fullsized":"2024-09-14T08:44:10.897892+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:44.768637+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050148086000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":31023,"num_read_kb":35394,"num_write":669,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":3628604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"216'1107","reported_seq":8313,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527890+0000","last_change":"2024-09-14T08:44:09.401728+0000","last_active":"2024-09-14T08:44:10.527890+0000","last_peered":"2024-09-14T08:44:10.527890+0000","last_clean":"2024-09-14T08:44:10.527890+0000","last_became_active":"2024-09-14T08:44:09.397717+0000","last_became_peered":"2024-09-14T08:44:09.397717+0000","last_unstale":"2024-09-14T08:44:10.527890+0000","last_undegraded":"2024-09-14T08:44:10.527890+0000","last_fullsized":"2024-09-14T08:44:10.527890+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.117371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371021,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12242,"num_read_kb":26406,"num_write":1299,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":535,"num_bytes_recovered":14245931,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"217'414","reported_seq":33294,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527734+0000","last_change":"2024-09-14T08:44:01.399150+0000","last_active":"2024-09-14T08:44:10.527734+0000","last_peered":"2024-09-14T08:44:10.527734+0000","last_clean":"2024-09-14T08:44:10.527734+0000","last_became_active":"2024-09-14T08:44:01.395419+0000","last_became_peered":"2024-09-14T08:44:01.395419+0000","last_unstale":"2024-09-14T08:44:10.527734+0000","last_undegraded":"2024-09-14T08:44:10.527734+0000","last_fullsized":"2024-09-14T08:44:10.527734+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:46.518606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052741680000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":32260,"num_read_kb":39536,"num_write":469,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":2619100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528347+0000","last_change":"2024-09-14T08:43:59.418934+0000","last_active":"2024-09-14T08:44:10.528347+0000","last_peered":"2024-09-14T08:44:10.528347+0000","last_clean":"2024-09-14T08:44:10.528347+0000","last_became_active":"2024-09-14T08:43:59.412933+0000","last_became_peered":"2024-09-14T08:43:59.412933+0000","last_unstale":"2024-09-14T08:44:10.528347+0000","last_undegraded":"2024-09-14T08:44:10.528347+0000","last_fullsized":"2024-09-14T08:44:10.528347+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:09.547187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"222'2432","reported_seq":59036,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894044+0000","last_change":"2024-09-14T08:43:53.823293+0000","last_active":"2024-09-14T08:44:10.894044+0000","last_peered":"2024-09-14T08:44:10.894044+0000","last_clean":"2024-09-14T08:44:10.894044+0000","last_became_active":"2024-09-14T08:43:53.493591+0000","last_became_peered":"2024-09-14T08:43:53.493591+0000","last_unstale":"2024-09-14T08:44:10.894044+0000","last_undegraded":"2024-09-14T08:44:10.894044+0000","last_fullsized":"2024-09-14T08:44:10.894044+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2432,"log_dups_size":0,"ondisk_log_size":2432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:38.040189+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.066703469000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":67566,"num_read_kb":68156,"num_write":3798,"num_write_kb":9140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":455,"num_bytes_recovered":11715346,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526107+0000","last_change":"2024-09-14T08:43:59.420342+0000","last_active":"2024-09-14T08:44:10.526107+0000","last_peered":"2024-09-14T08:44:10.526107+0000","last_clean":"2024-09-14T08:44:10.526107+0000","last_became_active":"2024-09-14T08:43:59.417188+0000","last_became_peered":"2024-09-14T08:43:59.417188+0000","last_unstale":"2024-09-14T08:44:10.526107+0000","last_undegraded":"2024-09-14T08:44:10.526107+0000","last_fullsized":"2024-09-14T08:44:10.526107+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:19.062815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"222'771","reported_seq":59115,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526084+0000","last_change":"2024-09-14T08:43:53.590126+0000","last_active":"2024-09-14T08:44:10.526084+0000","last_peered":"2024-09-14T08:44:10.526084+0000","last_clean":"2024-09-14T08:44:10.526084+0000","last_became_active":"2024-09-14T08:43:53.485749+0000","last_became_peered":"2024-09-14T08:43:53.485749+0000","last_unstale":"2024-09-14T08:44:10.526084+0000","last_undegraded":"2024-09-14T08:44:10.526084+0000","last_fullsized":"2024-09-14T08:44:10.526084+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:40:38.092608+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.029629143,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":52542,"num_read_kb":50304,"num_write":575,"num_write_kb":32325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":262,"num_bytes_recovered":6496921,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528066+0000","last_change":"2024-09-14T08:43:59.410903+0000","last_active":"2024-09-14T08:44:10.528066+0000","last_peered":"2024-09-14T08:44:10.528066+0000","last_clean":"2024-09-14T08:44:10.528066+0000","last_became_active":"2024-09-14T08:43:59.410081+0000","last_became_peered":"2024-09-14T08:43:59.410081+0000","last_unstale":"2024-09-14T08:44:10.528066+0000","last_undegraded":"2024-09-14T08:44:10.528066+0000","last_fullsized":"2024-09-14T08:44:10.528066+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:07.401067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"222'641","reported_seq":6465,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898822+0000","last_change":"2024-09-14T08:44:07.414796+0000","last_active":"2024-09-14T08:44:10.898822+0000","last_peered":"2024-09-14T08:44:10.898822+0000","last_clean":"2024-09-14T08:44:10.898822+0000","last_became_active":"2024-09-14T08:44:07.405923+0000","last_became_peered":"2024-09-14T08:44:07.405923+0000","last_unstale":"2024-09-14T08:44:10.898822+0000","last_undegraded":"2024-09-14T08:44:10.898822+0000","last_fullsized":"2024-09-14T08:44:10.898822+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:57.074695+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.040351541999999997,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":6460,"num_read_kb":17251,"num_write":625,"num_write_kb":20411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":498,"num_bytes_recovered":6627757,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525679+0000","last_change":"2024-09-14T08:43:53.481113+0000","last_active":"2024-09-14T08:44:10.525679+0000","last_peered":"2024-09-14T08:44:10.525679+0000","last_clean":"2024-09-14T08:44:10.525679+0000","last_became_active":"2024-09-14T08:43:53.480382+0000","last_became_peered":"2024-09-14T08:43:53.480382+0000","last_unstale":"2024-09-14T08:44:10.525679+0000","last_undegraded":"2024-09-14T08:44:10.525679+0000","last_fullsized":"2024-09-14T08:44:10.525679+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:40.958509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"222'805","reported_seq":11063,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898417+0000","last_change":"2024-09-14T08:44:07.411700+0000","last_active":"2024-09-14T08:44:10.898417+0000","last_peered":"2024-09-14T08:44:10.898417+0000","last_clean":"2024-09-14T08:44:10.898417+0000","last_became_active":"2024-09-14T08:44:07.406747+0000","last_became_peered":"2024-09-14T08:44:07.406747+0000","last_unstale":"2024-09-14T08:44:10.898417+0000","last_undegraded":"2024-09-14T08:44:10.898417+0000","last_fullsized":"2024-09-14T08:44:10.898417+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:31.593890+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.034384078999999998,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":11288,"num_read_kb":43310,"num_write":1070,"num_write_kb":21593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":311,"num_bytes_recovered":4578256,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"217'1582","reported_seq":21530,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898225+0000","last_change":"2024-09-14T08:43:39.607463+0000","last_active":"2024-09-14T08:44:10.898225+0000","last_peered":"2024-09-14T08:44:10.898225+0000","last_clean":"2024-09-14T08:44:10.898225+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:44:10.898225+0000","last_undegraded":"2024-09-14T08:44:10.898225+0000","last_fullsized":"2024-09-14T08:44:10.898225+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1582,"log_dups_size":0,"ondisk_log_size":1582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:50.821083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050029469999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":22,"num_read":24909,"num_read_kb":27100,"num_write":2438,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":69,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898104+0000","last_change":"2024-09-14T08:44:07.404347+0000","last_active":"2024-09-14T08:44:10.898104+0000","last_peered":"2024-09-14T08:44:10.898104+0000","last_clean":"2024-09-14T08:44:10.898104+0000","last_became_active":"2024-09-14T08:44:07.403501+0000","last_became_peered":"2024-09-14T08:44:07.403501+0000","last_unstale":"2024-09-14T08:44:10.898104+0000","last_undegraded":"2024-09-14T08:44:10.898104+0000","last_fullsized":"2024-09-14T08:44:10.898104+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:22:14.375160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"222'466","reported_seq":28009,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525210+0000","last_change":"2024-09-14T08:43:53.620465+0000","last_active":"2024-09-14T08:44:10.525210+0000","last_peered":"2024-09-14T08:44:10.525210+0000","last_clean":"2024-09-14T08:44:10.525210+0000","last_became_active":"2024-09-14T08:43:53.464437+0000","last_became_peered":"2024-09-14T08:43:53.464437+0000","last_unstale":"2024-09-14T08:44:10.525210+0000","last_undegraded":"2024-09-14T08:44:10.525210+0000","last_fullsized":"2024-09-14T08:44:10.525210+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:53.362716+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.055535908000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":26972,"num_read_kb":27595,"num_write":457,"num_write_kb":3537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":3380924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":477,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525243+0000","last_change":"2024-09-14T08:43:53.459922+0000","last_active":"2024-09-14T08:44:10.525243+0000","last_peered":"2024-09-14T08:44:10.525243+0000","last_clean":"2024-09-14T08:44:10.525243+0000","last_became_active":"2024-09-14T08:43:53.458867+0000","last_became_peered":"2024-09-14T08:43:53.458867+0000","last_unstale":"2024-09-14T08:44:10.525243+0000","last_undegraded":"2024-09-14T08:44:10.525243+0000","last_fullsized":"2024-09-14T08:44:10.525243+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:58.597461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"214'425","reported_seq":8808,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893899+0000","last_change":"2024-09-14T08:43:39.657773+0000","last_active":"2024-09-14T08:44:10.893899+0000","last_peered":"2024-09-14T08:44:10.893899+0000","last_clean":"2024-09-14T08:44:10.893899+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:44:10.893899+0000","last_undegraded":"2024-09-14T08:44:10.893899+0000","last_fullsized":"2024-09-14T08:44:10.893899+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:15.972399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001097399,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7748,"num_read_kb":16836,"num_write":423,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527639+0000","last_change":"2024-09-14T08:43:59.401455+0000","last_active":"2024-09-14T08:44:10.527639+0000","last_peered":"2024-09-14T08:44:10.527639+0000","last_clean":"2024-09-14T08:44:10.527639+0000","last_became_active":"2024-09-14T08:43:59.398475+0000","last_became_peered":"2024-09-14T08:43:59.398475+0000","last_unstale":"2024-09-14T08:44:10.527639+0000","last_undegraded":"2024-09-14T08:44:10.527639+0000","last_fullsized":"2024-09-14T08:44:10.527639+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:07.678890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"222'533","reported_seq":18802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525614+0000","last_change":"2024-09-14T08:44:03.397964+0000","last_active":"2024-09-14T08:44:10.525614+0000","last_peered":"2024-09-14T08:44:10.525614+0000","last_clean":"2024-09-14T08:44:10.525614+0000","last_became_active":"2024-09-14T08:44:03.395670+0000","last_became_peered":"2024-09-14T08:44:03.395670+0000","last_unstale":"2024-09-14T08:44:10.525614+0000","last_undegraded":"2024-09-14T08:44:10.525614+0000","last_fullsized":"2024-09-14T08:44:10.525614+0000","mapping_epoch":228,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":229,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:11.528255+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.040148494999999999,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":17829,"num_read_kb":57289,"num_write":620,"num_write_kb":6801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":569,"num_bytes_recovered":15227317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":383,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898157+0000","last_change":"2024-09-14T08:44:07.409575+0000","last_active":"2024-09-14T08:44:10.898157+0000","last_peered":"2024-09-14T08:44:10.898157+0000","last_clean":"2024-09-14T08:44:10.898157+0000","last_became_active":"2024-09-14T08:44:07.408549+0000","last_became_peered":"2024-09-14T08:44:07.408549+0000","last_unstale":"2024-09-14T08:44:10.898157+0000","last_undegraded":"2024-09-14T08:44:10.898157+0000","last_fullsized":"2024-09-14T08:44:10.898157+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:28.425168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":39,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527628+0000","last_change":"2024-09-14T08:43:59.432210+0000","last_active":"2024-09-14T08:44:10.527628+0000","last_peered":"2024-09-14T08:44:10.527628+0000","last_clean":"2024-09-14T08:44:10.527628+0000","last_became_active":"2024-09-14T08:43:59.418428+0000","last_became_peered":"2024-09-14T08:43:59.418428+0000","last_unstale":"2024-09-14T08:44:10.527628+0000","last_undegraded":"2024-09-14T08:44:10.527628+0000","last_fullsized":"2024-09-14T08:44:10.527628+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:56:57.805159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"222'613","reported_seq":35728,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524989+0000","last_change":"2024-09-14T08:43:53.686001+0000","last_active":"2024-09-14T08:44:10.524989+0000","last_peered":"2024-09-14T08:44:10.524989+0000","last_clean":"2024-09-14T08:44:10.524989+0000","last_became_active":"2024-09-14T08:43:53.487405+0000","last_became_peered":"2024-09-14T08:43:53.487405+0000","last_unstale":"2024-09-14T08:44:10.524989+0000","last_undegraded":"2024-09-14T08:44:10.524989+0000","last_fullsized":"2024-09-14T08:44:10.524989+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:20.351169+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.024367663000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":33488,"num_read_kb":35878,"num_write":489,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":2364662,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"214'1053","reported_seq":16852,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897513+0000","last_change":"2024-09-14T08:43:39.605741+0000","last_active":"2024-09-14T08:44:10.897513+0000","last_peered":"2024-09-14T08:44:10.897513+0000","last_clean":"2024-09-14T08:44:10.897513+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:44:10.897513+0000","last_undegraded":"2024-09-14T08:44:10.897513+0000","last_fullsized":"2024-09-14T08:44:10.897513+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:59.457424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052773719999999998,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":16233,"num_read_kb":33099,"num_write":859,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"222'681","reported_seq":14472,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525569+0000","last_change":"2024-09-14T08:44:05.402563+0000","last_active":"2024-09-14T08:44:10.525569+0000","last_peered":"2024-09-14T08:44:10.525569+0000","last_clean":"2024-09-14T08:44:10.525569+0000","last_became_active":"2024-09-14T08:44:05.398159+0000","last_became_peered":"2024-09-14T08:44:05.398159+0000","last_unstale":"2024-09-14T08:44:10.525569+0000","last_undegraded":"2024-09-14T08:44:10.525569+0000","last_fullsized":"2024-09-14T08:44:10.525569+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:12.499363+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050530626000000002,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":14875,"num_read_kb":84017,"num_write":659,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":18337410,"num_keys_recovered":105,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"222'658","reported_seq":5999,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525728+0000","last_change":"2024-09-14T08:43:53.646871+0000","last_active":"2024-09-14T08:44:10.525728+0000","last_peered":"2024-09-14T08:44:10.525728+0000","last_clean":"2024-09-14T08:44:10.525728+0000","last_became_active":"2024-09-14T08:43:53.480067+0000","last_became_peered":"2024-09-14T08:43:53.480067+0000","last_unstale":"2024-09-14T08:44:10.525728+0000","last_undegraded":"2024-09-14T08:44:10.525728+0000","last_fullsized":"2024-09-14T08:44:10.525728+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:54.483372+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.051150345999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6328,"num_read_kb":21947,"num_write":820,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":389,"num_bytes_recovered":7762120,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"222'1049","reported_seq":45235,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898566+0000","last_change":"2024-09-14T08:44:07.422801+0000","last_active":"2024-09-14T08:44:10.898566+0000","last_peered":"2024-09-14T08:44:10.898566+0000","last_clean":"2024-09-14T08:44:10.898566+0000","last_became_active":"2024-09-14T08:44:07.414903+0000","last_became_peered":"2024-09-14T08:44:07.414903+0000","last_unstale":"2024-09-14T08:44:10.898566+0000","last_undegraded":"2024-09-14T08:44:10.898566+0000","last_fullsized":"2024-09-14T08:44:10.898566+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.984066+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.068642173000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":49733,"num_read_kb":103295,"num_write":819,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":12466332,"num_keys_recovered":182,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"214'694","reported_seq":8302,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528148+0000","last_change":"2024-09-14T08:44:06.414747+0000","last_active":"2024-09-14T08:44:10.528148+0000","last_peered":"2024-09-14T08:44:10.528148+0000","last_clean":"2024-09-14T08:44:10.528148+0000","last_became_active":"2024-09-14T08:44:06.407599+0000","last_became_peered":"2024-09-14T08:44:06.407599+0000","last_unstale":"2024-09-14T08:44:10.528148+0000","last_undegraded":"2024-09-14T08:44:10.528148+0000","last_fullsized":"2024-09-14T08:44:10.528148+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:09.433157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014175520000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":9196,"num_read_kb":22714,"num_write":526,"num_write_kb":7334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":391,"num_bytes_recovered":6800384,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"222'321","reported_seq":7626,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898657+0000","last_change":"2024-09-14T08:44:07.412670+0000","last_active":"2024-09-14T08:44:10.898657+0000","last_peered":"2024-09-14T08:44:10.898657+0000","last_clean":"2024-09-14T08:44:10.898657+0000","last_became_active":"2024-09-14T08:44:07.408742+0000","last_became_peered":"2024-09-14T08:44:07.408742+0000","last_unstale":"2024-09-14T08:44:10.898657+0000","last_undegraded":"2024-09-14T08:44:10.898657+0000","last_fullsized":"2024-09-14T08:44:10.898657+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:02.288720+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.035863521000000002,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":6541,"num_read_kb":21437,"num_write":285,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":561152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"222'572","reported_seq":10035,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898548+0000","last_change":"2024-09-14T08:44:07.415164+0000","last_active":"2024-09-14T08:44:10.898548+0000","last_peered":"2024-09-14T08:44:10.898548+0000","last_clean":"2024-09-14T08:44:10.898548+0000","last_became_active":"2024-09-14T08:44:07.406874+0000","last_became_peered":"2024-09-14T08:44:07.406874+0000","last_unstale":"2024-09-14T08:44:10.898548+0000","last_undegraded":"2024-09-14T08:44:10.898548+0000","last_fullsized":"2024-09-14T08:44:10.898548+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:38.272726+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053448875,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":7838,"num_read_kb":43795,"num_write":497,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":640,"num_bytes_recovered":25134704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"222'509","reported_seq":20077,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897511+0000","last_change":"2024-09-14T08:44:07.407192+0000","last_active":"2024-09-14T08:44:10.897511+0000","last_peered":"2024-09-14T08:44:10.897511+0000","last_clean":"2024-09-14T08:44:10.897511+0000","last_became_active":"2024-09-14T08:44:07.403507+0000","last_became_peered":"2024-09-14T08:44:07.403507+0000","last_unstale":"2024-09-14T08:44:10.897511+0000","last_undegraded":"2024-09-14T08:44:10.897511+0000","last_fullsized":"2024-09-14T08:44:10.897511+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:16.328502+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.050693604000000003,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20159,"num_read_kb":55886,"num_write":485,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":360,"num_bytes_recovered":2324520,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"214'552","reported_seq":44239,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527808+0000","last_change":"2024-09-14T08:44:08.397958+0000","last_active":"2024-09-14T08:44:10.527808+0000","last_peered":"2024-09-14T08:44:10.527808+0000","last_clean":"2024-09-14T08:44:10.527808+0000","last_became_active":"2024-09-14T08:44:08.392150+0000","last_became_peered":"2024-09-14T08:44:08.392150+0000","last_unstale":"2024-09-14T08:44:10.527808+0000","last_undegraded":"2024-09-14T08:44:10.527808+0000","last_fullsized":"2024-09-14T08:44:10.527808+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:21.006773+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.0046849040000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":44159,"num_read_kb":101736,"num_write":433,"num_write_kb":14207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":14335213,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"222'639","reported_seq":7204,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893897+0000","last_change":"2024-09-14T08:44:09.396495+0000","last_active":"2024-09-14T08:44:10.893897+0000","last_peered":"2024-09-14T08:44:10.893897+0000","last_clean":"2024-09-14T08:44:10.893897+0000","last_became_active":"2024-09-14T08:44:09.394635+0000","last_became_peered":"2024-09-14T08:44:09.394635+0000","last_unstale":"2024-09-14T08:44:10.893897+0000","last_undegraded":"2024-09-14T08:44:10.893897+0000","last_fullsized":"2024-09-14T08:44:10.893897+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:32.203345+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.041958433000000003,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5789,"num_read_kb":20892,"num_write":624,"num_write_kb":8469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":542,"num_bytes_recovered":17076794,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"214'884","reported_seq":4179,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527655+0000","last_change":"2024-09-14T08:44:06.415948+0000","last_active":"2024-09-14T08:44:10.527655+0000","last_peered":"2024-09-14T08:44:10.527655+0000","last_clean":"2024-09-14T08:44:10.527655+0000","last_became_active":"2024-09-14T08:44:06.410917+0000","last_became_peered":"2024-09-14T08:44:06.410917+0000","last_unstale":"2024-09-14T08:44:10.527655+0000","last_undegraded":"2024-09-14T08:44:10.527655+0000","last_fullsized":"2024-09-14T08:44:10.527655+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:53.099036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000881582,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":5580,"num_read_kb":13815,"num_write":1250,"num_write_kb":9128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":379,"num_bytes_recovered":3502437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":464,"num_read":609824,"num_read_kb":1289029,"num_write":26487,"num_write_kb":295335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11149,"num_bytes_recovered":214886831,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30533,"internal_metadata":0},"log_size":24018,"ondisk_log_size":24018,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65900,"kb_used_data":2772,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94305940,"statfs":{"total":96636764160,"available":96569282560,"internally_reserved":0,"allocated":2838528,"data_stored":1209373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52600,"kb_used_data":3360,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319240,"statfs":{"total":96636764160,"available":96582901760,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56180,"kb_used_data":2780,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315660,"statfs":{"total":96636764160,"available":96579235840,"internally_reserved":0,"allocated":2846720,"data_stored":1214382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":221,"seq":949187772422,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":2788,"kb_used_omap":41,"kb_used_meta":30102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":2854912,"data_stored":1214420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42656,"internal_metadata":30824800},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607619,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82548,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94289292,"statfs":{"total":96636764160,"available":96552235008,"internally_reserved":0,"allocated":2850816,"data_stored":1214401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846621,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40872,"kb_used_data":3348,"kb_used_omap":22,"kb_used_meta":37481,"kb_avail":94330968,"statfs":{"total":96636764160,"available":96594911232,"internally_reserved":0,"allocated":3428352,"data_stored":1799722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":38381344},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17459,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:44:14.069 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T08:44:14.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-14T08:44:14.374 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T08:44:14.384 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T08:44:14.384 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:44:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:44:14.682 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:44:14.698 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-09-14T08:44:14.353555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":472,"num_object_clones":0,"num_object_copies":944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":472,"num_whiteouts":464,"num_read":609890,"num_read_kb":1289084,"num_write":26590,"num_write_kb":296965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11164,"num_bytes_recovered":218429077,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24093,"ondisk_log_size":24093,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":331072,"kb_used_data":17844,"kb_used_omap":70,"kb_used_meta":313017,"kb_avail":565899968,"statfs":{"total":579820584960,"available":579481567232,"internally_reserved":0,"allocated":18272256,"data_stored":8462076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71786,"internal_metadata":320530326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-891,"num_objects_misplaced":-143,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":600,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002051"},"pg_stats":[{"pgid":"3.1f","version":"217'460","reported_seq":5330,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894001+0000","last_change":"2024-09-14T08:44:08.390806+0000","last_active":"2024-09-14T08:44:10.894001+0000","last_peered":"2024-09-14T08:44:10.894001+0000","last_clean":"2024-09-14T08:44:10.894001+0000","last_became_active":"2024-09-14T08:44:08.389408+0000","last_became_peered":"2024-09-14T08:44:08.389408+0000","last_unstale":"2024-09-14T08:44:10.894001+0000","last_undegraded":"2024-09-14T08:44:10.894001+0000","last_fullsized":"2024-09-14T08:44:10.894001+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:56.620484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016438780000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":3901,"num_read_kb":17036,"num_write":490,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":482,"num_bytes_recovered":8172556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"222'381","reported_seq":30464,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525981+0000","last_change":"2024-09-14T08:44:06.408757+0000","last_active":"2024-09-14T08:44:10.525981+0000","last_peered":"2024-09-14T08:44:10.525981+0000","last_clean":"2024-09-14T08:44:10.525981+0000","last_became_active":"2024-09-14T08:44:06.406436+0000","last_became_peered":"2024-09-14T08:44:06.406436+0000","last_unstale":"2024-09-14T08:44:10.525981+0000","last_undegraded":"2024-09-14T08:44:10.525981+0000","last_fullsized":"2024-09-14T08:44:10.525981+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:37.062114+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.042684857,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":28761,"num_read_kb":35233,"num_write":368,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":355,"num_bytes_recovered":515120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"222'750","reported_seq":8689,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898303+0000","last_change":"2024-09-14T08:44:07.416202+0000","last_active":"2024-09-14T08:44:10.898303+0000","last_peered":"2024-09-14T08:44:10.898303+0000","last_clean":"2024-09-14T08:44:10.898303+0000","last_became_active":"2024-09-14T08:44:07.410893+0000","last_became_peered":"2024-09-14T08:44:07.410893+0000","last_unstale":"2024-09-14T08:44:10.898303+0000","last_undegraded":"2024-09-14T08:44:10.898303+0000","last_fullsized":"2024-09-14T08:44:10.898303+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:26.339107+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.049489020000000002,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":10164,"num_read_kb":40300,"num_write":735,"num_write_kb":5110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":1147934,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"222'760","reported_seq":9287,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898348+0000","last_change":"2024-09-14T08:44:07.422741+0000","last_active":"2024-09-14T08:44:10.898348+0000","last_peered":"2024-09-14T08:44:10.898348+0000","last_clean":"2024-09-14T08:44:10.898348+0000","last_became_active":"2024-09-14T08:44:07.415742+0000","last_became_peered":"2024-09-14T08:44:07.415742+0000","last_unstale":"2024-09-14T08:44:10.898348+0000","last_undegraded":"2024-09-14T08:44:10.898348+0000","last_fullsized":"2024-09-14T08:44:10.898348+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:37.288749+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.059401431999999997,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":15,"num_read":8755,"num_read_kb":53187,"num_write":901,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":3698222,"num_keys_recovered":59,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"215'929","reported_seq":11250,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894125+0000","last_change":"2024-09-14T08:43:39.658480+0000","last_active":"2024-09-14T08:44:10.894125+0000","last_peered":"2024-09-14T08:44:10.894125+0000","last_clean":"2024-09-14T08:44:10.894125+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:44:10.894125+0000","last_undegraded":"2024-09-14T08:44:10.894125+0000","last_fullsized":"2024-09-14T08:44:10.894125+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:14.682609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001641146,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":11941,"num_read_kb":55626,"num_write":963,"num_write_kb":5928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"222'535","reported_seq":12802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897623+0000","last_change":"2024-09-14T08:43:53.753438+0000","last_active":"2024-09-14T08:44:10.897623+0000","last_peered":"2024-09-14T08:44:10.897623+0000","last_clean":"2024-09-14T08:44:10.897623+0000","last_became_active":"2024-09-14T08:43:53.474287+0000","last_became_peered":"2024-09-14T08:43:53.474287+0000","last_unstale":"2024-09-14T08:44:10.897623+0000","last_undegraded":"2024-09-14T08:44:10.897623+0000","last_fullsized":"2024-09-14T08:44:10.897623+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:17.015900+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.058553644000000002,"stat_sum":{"num_bytes":19,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":11827,"num_read_kb":31605,"num_write":546,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":6116492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"222'755","reported_seq":7459,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525223+0000","last_change":"2024-09-14T08:43:53.556657+0000","last_active":"2024-09-14T08:44:10.525223+0000","last_peered":"2024-09-14T08:44:10.525223+0000","last_clean":"2024-09-14T08:44:10.525223+0000","last_became_active":"2024-09-14T08:43:53.452873+0000","last_became_peered":"2024-09-14T08:43:53.452873+0000","last_unstale":"2024-09-14T08:44:10.525223+0000","last_undegraded":"2024-09-14T08:44:10.525223+0000","last_fullsized":"2024-09-14T08:44:10.525223+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:35.049723+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.036162803,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7603,"num_read_kb":22143,"num_write":748,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":3588110,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"214'592","reported_seq":7881,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524932+0000","last_change":"2024-09-14T08:43:39.592789+0000","last_active":"2024-09-14T08:44:10.524932+0000","last_peered":"2024-09-14T08:44:10.524932+0000","last_clean":"2024-09-14T08:44:10.524932+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:44:10.524932+0000","last_undegraded":"2024-09-14T08:44:10.524932+0000","last_fullsized":"2024-09-14T08:44:10.524932+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:25.103017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018468670000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":7942,"num_read_kb":29510,"num_write":481,"num_write_kb":3303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"216'791","reported_seq":7561,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894118+0000","last_change":"2024-09-14T08:44:05.406114+0000","last_active":"2024-09-14T08:44:10.894118+0000","last_peered":"2024-09-14T08:44:10.894118+0000","last_clean":"2024-09-14T08:44:10.894118+0000","last_became_active":"2024-09-14T08:44:05.404094+0000","last_became_peered":"2024-09-14T08:44:05.404094+0000","last_unstale":"2024-09-14T08:44:10.894118+0000","last_undegraded":"2024-09-14T08:44:10.894118+0000","last_fullsized":"2024-09-14T08:44:10.894118+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:04:22.949426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001891085,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":8172,"num_read_kb":36701,"num_write":1066,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":397,"num_bytes_recovered":4642734,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"222'664","reported_seq":7139,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897892+0000","last_change":"2024-09-14T08:44:02.406710+0000","last_active":"2024-09-14T08:44:10.897892+0000","last_peered":"2024-09-14T08:44:10.897892+0000","last_clean":"2024-09-14T08:44:10.897892+0000","last_became_active":"2024-09-14T08:44:02.400561+0000","last_became_peered":"2024-09-14T08:44:02.400561+0000","last_unstale":"2024-09-14T08:44:10.897892+0000","last_undegraded":"2024-09-14T08:44:10.897892+0000","last_fullsized":"2024-09-14T08:44:10.897892+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:44.768637+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050148086000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":31023,"num_read_kb":35394,"num_write":669,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":3628604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"216'1107","reported_seq":8313,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527890+0000","last_change":"2024-09-14T08:44:09.401728+0000","last_active":"2024-09-14T08:44:10.527890+0000","last_peered":"2024-09-14T08:44:10.527890+0000","last_clean":"2024-09-14T08:44:10.527890+0000","last_became_active":"2024-09-14T08:44:09.397717+0000","last_became_peered":"2024-09-14T08:44:09.397717+0000","last_unstale":"2024-09-14T08:44:10.527890+0000","last_undegraded":"2024-09-14T08:44:10.527890+0000","last_fullsized":"2024-09-14T08:44:10.527890+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.117371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371021,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12242,"num_read_kb":26406,"num_write":1299,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":535,"num_bytes_recovered":14245931,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"217'414","reported_seq":33294,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527734+0000","last_change":"2024-09-14T08:44:01.399150+0000","last_active":"2024-09-14T08:44:10.527734+0000","last_peered":"2024-09-14T08:44:10.527734+0000","last_clean":"2024-09-14T08:44:10.527734+0000","last_became_active":"2024-09-14T08:44:01.395419+0000","last_became_peered":"2024-09-14T08:44:01.395419+0000","last_unstale":"2024-09-14T08:44:10.527734+0000","last_undegraded":"2024-09-14T08:44:10.527734+0000","last_fullsized":"2024-09-14T08:44:10.527734+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:46.518606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052741680000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":32260,"num_read_kb":39536,"num_write":469,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":2619100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528347+0000","last_change":"2024-09-14T08:43:59.418934+0000","last_active":"2024-09-14T08:44:10.528347+0000","last_peered":"2024-09-14T08:44:10.528347+0000","last_clean":"2024-09-14T08:44:10.528347+0000","last_became_active":"2024-09-14T08:43:59.412933+0000","last_became_peered":"2024-09-14T08:43:59.412933+0000","last_unstale":"2024-09-14T08:44:10.528347+0000","last_undegraded":"2024-09-14T08:44:10.528347+0000","last_fullsized":"2024-09-14T08:44:10.528347+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:09.547187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"222'2432","reported_seq":59036,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894044+0000","last_change":"2024-09-14T08:43:53.823293+0000","last_active":"2024-09-14T08:44:10.894044+0000","last_peered":"2024-09-14T08:44:10.894044+0000","last_clean":"2024-09-14T08:44:10.894044+0000","last_became_active":"2024-09-14T08:43:53.493591+0000","last_became_peered":"2024-09-14T08:43:53.493591+0000","last_unstale":"2024-09-14T08:44:10.894044+0000","last_undegraded":"2024-09-14T08:44:10.894044+0000","last_fullsized":"2024-09-14T08:44:10.894044+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2432,"log_dups_size":0,"ondisk_log_size":2432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:38.040189+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.066703469000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":67566,"num_read_kb":68156,"num_write":3798,"num_write_kb":9140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":455,"num_bytes_recovered":11715346,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526107+0000","last_change":"2024-09-14T08:43:59.420342+0000","last_active":"2024-09-14T08:44:10.526107+0000","last_peered":"2024-09-14T08:44:10.526107+0000","last_clean":"2024-09-14T08:44:10.526107+0000","last_became_active":"2024-09-14T08:43:59.417188+0000","last_became_peered":"2024-09-14T08:43:59.417188+0000","last_unstale":"2024-09-14T08:44:10.526107+0000","last_undegraded":"2024-09-14T08:44:10.526107+0000","last_fullsized":"2024-09-14T08:44:10.526107+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:19.062815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"222'771","reported_seq":59115,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526084+0000","last_change":"2024-09-14T08:43:53.590126+0000","last_active":"2024-09-14T08:44:10.526084+0000","last_peered":"2024-09-14T08:44:10.526084+0000","last_clean":"2024-09-14T08:44:10.526084+0000","last_became_active":"2024-09-14T08:43:53.485749+0000","last_became_peered":"2024-09-14T08:43:53.485749+0000","last_unstale":"2024-09-14T08:44:10.526084+0000","last_undegraded":"2024-09-14T08:44:10.526084+0000","last_fullsized":"2024-09-14T08:44:10.526084+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:40:38.092608+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.029629143,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":52542,"num_read_kb":50304,"num_write":575,"num_write_kb":32325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":262,"num_bytes_recovered":6496921,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528066+0000","last_change":"2024-09-14T08:43:59.410903+0000","last_active":"2024-09-14T08:44:10.528066+0000","last_peered":"2024-09-14T08:44:10.528066+0000","last_clean":"2024-09-14T08:44:10.528066+0000","last_became_active":"2024-09-14T08:43:59.410081+0000","last_became_peered":"2024-09-14T08:43:59.410081+0000","last_unstale":"2024-09-14T08:44:10.528066+0000","last_undegraded":"2024-09-14T08:44:10.528066+0000","last_fullsized":"2024-09-14T08:44:10.528066+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:07.401067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"222'641","reported_seq":6465,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898822+0000","last_change":"2024-09-14T08:44:07.414796+0000","last_active":"2024-09-14T08:44:10.898822+0000","last_peered":"2024-09-14T08:44:10.898822+0000","last_clean":"2024-09-14T08:44:10.898822+0000","last_became_active":"2024-09-14T08:44:07.405923+0000","last_became_peered":"2024-09-14T08:44:07.405923+0000","last_unstale":"2024-09-14T08:44:10.898822+0000","last_undegraded":"2024-09-14T08:44:10.898822+0000","last_fullsized":"2024-09-14T08:44:10.898822+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:57.074695+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.040351541999999997,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":6460,"num_read_kb":17251,"num_write":625,"num_write_kb":20411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":498,"num_bytes_recovered":6627757,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525679+0000","last_change":"2024-09-14T08:43:53.481113+0000","last_active":"2024-09-14T08:44:10.525679+0000","last_peered":"2024-09-14T08:44:10.525679+0000","last_clean":"2024-09-14T08:44:10.525679+0000","last_became_active":"2024-09-14T08:43:53.480382+0000","last_became_peered":"2024-09-14T08:43:53.480382+0000","last_unstale":"2024-09-14T08:44:10.525679+0000","last_undegraded":"2024-09-14T08:44:10.525679+0000","last_fullsized":"2024-09-14T08:44:10.525679+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:40.958509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"222'805","reported_seq":11063,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898417+0000","last_change":"2024-09-14T08:44:07.411700+0000","last_active":"2024-09-14T08:44:10.898417+0000","last_peered":"2024-09-14T08:44:10.898417+0000","last_clean":"2024-09-14T08:44:10.898417+0000","last_became_active":"2024-09-14T08:44:07.406747+0000","last_became_peered":"2024-09-14T08:44:07.406747+0000","last_unstale":"2024-09-14T08:44:10.898417+0000","last_undegraded":"2024-09-14T08:44:10.898417+0000","last_fullsized":"2024-09-14T08:44:10.898417+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:31.593890+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.034384078999999998,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":11288,"num_read_kb":43310,"num_write":1070,"num_write_kb":21593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":311,"num_bytes_recovered":4578256,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"217'1582","reported_seq":21530,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898225+0000","last_change":"2024-09-14T08:43:39.607463+0000","last_active":"2024-09-14T08:44:10.898225+0000","last_peered":"2024-09-14T08:44:10.898225+0000","last_clean":"2024-09-14T08:44:10.898225+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:44:10.898225+0000","last_undegraded":"2024-09-14T08:44:10.898225+0000","last_fullsized":"2024-09-14T08:44:10.898225+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1582,"log_dups_size":0,"ondisk_log_size":1582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:50.821083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050029469999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":22,"num_read":24909,"num_read_kb":27100,"num_write":2438,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":69,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898104+0000","last_change":"2024-09-14T08:44:07.404347+0000","last_active":"2024-09-14T08:44:10.898104+0000","last_peered":"2024-09-14T08:44:10.898104+0000","last_clean":"2024-09-14T08:44:10.898104+0000","last_became_active":"2024-09-14T08:44:07.403501+0000","last_became_peered":"2024-09-14T08:44:07.403501+0000","last_unstale":"2024-09-14T08:44:10.898104+0000","last_undegraded":"2024-09-14T08:44:10.898104+0000","last_fullsized":"2024-09-14T08:44:10.898104+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:22:14.375160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"222'466","reported_seq":28009,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525210+0000","last_change":"2024-09-14T08:43:53.620465+0000","last_active":"2024-09-14T08:44:10.525210+0000","last_peered":"2024-09-14T08:44:10.525210+0000","last_clean":"2024-09-14T08:44:10.525210+0000","last_became_active":"2024-09-14T08:43:53.464437+0000","last_became_peered":"2024-09-14T08:43:53.464437+0000","last_unstale":"2024-09-14T08:44:10.525210+0000","last_undegraded":"2024-09-14T08:44:10.525210+0000","last_fullsized":"2024-09-14T08:44:10.525210+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:53.362716+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.055535908000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":26972,"num_read_kb":27595,"num_write":457,"num_write_kb":3537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":3380924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":477,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525243+0000","last_change":"2024-09-14T08:43:53.459922+0000","last_active":"2024-09-14T08:44:10.525243+0000","last_peered":"2024-09-14T08:44:10.525243+0000","last_clean":"2024-09-14T08:44:10.525243+0000","last_became_active":"2024-09-14T08:43:53.458867+0000","last_became_peered":"2024-09-14T08:43:53.458867+0000","last_unstale":"2024-09-14T08:44:10.525243+0000","last_undegraded":"2024-09-14T08:44:10.525243+0000","last_fullsized":"2024-09-14T08:44:10.525243+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:58.597461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"214'425","reported_seq":8808,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893899+0000","last_change":"2024-09-14T08:43:39.657773+0000","last_active":"2024-09-14T08:44:10.893899+0000","last_peered":"2024-09-14T08:44:10.893899+0000","last_clean":"2024-09-14T08:44:10.893899+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:44:10.893899+0000","last_undegraded":"2024-09-14T08:44:10.893899+0000","last_fullsized":"2024-09-14T08:44:10.893899+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:15.972399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001097399,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7748,"num_read_kb":16836,"num_write":423,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527639+0000","last_change":"2024-09-14T08:43:59.401455+0000","last_active":"2024-09-14T08:44:10.527639+0000","last_peered":"2024-09-14T08:44:10.527639+0000","last_clean":"2024-09-14T08:44:10.527639+0000","last_became_active":"2024-09-14T08:43:59.398475+0000","last_became_peered":"2024-09-14T08:43:59.398475+0000","last_unstale":"2024-09-14T08:44:10.527639+0000","last_undegraded":"2024-09-14T08:44:10.527639+0000","last_fullsized":"2024-09-14T08:44:10.527639+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:07.678890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"222'533","reported_seq":18802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525614+0000","last_change":"2024-09-14T08:44:03.397964+0000","last_active":"2024-09-14T08:44:10.525614+0000","last_peered":"2024-09-14T08:44:10.525614+0000","last_clean":"2024-09-14T08:44:10.525614+0000","last_became_active":"2024-09-14T08:44:03.395670+0000","last_became_peered":"2024-09-14T08:44:03.395670+0000","last_unstale":"2024-09-14T08:44:10.525614+0000","last_undegraded":"2024-09-14T08:44:10.525614+0000","last_fullsized":"2024-09-14T08:44:10.525614+0000","mapping_epoch":228,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":229,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:11.528255+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.040148494999999999,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":17829,"num_read_kb":57289,"num_write":620,"num_write_kb":6801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":569,"num_bytes_recovered":15227317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":383,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898157+0000","last_change":"2024-09-14T08:44:07.409575+0000","last_active":"2024-09-14T08:44:10.898157+0000","last_peered":"2024-09-14T08:44:10.898157+0000","last_clean":"2024-09-14T08:44:10.898157+0000","last_became_active":"2024-09-14T08:44:07.408549+0000","last_became_peered":"2024-09-14T08:44:07.408549+0000","last_unstale":"2024-09-14T08:44:10.898157+0000","last_undegraded":"2024-09-14T08:44:10.898157+0000","last_fullsized":"2024-09-14T08:44:10.898157+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:28.425168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":39,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527628+0000","last_change":"2024-09-14T08:43:59.432210+0000","last_active":"2024-09-14T08:44:10.527628+0000","last_peered":"2024-09-14T08:44:10.527628+0000","last_clean":"2024-09-14T08:44:10.527628+0000","last_became_active":"2024-09-14T08:43:59.418428+0000","last_became_peered":"2024-09-14T08:43:59.418428+0000","last_unstale":"2024-09-14T08:44:10.527628+0000","last_undegraded":"2024-09-14T08:44:10.527628+0000","last_fullsized":"2024-09-14T08:44:10.527628+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:56:57.805159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"222'613","reported_seq":35728,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524989+0000","last_change":"2024-09-14T08:43:53.686001+0000","last_active":"2024-09-14T08:44:10.524989+0000","last_peered":"2024-09-14T08:44:10.524989+0000","last_clean":"2024-09-14T08:44:10.524989+0000","last_became_active":"2024-09-14T08:43:53.487405+0000","last_became_peered":"2024-09-14T08:43:53.487405+0000","last_unstale":"2024-09-14T08:44:10.524989+0000","last_undegraded":"2024-09-14T08:44:10.524989+0000","last_fullsized":"2024-09-14T08:44:10.524989+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:20.351169+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.024367663000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":33488,"num_read_kb":35878,"num_write":489,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":2364662,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"214'1053","reported_seq":16852,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897513+0000","last_change":"2024-09-14T08:43:39.605741+0000","last_active":"2024-09-14T08:44:10.897513+0000","last_peered":"2024-09-14T08:44:10.897513+0000","last_clean":"2024-09-14T08:44:10.897513+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:44:10.897513+0000","last_undegraded":"2024-09-14T08:44:10.897513+0000","last_fullsized":"2024-09-14T08:44:10.897513+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:59.457424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052773719999999998,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":16233,"num_read_kb":33099,"num_write":859,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"222'681","reported_seq":14472,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525569+0000","last_change":"2024-09-14T08:44:05.402563+0000","last_active":"2024-09-14T08:44:10.525569+0000","last_peered":"2024-09-14T08:44:10.525569+0000","last_clean":"2024-09-14T08:44:10.525569+0000","last_became_active":"2024-09-14T08:44:05.398159+0000","last_became_peered":"2024-09-14T08:44:05.398159+0000","last_unstale":"2024-09-14T08:44:10.525569+0000","last_undegraded":"2024-09-14T08:44:10.525569+0000","last_fullsized":"2024-09-14T08:44:10.525569+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:12.499363+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050530626000000002,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":14875,"num_read_kb":84017,"num_write":659,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":18337410,"num_keys_recovered":105,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"222'658","reported_seq":5999,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525728+0000","last_change":"2024-09-14T08:43:53.646871+0000","last_active":"2024-09-14T08:44:10.525728+0000","last_peered":"2024-09-14T08:44:10.525728+0000","last_clean":"2024-09-14T08:44:10.525728+0000","last_became_active":"2024-09-14T08:43:53.480067+0000","last_became_peered":"2024-09-14T08:43:53.480067+0000","last_unstale":"2024-09-14T08:44:10.525728+0000","last_undegraded":"2024-09-14T08:44:10.525728+0000","last_fullsized":"2024-09-14T08:44:10.525728+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:54.483372+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.051150345999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6328,"num_read_kb":21947,"num_write":820,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":389,"num_bytes_recovered":7762120,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"222'1049","reported_seq":45235,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898566+0000","last_change":"2024-09-14T08:44:07.422801+0000","last_active":"2024-09-14T08:44:10.898566+0000","last_peered":"2024-09-14T08:44:10.898566+0000","last_clean":"2024-09-14T08:44:10.898566+0000","last_became_active":"2024-09-14T08:44:07.414903+0000","last_became_peered":"2024-09-14T08:44:07.414903+0000","last_unstale":"2024-09-14T08:44:10.898566+0000","last_undegraded":"2024-09-14T08:44:10.898566+0000","last_fullsized":"2024-09-14T08:44:10.898566+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.984066+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.068642173000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":49733,"num_read_kb":103295,"num_write":819,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":12466332,"num_keys_recovered":182,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"214'694","reported_seq":8302,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528148+0000","last_change":"2024-09-14T08:44:06.414747+0000","last_active":"2024-09-14T08:44:10.528148+0000","last_peered":"2024-09-14T08:44:10.528148+0000","last_clean":"2024-09-14T08:44:10.528148+0000","last_became_active":"2024-09-14T08:44:06.407599+0000","last_became_peered":"2024-09-14T08:44:06.407599+0000","last_unstale":"2024-09-14T08:44:10.528148+0000","last_undegraded":"2024-09-14T08:44:10.528148+0000","last_fullsized":"2024-09-14T08:44:10.528148+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:09.433157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014175520000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":9196,"num_read_kb":22714,"num_write":526,"num_write_kb":7334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":391,"num_bytes_recovered":6800384,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"222'321","reported_seq":7626,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898657+0000","last_change":"2024-09-14T08:44:07.412670+0000","last_active":"2024-09-14T08:44:10.898657+0000","last_peered":"2024-09-14T08:44:10.898657+0000","last_clean":"2024-09-14T08:44:10.898657+0000","last_became_active":"2024-09-14T08:44:07.408742+0000","last_became_peered":"2024-09-14T08:44:07.408742+0000","last_unstale":"2024-09-14T08:44:10.898657+0000","last_undegraded":"2024-09-14T08:44:10.898657+0000","last_fullsized":"2024-09-14T08:44:10.898657+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:02.288720+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.035863521000000002,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":6541,"num_read_kb":21437,"num_write":285,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":561152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"222'572","reported_seq":10035,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898548+0000","last_change":"2024-09-14T08:44:07.415164+0000","last_active":"2024-09-14T08:44:10.898548+0000","last_peered":"2024-09-14T08:44:10.898548+0000","last_clean":"2024-09-14T08:44:10.898548+0000","last_became_active":"2024-09-14T08:44:07.406874+0000","last_became_peered":"2024-09-14T08:44:07.406874+0000","last_unstale":"2024-09-14T08:44:10.898548+0000","last_undegraded":"2024-09-14T08:44:10.898548+0000","last_fullsized":"2024-09-14T08:44:10.898548+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:38.272726+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053448875,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":7838,"num_read_kb":43795,"num_write":497,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":640,"num_bytes_recovered":25134704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"222'509","reported_seq":20077,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897511+0000","last_change":"2024-09-14T08:44:07.407192+0000","last_active":"2024-09-14T08:44:10.897511+0000","last_peered":"2024-09-14T08:44:10.897511+0000","last_clean":"2024-09-14T08:44:10.897511+0000","last_became_active":"2024-09-14T08:44:07.403507+0000","last_became_peered":"2024-09-14T08:44:07.403507+0000","last_unstale":"2024-09-14T08:44:10.897511+0000","last_undegraded":"2024-09-14T08:44:10.897511+0000","last_fullsized":"2024-09-14T08:44:10.897511+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:16.328502+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.050693604000000003,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20159,"num_read_kb":55886,"num_write":485,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":360,"num_bytes_recovered":2324520,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"214'552","reported_seq":44239,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527808+0000","last_change":"2024-09-14T08:44:08.397958+0000","last_active":"2024-09-14T08:44:10.527808+0000","last_peered":"2024-09-14T08:44:10.527808+0000","last_clean":"2024-09-14T08:44:10.527808+0000","last_became_active":"2024-09-14T08:44:08.392150+0000","last_became_peered":"2024-09-14T08:44:08.392150+0000","last_unstale":"2024-09-14T08:44:10.527808+0000","last_undegraded":"2024-09-14T08:44:10.527808+0000","last_fullsized":"2024-09-14T08:44:10.527808+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:21.006773+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.0046849040000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":44159,"num_read_kb":101736,"num_write":433,"num_write_kb":14207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":14335213,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"222'639","reported_seq":7204,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893897+0000","last_change":"2024-09-14T08:44:09.396495+0000","last_active":"2024-09-14T08:44:10.893897+0000","last_peered":"2024-09-14T08:44:10.893897+0000","last_clean":"2024-09-14T08:44:10.893897+0000","last_became_active":"2024-09-14T08:44:09.394635+0000","last_became_peered":"2024-09-14T08:44:09.394635+0000","last_unstale":"2024-09-14T08:44:10.893897+0000","last_undegraded":"2024-09-14T08:44:10.893897+0000","last_fullsized":"2024-09-14T08:44:10.893897+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:32.203345+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.041958433000000003,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5789,"num_read_kb":20892,"num_write":624,"num_write_kb":8469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":542,"num_bytes_recovered":17076794,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"214'884","reported_seq":4179,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527655+0000","last_change":"2024-09-14T08:44:06.415948+0000","last_active":"2024-09-14T08:44:10.527655+0000","last_peered":"2024-09-14T08:44:10.527655+0000","last_clean":"2024-09-14T08:44:10.527655+0000","last_became_active":"2024-09-14T08:44:06.410917+0000","last_became_peered":"2024-09-14T08:44:06.410917+0000","last_unstale":"2024-09-14T08:44:10.527655+0000","last_undegraded":"2024-09-14T08:44:10.527655+0000","last_fullsized":"2024-09-14T08:44:10.527655+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:53.099036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000881582,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":5580,"num_read_kb":13815,"num_write":1250,"num_write_kb":9128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":379,"num_bytes_recovered":3502437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":464,"num_read":609824,"num_read_kb":1289029,"num_write":26487,"num_write_kb":295335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11149,"num_bytes_recovered":214886831,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30533,"internal_metadata":0},"log_size":24018,"ondisk_log_size":24018,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65900,"kb_used_data":2772,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94305940,"statfs":{"total":96636764160,"available":96569282560,"internally_reserved":0,"allocated":2838528,"data_stored":1209373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52600,"kb_used_data":3360,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319240,"statfs":{"total":96636764160,"available":96582901760,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56180,"kb_used_data":2780,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315660,"statfs":{"total":96636764160,"available":96579235840,"internally_reserved":0,"allocated":2846720,"data_stored":1214382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":221,"seq":949187772422,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":2788,"kb_used_omap":41,"kb_used_meta":30102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":2854912,"data_stored":1214420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42656,"internal_metadata":30824800},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607619,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82548,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94289292,"statfs":{"total":96636764160,"available":96552235008,"internally_reserved":0,"allocated":2850816,"data_stored":1214401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846622,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40888,"kb_used_data":3360,"kb_used_omap":22,"kb_used_meta":37481,"kb_avail":94330952,"statfs":{"total":96636764160,"available":96594894848,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":38381344},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17459,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:44:14.701 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:44:14.979 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:44:14.995 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-09-14T08:44:14.353555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":472,"num_object_clones":0,"num_object_copies":944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":472,"num_whiteouts":464,"num_read":609890,"num_read_kb":1289084,"num_write":26590,"num_write_kb":296965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11164,"num_bytes_recovered":218429077,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24093,"ondisk_log_size":24093,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":331072,"kb_used_data":17844,"kb_used_omap":70,"kb_used_meta":313017,"kb_avail":565899968,"statfs":{"total":579820584960,"available":579481567232,"internally_reserved":0,"allocated":18272256,"data_stored":8462076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71786,"internal_metadata":320530326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-891,"num_objects_misplaced":-143,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":600,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002051"},"pg_stats":[{"pgid":"3.1f","version":"217'460","reported_seq":5330,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894001+0000","last_change":"2024-09-14T08:44:08.390806+0000","last_active":"2024-09-14T08:44:10.894001+0000","last_peered":"2024-09-14T08:44:10.894001+0000","last_clean":"2024-09-14T08:44:10.894001+0000","last_became_active":"2024-09-14T08:44:08.389408+0000","last_became_peered":"2024-09-14T08:44:08.389408+0000","last_unstale":"2024-09-14T08:44:10.894001+0000","last_undegraded":"2024-09-14T08:44:10.894001+0000","last_fullsized":"2024-09-14T08:44:10.894001+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:56.620484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016438780000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":3901,"num_read_kb":17036,"num_write":490,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":482,"num_bytes_recovered":8172556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"222'381","reported_seq":30464,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525981+0000","last_change":"2024-09-14T08:44:06.408757+0000","last_active":"2024-09-14T08:44:10.525981+0000","last_peered":"2024-09-14T08:44:10.525981+0000","last_clean":"2024-09-14T08:44:10.525981+0000","last_became_active":"2024-09-14T08:44:06.406436+0000","last_became_peered":"2024-09-14T08:44:06.406436+0000","last_unstale":"2024-09-14T08:44:10.525981+0000","last_undegraded":"2024-09-14T08:44:10.525981+0000","last_fullsized":"2024-09-14T08:44:10.525981+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:37.062114+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.042684857,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":28761,"num_read_kb":35233,"num_write":368,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":355,"num_bytes_recovered":515120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"222'750","reported_seq":8689,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898303+0000","last_change":"2024-09-14T08:44:07.416202+0000","last_active":"2024-09-14T08:44:10.898303+0000","last_peered":"2024-09-14T08:44:10.898303+0000","last_clean":"2024-09-14T08:44:10.898303+0000","last_became_active":"2024-09-14T08:44:07.410893+0000","last_became_peered":"2024-09-14T08:44:07.410893+0000","last_unstale":"2024-09-14T08:44:10.898303+0000","last_undegraded":"2024-09-14T08:44:10.898303+0000","last_fullsized":"2024-09-14T08:44:10.898303+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:26.339107+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.049489020000000002,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":10164,"num_read_kb":40300,"num_write":735,"num_write_kb":5110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":1147934,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"222'760","reported_seq":9287,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898348+0000","last_change":"2024-09-14T08:44:07.422741+0000","last_active":"2024-09-14T08:44:10.898348+0000","last_peered":"2024-09-14T08:44:10.898348+0000","last_clean":"2024-09-14T08:44:10.898348+0000","last_became_active":"2024-09-14T08:44:07.415742+0000","last_became_peered":"2024-09-14T08:44:07.415742+0000","last_unstale":"2024-09-14T08:44:10.898348+0000","last_undegraded":"2024-09-14T08:44:10.898348+0000","last_fullsized":"2024-09-14T08:44:10.898348+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:37.288749+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.059401431999999997,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":15,"num_read":8755,"num_read_kb":53187,"num_write":901,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":3698222,"num_keys_recovered":59,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"215'929","reported_seq":11250,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894125+0000","last_change":"2024-09-14T08:43:39.658480+0000","last_active":"2024-09-14T08:44:10.894125+0000","last_peered":"2024-09-14T08:44:10.894125+0000","last_clean":"2024-09-14T08:44:10.894125+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:44:10.894125+0000","last_undegraded":"2024-09-14T08:44:10.894125+0000","last_fullsized":"2024-09-14T08:44:10.894125+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:14.682609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001641146,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":11941,"num_read_kb":55626,"num_write":963,"num_write_kb":5928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"222'535","reported_seq":12802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897623+0000","last_change":"2024-09-14T08:43:53.753438+0000","last_active":"2024-09-14T08:44:10.897623+0000","last_peered":"2024-09-14T08:44:10.897623+0000","last_clean":"2024-09-14T08:44:10.897623+0000","last_became_active":"2024-09-14T08:43:53.474287+0000","last_became_peered":"2024-09-14T08:43:53.474287+0000","last_unstale":"2024-09-14T08:44:10.897623+0000","last_undegraded":"2024-09-14T08:44:10.897623+0000","last_fullsized":"2024-09-14T08:44:10.897623+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:17.015900+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.058553644000000002,"stat_sum":{"num_bytes":19,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":11827,"num_read_kb":31605,"num_write":546,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":6116492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"222'755","reported_seq":7459,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525223+0000","last_change":"2024-09-14T08:43:53.556657+0000","last_active":"2024-09-14T08:44:10.525223+0000","last_peered":"2024-09-14T08:44:10.525223+0000","last_clean":"2024-09-14T08:44:10.525223+0000","last_became_active":"2024-09-14T08:43:53.452873+0000","last_became_peered":"2024-09-14T08:43:53.452873+0000","last_unstale":"2024-09-14T08:44:10.525223+0000","last_undegraded":"2024-09-14T08:44:10.525223+0000","last_fullsized":"2024-09-14T08:44:10.525223+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:35.049723+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.036162803,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7603,"num_read_kb":22143,"num_write":748,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":3588110,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"214'592","reported_seq":7881,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524932+0000","last_change":"2024-09-14T08:43:39.592789+0000","last_active":"2024-09-14T08:44:10.524932+0000","last_peered":"2024-09-14T08:44:10.524932+0000","last_clean":"2024-09-14T08:44:10.524932+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:44:10.524932+0000","last_undegraded":"2024-09-14T08:44:10.524932+0000","last_fullsized":"2024-09-14T08:44:10.524932+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:25.103017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018468670000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":7942,"num_read_kb":29510,"num_write":481,"num_write_kb":3303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"216'791","reported_seq":7561,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894118+0000","last_change":"2024-09-14T08:44:05.406114+0000","last_active":"2024-09-14T08:44:10.894118+0000","last_peered":"2024-09-14T08:44:10.894118+0000","last_clean":"2024-09-14T08:44:10.894118+0000","last_became_active":"2024-09-14T08:44:05.404094+0000","last_became_peered":"2024-09-14T08:44:05.404094+0000","last_unstale":"2024-09-14T08:44:10.894118+0000","last_undegraded":"2024-09-14T08:44:10.894118+0000","last_fullsized":"2024-09-14T08:44:10.894118+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:04:22.949426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001891085,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":8172,"num_read_kb":36701,"num_write":1066,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":397,"num_bytes_recovered":4642734,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"222'664","reported_seq":7139,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897892+0000","last_change":"2024-09-14T08:44:02.406710+0000","last_active":"2024-09-14T08:44:10.897892+0000","last_peered":"2024-09-14T08:44:10.897892+0000","last_clean":"2024-09-14T08:44:10.897892+0000","last_became_active":"2024-09-14T08:44:02.400561+0000","last_became_peered":"2024-09-14T08:44:02.400561+0000","last_unstale":"2024-09-14T08:44:10.897892+0000","last_undegraded":"2024-09-14T08:44:10.897892+0000","last_fullsized":"2024-09-14T08:44:10.897892+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:44.768637+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050148086000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":31023,"num_read_kb":35394,"num_write":669,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":3628604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"216'1107","reported_seq":8313,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527890+0000","last_change":"2024-09-14T08:44:09.401728+0000","last_active":"2024-09-14T08:44:10.527890+0000","last_peered":"2024-09-14T08:44:10.527890+0000","last_clean":"2024-09-14T08:44:10.527890+0000","last_became_active":"2024-09-14T08:44:09.397717+0000","last_became_peered":"2024-09-14T08:44:09.397717+0000","last_unstale":"2024-09-14T08:44:10.527890+0000","last_undegraded":"2024-09-14T08:44:10.527890+0000","last_fullsized":"2024-09-14T08:44:10.527890+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.117371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371021,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12242,"num_read_kb":26406,"num_write":1299,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":535,"num_bytes_recovered":14245931,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"217'414","reported_seq":33294,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527734+0000","last_change":"2024-09-14T08:44:01.399150+0000","last_active":"2024-09-14T08:44:10.527734+0000","last_peered":"2024-09-14T08:44:10.527734+0000","last_clean":"2024-09-14T08:44:10.527734+0000","last_became_active":"2024-09-14T08:44:01.395419+0000","last_became_peered":"2024-09-14T08:44:01.395419+0000","last_unstale":"2024-09-14T08:44:10.527734+0000","last_undegraded":"2024-09-14T08:44:10.527734+0000","last_fullsized":"2024-09-14T08:44:10.527734+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:46.518606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052741680000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":32260,"num_read_kb":39536,"num_write":469,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":2619100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528347+0000","last_change":"2024-09-14T08:43:59.418934+0000","last_active":"2024-09-14T08:44:10.528347+0000","last_peered":"2024-09-14T08:44:10.528347+0000","last_clean":"2024-09-14T08:44:10.528347+0000","last_became_active":"2024-09-14T08:43:59.412933+0000","last_became_peered":"2024-09-14T08:43:59.412933+0000","last_unstale":"2024-09-14T08:44:10.528347+0000","last_undegraded":"2024-09-14T08:44:10.528347+0000","last_fullsized":"2024-09-14T08:44:10.528347+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:09.547187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"222'2432","reported_seq":59036,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894044+0000","last_change":"2024-09-14T08:43:53.823293+0000","last_active":"2024-09-14T08:44:10.894044+0000","last_peered":"2024-09-14T08:44:10.894044+0000","last_clean":"2024-09-14T08:44:10.894044+0000","last_became_active":"2024-09-14T08:43:53.493591+0000","last_became_peered":"2024-09-14T08:43:53.493591+0000","last_unstale":"2024-09-14T08:44:10.894044+0000","last_undegraded":"2024-09-14T08:44:10.894044+0000","last_fullsized":"2024-09-14T08:44:10.894044+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2432,"log_dups_size":0,"ondisk_log_size":2432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:38.040189+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.066703469000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":67566,"num_read_kb":68156,"num_write":3798,"num_write_kb":9140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":455,"num_bytes_recovered":11715346,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526107+0000","last_change":"2024-09-14T08:43:59.420342+0000","last_active":"2024-09-14T08:44:10.526107+0000","last_peered":"2024-09-14T08:44:10.526107+0000","last_clean":"2024-09-14T08:44:10.526107+0000","last_became_active":"2024-09-14T08:43:59.417188+0000","last_became_peered":"2024-09-14T08:43:59.417188+0000","last_unstale":"2024-09-14T08:44:10.526107+0000","last_undegraded":"2024-09-14T08:44:10.526107+0000","last_fullsized":"2024-09-14T08:44:10.526107+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:19.062815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"222'771","reported_seq":59115,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526084+0000","last_change":"2024-09-14T08:43:53.590126+0000","last_active":"2024-09-14T08:44:10.526084+0000","last_peered":"2024-09-14T08:44:10.526084+0000","last_clean":"2024-09-14T08:44:10.526084+0000","last_became_active":"2024-09-14T08:43:53.485749+0000","last_became_peered":"2024-09-14T08:43:53.485749+0000","last_unstale":"2024-09-14T08:44:10.526084+0000","last_undegraded":"2024-09-14T08:44:10.526084+0000","last_fullsized":"2024-09-14T08:44:10.526084+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:40:38.092608+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.029629143,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":52542,"num_read_kb":50304,"num_write":575,"num_write_kb":32325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":262,"num_bytes_recovered":6496921,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528066+0000","last_change":"2024-09-14T08:43:59.410903+0000","last_active":"2024-09-14T08:44:10.528066+0000","last_peered":"2024-09-14T08:44:10.528066+0000","last_clean":"2024-09-14T08:44:10.528066+0000","last_became_active":"2024-09-14T08:43:59.410081+0000","last_became_peered":"2024-09-14T08:43:59.410081+0000","last_unstale":"2024-09-14T08:44:10.528066+0000","last_undegraded":"2024-09-14T08:44:10.528066+0000","last_fullsized":"2024-09-14T08:44:10.528066+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:07.401067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"222'641","reported_seq":6465,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898822+0000","last_change":"2024-09-14T08:44:07.414796+0000","last_active":"2024-09-14T08:44:10.898822+0000","last_peered":"2024-09-14T08:44:10.898822+0000","last_clean":"2024-09-14T08:44:10.898822+0000","last_became_active":"2024-09-14T08:44:07.405923+0000","last_became_peered":"2024-09-14T08:44:07.405923+0000","last_unstale":"2024-09-14T08:44:10.898822+0000","last_undegraded":"2024-09-14T08:44:10.898822+0000","last_fullsized":"2024-09-14T08:44:10.898822+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:57.074695+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.040351541999999997,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":6460,"num_read_kb":17251,"num_write":625,"num_write_kb":20411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":498,"num_bytes_recovered":6627757,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525679+0000","last_change":"2024-09-14T08:43:53.481113+0000","last_active":"2024-09-14T08:44:10.525679+0000","last_peered":"2024-09-14T08:44:10.525679+0000","last_clean":"2024-09-14T08:44:10.525679+0000","last_became_active":"2024-09-14T08:43:53.480382+0000","last_became_peered":"2024-09-14T08:43:53.480382+0000","last_unstale":"2024-09-14T08:44:10.525679+0000","last_undegraded":"2024-09-14T08:44:10.525679+0000","last_fullsized":"2024-09-14T08:44:10.525679+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:40.958509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"222'805","reported_seq":11063,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898417+0000","last_change":"2024-09-14T08:44:07.411700+0000","last_active":"2024-09-14T08:44:10.898417+0000","last_peered":"2024-09-14T08:44:10.898417+0000","last_clean":"2024-09-14T08:44:10.898417+0000","last_became_active":"2024-09-14T08:44:07.406747+0000","last_became_peered":"2024-09-14T08:44:07.406747+0000","last_unstale":"2024-09-14T08:44:10.898417+0000","last_undegraded":"2024-09-14T08:44:10.898417+0000","last_fullsized":"2024-09-14T08:44:10.898417+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:31.593890+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.034384078999999998,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":11288,"num_read_kb":43310,"num_write":1070,"num_write_kb":21593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":311,"num_bytes_recovered":4578256,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"217'1582","reported_seq":21530,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898225+0000","last_change":"2024-09-14T08:43:39.607463+0000","last_active":"2024-09-14T08:44:10.898225+0000","last_peered":"2024-09-14T08:44:10.898225+0000","last_clean":"2024-09-14T08:44:10.898225+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:44:10.898225+0000","last_undegraded":"2024-09-14T08:44:10.898225+0000","last_fullsized":"2024-09-14T08:44:10.898225+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1582,"log_dups_size":0,"ondisk_log_size":1582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:50.821083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050029469999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":22,"num_read":24909,"num_read_kb":27100,"num_write":2438,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":69,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898104+0000","last_change":"2024-09-14T08:44:07.404347+0000","last_active":"2024-09-14T08:44:10.898104+0000","last_peered":"2024-09-14T08:44:10.898104+0000","last_clean":"2024-09-14T08:44:10.898104+0000","last_became_active":"2024-09-14T08:44:07.403501+0000","last_became_peered":"2024-09-14T08:44:07.403501+0000","last_unstale":"2024-09-14T08:44:10.898104+0000","last_undegraded":"2024-09-14T08:44:10.898104+0000","last_fullsized":"2024-09-14T08:44:10.898104+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:22:14.375160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"222'466","reported_seq":28009,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525210+0000","last_change":"2024-09-14T08:43:53.620465+0000","last_active":"2024-09-14T08:44:10.525210+0000","last_peered":"2024-09-14T08:44:10.525210+0000","last_clean":"2024-09-14T08:44:10.525210+0000","last_became_active":"2024-09-14T08:43:53.464437+0000","last_became_peered":"2024-09-14T08:43:53.464437+0000","last_unstale":"2024-09-14T08:44:10.525210+0000","last_undegraded":"2024-09-14T08:44:10.525210+0000","last_fullsized":"2024-09-14T08:44:10.525210+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:53.362716+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.055535908000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":26972,"num_read_kb":27595,"num_write":457,"num_write_kb":3537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":3380924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":477,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525243+0000","last_change":"2024-09-14T08:43:53.459922+0000","last_active":"2024-09-14T08:44:10.525243+0000","last_peered":"2024-09-14T08:44:10.525243+0000","last_clean":"2024-09-14T08:44:10.525243+0000","last_became_active":"2024-09-14T08:43:53.458867+0000","last_became_peered":"2024-09-14T08:43:53.458867+0000","last_unstale":"2024-09-14T08:44:10.525243+0000","last_undegraded":"2024-09-14T08:44:10.525243+0000","last_fullsized":"2024-09-14T08:44:10.525243+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:58.597461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"214'425","reported_seq":8808,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893899+0000","last_change":"2024-09-14T08:43:39.657773+0000","last_active":"2024-09-14T08:44:10.893899+0000","last_peered":"2024-09-14T08:44:10.893899+0000","last_clean":"2024-09-14T08:44:10.893899+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:44:10.893899+0000","last_undegraded":"2024-09-14T08:44:10.893899+0000","last_fullsized":"2024-09-14T08:44:10.893899+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:15.972399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001097399,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7748,"num_read_kb":16836,"num_write":423,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527639+0000","last_change":"2024-09-14T08:43:59.401455+0000","last_active":"2024-09-14T08:44:10.527639+0000","last_peered":"2024-09-14T08:44:10.527639+0000","last_clean":"2024-09-14T08:44:10.527639+0000","last_became_active":"2024-09-14T08:43:59.398475+0000","last_became_peered":"2024-09-14T08:43:59.398475+0000","last_unstale":"2024-09-14T08:44:10.527639+0000","last_undegraded":"2024-09-14T08:44:10.527639+0000","last_fullsized":"2024-09-14T08:44:10.527639+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:07.678890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"222'533","reported_seq":18802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525614+0000","last_change":"2024-09-14T08:44:03.397964+0000","last_active":"2024-09-14T08:44:10.525614+0000","last_peered":"2024-09-14T08:44:10.525614+0000","last_clean":"2024-09-14T08:44:10.525614+0000","last_became_active":"2024-09-14T08:44:03.395670+0000","last_became_peered":"2024-09-14T08:44:03.395670+0000","last_unstale":"2024-09-14T08:44:10.525614+0000","last_undegraded":"2024-09-14T08:44:10.525614+0000","last_fullsized":"2024-09-14T08:44:10.525614+0000","mapping_epoch":228,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":229,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:11.528255+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.040148494999999999,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":17829,"num_read_kb":57289,"num_write":620,"num_write_kb":6801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":569,"num_bytes_recovered":15227317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":383,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898157+0000","last_change":"2024-09-14T08:44:07.409575+0000","last_active":"2024-09-14T08:44:10.898157+0000","last_peered":"2024-09-14T08:44:10.898157+0000","last_clean":"2024-09-14T08:44:10.898157+0000","last_became_active":"2024-09-14T08:44:07.408549+0000","last_became_peered":"2024-09-14T08:44:07.408549+0000","last_unstale":"2024-09-14T08:44:10.898157+0000","last_undegraded":"2024-09-14T08:44:10.898157+0000","last_fullsized":"2024-09-14T08:44:10.898157+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:28.425168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":39,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527628+0000","last_change":"2024-09-14T08:43:59.432210+0000","last_active":"2024-09-14T08:44:10.527628+0000","last_peered":"2024-09-14T08:44:10.527628+0000","last_clean":"2024-09-14T08:44:10.527628+0000","last_became_active":"2024-09-14T08:43:59.418428+0000","last_became_peered":"2024-09-14T08:43:59.418428+0000","last_unstale":"2024-09-14T08:44:10.527628+0000","last_undegraded":"2024-09-14T08:44:10.527628+0000","last_fullsized":"2024-09-14T08:44:10.527628+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:56:57.805159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"222'613","reported_seq":35728,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524989+0000","last_change":"2024-09-14T08:43:53.686001+0000","last_active":"2024-09-14T08:44:10.524989+0000","last_peered":"2024-09-14T08:44:10.524989+0000","last_clean":"2024-09-14T08:44:10.524989+0000","last_became_active":"2024-09-14T08:43:53.487405+0000","last_became_peered":"2024-09-14T08:43:53.487405+0000","last_unstale":"2024-09-14T08:44:10.524989+0000","last_undegraded":"2024-09-14T08:44:10.524989+0000","last_fullsized":"2024-09-14T08:44:10.524989+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:20.351169+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.024367663000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":33488,"num_read_kb":35878,"num_write":489,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":2364662,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"214'1053","reported_seq":16852,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897513+0000","last_change":"2024-09-14T08:43:39.605741+0000","last_active":"2024-09-14T08:44:10.897513+0000","last_peered":"2024-09-14T08:44:10.897513+0000","last_clean":"2024-09-14T08:44:10.897513+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:44:10.897513+0000","last_undegraded":"2024-09-14T08:44:10.897513+0000","last_fullsized":"2024-09-14T08:44:10.897513+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:59.457424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052773719999999998,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":16233,"num_read_kb":33099,"num_write":859,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"222'681","reported_seq":14472,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525569+0000","last_change":"2024-09-14T08:44:05.402563+0000","last_active":"2024-09-14T08:44:10.525569+0000","last_peered":"2024-09-14T08:44:10.525569+0000","last_clean":"2024-09-14T08:44:10.525569+0000","last_became_active":"2024-09-14T08:44:05.398159+0000","last_became_peered":"2024-09-14T08:44:05.398159+0000","last_unstale":"2024-09-14T08:44:10.525569+0000","last_undegraded":"2024-09-14T08:44:10.525569+0000","last_fullsized":"2024-09-14T08:44:10.525569+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:12.499363+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050530626000000002,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":14875,"num_read_kb":84017,"num_write":659,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":18337410,"num_keys_recovered":105,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"222'658","reported_seq":5999,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525728+0000","last_change":"2024-09-14T08:43:53.646871+0000","last_active":"2024-09-14T08:44:10.525728+0000","last_peered":"2024-09-14T08:44:10.525728+0000","last_clean":"2024-09-14T08:44:10.525728+0000","last_became_active":"2024-09-14T08:43:53.480067+0000","last_became_peered":"2024-09-14T08:43:53.480067+0000","last_unstale":"2024-09-14T08:44:10.525728+0000","last_undegraded":"2024-09-14T08:44:10.525728+0000","last_fullsized":"2024-09-14T08:44:10.525728+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:54.483372+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.051150345999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6328,"num_read_kb":21947,"num_write":820,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":389,"num_bytes_recovered":7762120,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"222'1049","reported_seq":45235,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898566+0000","last_change":"2024-09-14T08:44:07.422801+0000","last_active":"2024-09-14T08:44:10.898566+0000","last_peered":"2024-09-14T08:44:10.898566+0000","last_clean":"2024-09-14T08:44:10.898566+0000","last_became_active":"2024-09-14T08:44:07.414903+0000","last_became_peered":"2024-09-14T08:44:07.414903+0000","last_unstale":"2024-09-14T08:44:10.898566+0000","last_undegraded":"2024-09-14T08:44:10.898566+0000","last_fullsized":"2024-09-14T08:44:10.898566+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.984066+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.068642173000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":49733,"num_read_kb":103295,"num_write":819,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":12466332,"num_keys_recovered":182,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"214'694","reported_seq":8302,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528148+0000","last_change":"2024-09-14T08:44:06.414747+0000","last_active":"2024-09-14T08:44:10.528148+0000","last_peered":"2024-09-14T08:44:10.528148+0000","last_clean":"2024-09-14T08:44:10.528148+0000","last_became_active":"2024-09-14T08:44:06.407599+0000","last_became_peered":"2024-09-14T08:44:06.407599+0000","last_unstale":"2024-09-14T08:44:10.528148+0000","last_undegraded":"2024-09-14T08:44:10.528148+0000","last_fullsized":"2024-09-14T08:44:10.528148+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:09.433157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014175520000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":9196,"num_read_kb":22714,"num_write":526,"num_write_kb":7334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":391,"num_bytes_recovered":6800384,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"222'321","reported_seq":7626,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898657+0000","last_change":"2024-09-14T08:44:07.412670+0000","last_active":"2024-09-14T08:44:10.898657+0000","last_peered":"2024-09-14T08:44:10.898657+0000","last_clean":"2024-09-14T08:44:10.898657+0000","last_became_active":"2024-09-14T08:44:07.408742+0000","last_became_peered":"2024-09-14T08:44:07.408742+0000","last_unstale":"2024-09-14T08:44:10.898657+0000","last_undegraded":"2024-09-14T08:44:10.898657+0000","last_fullsized":"2024-09-14T08:44:10.898657+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:02.288720+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.035863521000000002,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":6541,"num_read_kb":21437,"num_write":285,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":561152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"222'572","reported_seq":10035,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898548+0000","last_change":"2024-09-14T08:44:07.415164+0000","last_active":"2024-09-14T08:44:10.898548+0000","last_peered":"2024-09-14T08:44:10.898548+0000","last_clean":"2024-09-14T08:44:10.898548+0000","last_became_active":"2024-09-14T08:44:07.406874+0000","last_became_peered":"2024-09-14T08:44:07.406874+0000","last_unstale":"2024-09-14T08:44:10.898548+0000","last_undegraded":"2024-09-14T08:44:10.898548+0000","last_fullsized":"2024-09-14T08:44:10.898548+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:38.272726+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053448875,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":7838,"num_read_kb":43795,"num_write":497,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":640,"num_bytes_recovered":25134704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"222'509","reported_seq":20077,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897511+0000","last_change":"2024-09-14T08:44:07.407192+0000","last_active":"2024-09-14T08:44:10.897511+0000","last_peered":"2024-09-14T08:44:10.897511+0000","last_clean":"2024-09-14T08:44:10.897511+0000","last_became_active":"2024-09-14T08:44:07.403507+0000","last_became_peered":"2024-09-14T08:44:07.403507+0000","last_unstale":"2024-09-14T08:44:10.897511+0000","last_undegraded":"2024-09-14T08:44:10.897511+0000","last_fullsized":"2024-09-14T08:44:10.897511+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:16.328502+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.050693604000000003,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20159,"num_read_kb":55886,"num_write":485,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":360,"num_bytes_recovered":2324520,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"214'552","reported_seq":44239,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527808+0000","last_change":"2024-09-14T08:44:08.397958+0000","last_active":"2024-09-14T08:44:10.527808+0000","last_peered":"2024-09-14T08:44:10.527808+0000","last_clean":"2024-09-14T08:44:10.527808+0000","last_became_active":"2024-09-14T08:44:08.392150+0000","last_became_peered":"2024-09-14T08:44:08.392150+0000","last_unstale":"2024-09-14T08:44:10.527808+0000","last_undegraded":"2024-09-14T08:44:10.527808+0000","last_fullsized":"2024-09-14T08:44:10.527808+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:21.006773+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.0046849040000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":44159,"num_read_kb":101736,"num_write":433,"num_write_kb":14207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":14335213,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"222'639","reported_seq":7204,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893897+0000","last_change":"2024-09-14T08:44:09.396495+0000","last_active":"2024-09-14T08:44:10.893897+0000","last_peered":"2024-09-14T08:44:10.893897+0000","last_clean":"2024-09-14T08:44:10.893897+0000","last_became_active":"2024-09-14T08:44:09.394635+0000","last_became_peered":"2024-09-14T08:44:09.394635+0000","last_unstale":"2024-09-14T08:44:10.893897+0000","last_undegraded":"2024-09-14T08:44:10.893897+0000","last_fullsized":"2024-09-14T08:44:10.893897+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:32.203345+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.041958433000000003,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5789,"num_read_kb":20892,"num_write":624,"num_write_kb":8469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":542,"num_bytes_recovered":17076794,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"214'884","reported_seq":4179,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527655+0000","last_change":"2024-09-14T08:44:06.415948+0000","last_active":"2024-09-14T08:44:10.527655+0000","last_peered":"2024-09-14T08:44:10.527655+0000","last_clean":"2024-09-14T08:44:10.527655+0000","last_became_active":"2024-09-14T08:44:06.410917+0000","last_became_peered":"2024-09-14T08:44:06.410917+0000","last_unstale":"2024-09-14T08:44:10.527655+0000","last_undegraded":"2024-09-14T08:44:10.527655+0000","last_fullsized":"2024-09-14T08:44:10.527655+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:53.099036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000881582,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":5580,"num_read_kb":13815,"num_write":1250,"num_write_kb":9128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":379,"num_bytes_recovered":3502437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":464,"num_read":609824,"num_read_kb":1289029,"num_write":26487,"num_write_kb":295335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11149,"num_bytes_recovered":214886831,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30533,"internal_metadata":0},"log_size":24018,"ondisk_log_size":24018,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65900,"kb_used_data":2772,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94305940,"statfs":{"total":96636764160,"available":96569282560,"internally_reserved":0,"allocated":2838528,"data_stored":1209373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52600,"kb_used_data":3360,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319240,"statfs":{"total":96636764160,"available":96582901760,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56180,"kb_used_data":2780,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315660,"statfs":{"total":96636764160,"available":96579235840,"internally_reserved":0,"allocated":2846720,"data_stored":1214382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":221,"seq":949187772422,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":2788,"kb_used_omap":41,"kb_used_meta":30102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":2854912,"data_stored":1214420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42656,"internal_metadata":30824800},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607619,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82548,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94289292,"statfs":{"total":96636764160,"available":96552235008,"internally_reserved":0,"allocated":2850816,"data_stored":1214401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846622,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40888,"kb_used_data":3360,"kb_used_omap":22,"kb_used_meta":37481,"kb_avail":94330952,"statfs":{"total":96636764160,"available":96594894848,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":38381344},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17459,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:44:14.997 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T08:44:14.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:44:15.279 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:44:15.279 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:44:15.296 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-09-14T08:44:14.353555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":472,"num_object_clones":0,"num_object_copies":944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":472,"num_whiteouts":464,"num_read":609890,"num_read_kb":1289084,"num_write":26590,"num_write_kb":296965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11164,"num_bytes_recovered":218429077,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24093,"ondisk_log_size":24093,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":331072,"kb_used_data":17844,"kb_used_omap":70,"kb_used_meta":313017,"kb_avail":565899968,"statfs":{"total":579820584960,"available":579481567232,"internally_reserved":0,"allocated":18272256,"data_stored":8462076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71786,"internal_metadata":320530326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-891,"num_objects_misplaced":-143,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":600,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002051"},"pg_stats":[{"pgid":"3.1f","version":"217'460","reported_seq":5330,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894001+0000","last_change":"2024-09-14T08:44:08.390806+0000","last_active":"2024-09-14T08:44:10.894001+0000","last_peered":"2024-09-14T08:44:10.894001+0000","last_clean":"2024-09-14T08:44:10.894001+0000","last_became_active":"2024-09-14T08:44:08.389408+0000","last_became_peered":"2024-09-14T08:44:08.389408+0000","last_unstale":"2024-09-14T08:44:10.894001+0000","last_undegraded":"2024-09-14T08:44:10.894001+0000","last_fullsized":"2024-09-14T08:44:10.894001+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:56.620484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016438780000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":3901,"num_read_kb":17036,"num_write":490,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":482,"num_bytes_recovered":8172556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"222'381","reported_seq":30464,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525981+0000","last_change":"2024-09-14T08:44:06.408757+0000","last_active":"2024-09-14T08:44:10.525981+0000","last_peered":"2024-09-14T08:44:10.525981+0000","last_clean":"2024-09-14T08:44:10.525981+0000","last_became_active":"2024-09-14T08:44:06.406436+0000","last_became_peered":"2024-09-14T08:44:06.406436+0000","last_unstale":"2024-09-14T08:44:10.525981+0000","last_undegraded":"2024-09-14T08:44:10.525981+0000","last_fullsized":"2024-09-14T08:44:10.525981+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:37.062114+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.042684857,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":28761,"num_read_kb":35233,"num_write":368,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":355,"num_bytes_recovered":515120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"222'750","reported_seq":8689,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898303+0000","last_change":"2024-09-14T08:44:07.416202+0000","last_active":"2024-09-14T08:44:10.898303+0000","last_peered":"2024-09-14T08:44:10.898303+0000","last_clean":"2024-09-14T08:44:10.898303+0000","last_became_active":"2024-09-14T08:44:07.410893+0000","last_became_peered":"2024-09-14T08:44:07.410893+0000","last_unstale":"2024-09-14T08:44:10.898303+0000","last_undegraded":"2024-09-14T08:44:10.898303+0000","last_fullsized":"2024-09-14T08:44:10.898303+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:26.339107+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.049489020000000002,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":10164,"num_read_kb":40300,"num_write":735,"num_write_kb":5110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":1147934,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"222'760","reported_seq":9287,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898348+0000","last_change":"2024-09-14T08:44:07.422741+0000","last_active":"2024-09-14T08:44:10.898348+0000","last_peered":"2024-09-14T08:44:10.898348+0000","last_clean":"2024-09-14T08:44:10.898348+0000","last_became_active":"2024-09-14T08:44:07.415742+0000","last_became_peered":"2024-09-14T08:44:07.415742+0000","last_unstale":"2024-09-14T08:44:10.898348+0000","last_undegraded":"2024-09-14T08:44:10.898348+0000","last_fullsized":"2024-09-14T08:44:10.898348+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:37.288749+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.059401431999999997,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":15,"num_read":8755,"num_read_kb":53187,"num_write":901,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":3698222,"num_keys_recovered":59,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"215'929","reported_seq":11250,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894125+0000","last_change":"2024-09-14T08:43:39.658480+0000","last_active":"2024-09-14T08:44:10.894125+0000","last_peered":"2024-09-14T08:44:10.894125+0000","last_clean":"2024-09-14T08:44:10.894125+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:44:10.894125+0000","last_undegraded":"2024-09-14T08:44:10.894125+0000","last_fullsized":"2024-09-14T08:44:10.894125+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:14.682609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001641146,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":11941,"num_read_kb":55626,"num_write":963,"num_write_kb":5928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"222'535","reported_seq":12802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897623+0000","last_change":"2024-09-14T08:43:53.753438+0000","last_active":"2024-09-14T08:44:10.897623+0000","last_peered":"2024-09-14T08:44:10.897623+0000","last_clean":"2024-09-14T08:44:10.897623+0000","last_became_active":"2024-09-14T08:43:53.474287+0000","last_became_peered":"2024-09-14T08:43:53.474287+0000","last_unstale":"2024-09-14T08:44:10.897623+0000","last_undegraded":"2024-09-14T08:44:10.897623+0000","last_fullsized":"2024-09-14T08:44:10.897623+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:17.015900+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.058553644000000002,"stat_sum":{"num_bytes":19,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":11827,"num_read_kb":31605,"num_write":546,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":6116492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"222'755","reported_seq":7459,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525223+0000","last_change":"2024-09-14T08:43:53.556657+0000","last_active":"2024-09-14T08:44:10.525223+0000","last_peered":"2024-09-14T08:44:10.525223+0000","last_clean":"2024-09-14T08:44:10.525223+0000","last_became_active":"2024-09-14T08:43:53.452873+0000","last_became_peered":"2024-09-14T08:43:53.452873+0000","last_unstale":"2024-09-14T08:44:10.525223+0000","last_undegraded":"2024-09-14T08:44:10.525223+0000","last_fullsized":"2024-09-14T08:44:10.525223+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:35.049723+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.036162803,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7603,"num_read_kb":22143,"num_write":748,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":3588110,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"214'592","reported_seq":7881,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524932+0000","last_change":"2024-09-14T08:43:39.592789+0000","last_active":"2024-09-14T08:44:10.524932+0000","last_peered":"2024-09-14T08:44:10.524932+0000","last_clean":"2024-09-14T08:44:10.524932+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:44:10.524932+0000","last_undegraded":"2024-09-14T08:44:10.524932+0000","last_fullsized":"2024-09-14T08:44:10.524932+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:25.103017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018468670000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":7942,"num_read_kb":29510,"num_write":481,"num_write_kb":3303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"216'791","reported_seq":7561,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894118+0000","last_change":"2024-09-14T08:44:05.406114+0000","last_active":"2024-09-14T08:44:10.894118+0000","last_peered":"2024-09-14T08:44:10.894118+0000","last_clean":"2024-09-14T08:44:10.894118+0000","last_became_active":"2024-09-14T08:44:05.404094+0000","last_became_peered":"2024-09-14T08:44:05.404094+0000","last_unstale":"2024-09-14T08:44:10.894118+0000","last_undegraded":"2024-09-14T08:44:10.894118+0000","last_fullsized":"2024-09-14T08:44:10.894118+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:04:22.949426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001891085,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":8172,"num_read_kb":36701,"num_write":1066,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":397,"num_bytes_recovered":4642734,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"222'664","reported_seq":7139,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897892+0000","last_change":"2024-09-14T08:44:02.406710+0000","last_active":"2024-09-14T08:44:10.897892+0000","last_peered":"2024-09-14T08:44:10.897892+0000","last_clean":"2024-09-14T08:44:10.897892+0000","last_became_active":"2024-09-14T08:44:02.400561+0000","last_became_peered":"2024-09-14T08:44:02.400561+0000","last_unstale":"2024-09-14T08:44:10.897892+0000","last_undegraded":"2024-09-14T08:44:10.897892+0000","last_fullsized":"2024-09-14T08:44:10.897892+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:44.768637+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050148086000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":31023,"num_read_kb":35394,"num_write":669,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":3628604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"216'1107","reported_seq":8313,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527890+0000","last_change":"2024-09-14T08:44:09.401728+0000","last_active":"2024-09-14T08:44:10.527890+0000","last_peered":"2024-09-14T08:44:10.527890+0000","last_clean":"2024-09-14T08:44:10.527890+0000","last_became_active":"2024-09-14T08:44:09.397717+0000","last_became_peered":"2024-09-14T08:44:09.397717+0000","last_unstale":"2024-09-14T08:44:10.527890+0000","last_undegraded":"2024-09-14T08:44:10.527890+0000","last_fullsized":"2024-09-14T08:44:10.527890+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.117371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371021,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12242,"num_read_kb":26406,"num_write":1299,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":535,"num_bytes_recovered":14245931,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"217'414","reported_seq":33294,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527734+0000","last_change":"2024-09-14T08:44:01.399150+0000","last_active":"2024-09-14T08:44:10.527734+0000","last_peered":"2024-09-14T08:44:10.527734+0000","last_clean":"2024-09-14T08:44:10.527734+0000","last_became_active":"2024-09-14T08:44:01.395419+0000","last_became_peered":"2024-09-14T08:44:01.395419+0000","last_unstale":"2024-09-14T08:44:10.527734+0000","last_undegraded":"2024-09-14T08:44:10.527734+0000","last_fullsized":"2024-09-14T08:44:10.527734+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:46.518606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052741680000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":32260,"num_read_kb":39536,"num_write":469,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":2619100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528347+0000","last_change":"2024-09-14T08:43:59.418934+0000","last_active":"2024-09-14T08:44:10.528347+0000","last_peered":"2024-09-14T08:44:10.528347+0000","last_clean":"2024-09-14T08:44:10.528347+0000","last_became_active":"2024-09-14T08:43:59.412933+0000","last_became_peered":"2024-09-14T08:43:59.412933+0000","last_unstale":"2024-09-14T08:44:10.528347+0000","last_undegraded":"2024-09-14T08:44:10.528347+0000","last_fullsized":"2024-09-14T08:44:10.528347+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:09.547187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"222'2432","reported_seq":59036,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894044+0000","last_change":"2024-09-14T08:43:53.823293+0000","last_active":"2024-09-14T08:44:10.894044+0000","last_peered":"2024-09-14T08:44:10.894044+0000","last_clean":"2024-09-14T08:44:10.894044+0000","last_became_active":"2024-09-14T08:43:53.493591+0000","last_became_peered":"2024-09-14T08:43:53.493591+0000","last_unstale":"2024-09-14T08:44:10.894044+0000","last_undegraded":"2024-09-14T08:44:10.894044+0000","last_fullsized":"2024-09-14T08:44:10.894044+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2432,"log_dups_size":0,"ondisk_log_size":2432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:38.040189+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.066703469000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":67566,"num_read_kb":68156,"num_write":3798,"num_write_kb":9140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":455,"num_bytes_recovered":11715346,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526107+0000","last_change":"2024-09-14T08:43:59.420342+0000","last_active":"2024-09-14T08:44:10.526107+0000","last_peered":"2024-09-14T08:44:10.526107+0000","last_clean":"2024-09-14T08:44:10.526107+0000","last_became_active":"2024-09-14T08:43:59.417188+0000","last_became_peered":"2024-09-14T08:43:59.417188+0000","last_unstale":"2024-09-14T08:44:10.526107+0000","last_undegraded":"2024-09-14T08:44:10.526107+0000","last_fullsized":"2024-09-14T08:44:10.526107+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:19.062815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"222'771","reported_seq":59115,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526084+0000","last_change":"2024-09-14T08:43:53.590126+0000","last_active":"2024-09-14T08:44:10.526084+0000","last_peered":"2024-09-14T08:44:10.526084+0000","last_clean":"2024-09-14T08:44:10.526084+0000","last_became_active":"2024-09-14T08:43:53.485749+0000","last_became_peered":"2024-09-14T08:43:53.485749+0000","last_unstale":"2024-09-14T08:44:10.526084+0000","last_undegraded":"2024-09-14T08:44:10.526084+0000","last_fullsized":"2024-09-14T08:44:10.526084+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:40:38.092608+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.029629143,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":52542,"num_read_kb":50304,"num_write":575,"num_write_kb":32325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":262,"num_bytes_recovered":6496921,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528066+0000","last_change":"2024-09-14T08:43:59.410903+0000","last_active":"2024-09-14T08:44:10.528066+0000","last_peered":"2024-09-14T08:44:10.528066+0000","last_clean":"2024-09-14T08:44:10.528066+0000","last_became_active":"2024-09-14T08:43:59.410081+0000","last_became_peered":"2024-09-14T08:43:59.410081+0000","last_unstale":"2024-09-14T08:44:10.528066+0000","last_undegraded":"2024-09-14T08:44:10.528066+0000","last_fullsized":"2024-09-14T08:44:10.528066+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:07.401067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"222'641","reported_seq":6465,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898822+0000","last_change":"2024-09-14T08:44:07.414796+0000","last_active":"2024-09-14T08:44:10.898822+0000","last_peered":"2024-09-14T08:44:10.898822+0000","last_clean":"2024-09-14T08:44:10.898822+0000","last_became_active":"2024-09-14T08:44:07.405923+0000","last_became_peered":"2024-09-14T08:44:07.405923+0000","last_unstale":"2024-09-14T08:44:10.898822+0000","last_undegraded":"2024-09-14T08:44:10.898822+0000","last_fullsized":"2024-09-14T08:44:10.898822+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:57.074695+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.040351541999999997,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":6460,"num_read_kb":17251,"num_write":625,"num_write_kb":20411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":498,"num_bytes_recovered":6627757,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525679+0000","last_change":"2024-09-14T08:43:53.481113+0000","last_active":"2024-09-14T08:44:10.525679+0000","last_peered":"2024-09-14T08:44:10.525679+0000","last_clean":"2024-09-14T08:44:10.525679+0000","last_became_active":"2024-09-14T08:43:53.480382+0000","last_became_peered":"2024-09-14T08:43:53.480382+0000","last_unstale":"2024-09-14T08:44:10.525679+0000","last_undegraded":"2024-09-14T08:44:10.525679+0000","last_fullsized":"2024-09-14T08:44:10.525679+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:40.958509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"222'805","reported_seq":11063,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898417+0000","last_change":"2024-09-14T08:44:07.411700+0000","last_active":"2024-09-14T08:44:10.898417+0000","last_peered":"2024-09-14T08:44:10.898417+0000","last_clean":"2024-09-14T08:44:10.898417+0000","last_became_active":"2024-09-14T08:44:07.406747+0000","last_became_peered":"2024-09-14T08:44:07.406747+0000","last_unstale":"2024-09-14T08:44:10.898417+0000","last_undegraded":"2024-09-14T08:44:10.898417+0000","last_fullsized":"2024-09-14T08:44:10.898417+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:31.593890+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.034384078999999998,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":11288,"num_read_kb":43310,"num_write":1070,"num_write_kb":21593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":311,"num_bytes_recovered":4578256,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"217'1582","reported_seq":21530,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898225+0000","last_change":"2024-09-14T08:43:39.607463+0000","last_active":"2024-09-14T08:44:10.898225+0000","last_peered":"2024-09-14T08:44:10.898225+0000","last_clean":"2024-09-14T08:44:10.898225+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:44:10.898225+0000","last_undegraded":"2024-09-14T08:44:10.898225+0000","last_fullsized":"2024-09-14T08:44:10.898225+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1582,"log_dups_size":0,"ondisk_log_size":1582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:50.821083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050029469999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":22,"num_read":24909,"num_read_kb":27100,"num_write":2438,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":69,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898104+0000","last_change":"2024-09-14T08:44:07.404347+0000","last_active":"2024-09-14T08:44:10.898104+0000","last_peered":"2024-09-14T08:44:10.898104+0000","last_clean":"2024-09-14T08:44:10.898104+0000","last_became_active":"2024-09-14T08:44:07.403501+0000","last_became_peered":"2024-09-14T08:44:07.403501+0000","last_unstale":"2024-09-14T08:44:10.898104+0000","last_undegraded":"2024-09-14T08:44:10.898104+0000","last_fullsized":"2024-09-14T08:44:10.898104+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:22:14.375160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"222'466","reported_seq":28009,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525210+0000","last_change":"2024-09-14T08:43:53.620465+0000","last_active":"2024-09-14T08:44:10.525210+0000","last_peered":"2024-09-14T08:44:10.525210+0000","last_clean":"2024-09-14T08:44:10.525210+0000","last_became_active":"2024-09-14T08:43:53.464437+0000","last_became_peered":"2024-09-14T08:43:53.464437+0000","last_unstale":"2024-09-14T08:44:10.525210+0000","last_undegraded":"2024-09-14T08:44:10.525210+0000","last_fullsized":"2024-09-14T08:44:10.525210+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:53.362716+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.055535908000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":26972,"num_read_kb":27595,"num_write":457,"num_write_kb":3537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":3380924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":477,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525243+0000","last_change":"2024-09-14T08:43:53.459922+0000","last_active":"2024-09-14T08:44:10.525243+0000","last_peered":"2024-09-14T08:44:10.525243+0000","last_clean":"2024-09-14T08:44:10.525243+0000","last_became_active":"2024-09-14T08:43:53.458867+0000","last_became_peered":"2024-09-14T08:43:53.458867+0000","last_unstale":"2024-09-14T08:44:10.525243+0000","last_undegraded":"2024-09-14T08:44:10.525243+0000","last_fullsized":"2024-09-14T08:44:10.525243+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:58.597461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"214'425","reported_seq":8808,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893899+0000","last_change":"2024-09-14T08:43:39.657773+0000","last_active":"2024-09-14T08:44:10.893899+0000","last_peered":"2024-09-14T08:44:10.893899+0000","last_clean":"2024-09-14T08:44:10.893899+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:44:10.893899+0000","last_undegraded":"2024-09-14T08:44:10.893899+0000","last_fullsized":"2024-09-14T08:44:10.893899+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:15.972399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001097399,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7748,"num_read_kb":16836,"num_write":423,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527639+0000","last_change":"2024-09-14T08:43:59.401455+0000","last_active":"2024-09-14T08:44:10.527639+0000","last_peered":"2024-09-14T08:44:10.527639+0000","last_clean":"2024-09-14T08:44:10.527639+0000","last_became_active":"2024-09-14T08:43:59.398475+0000","last_became_peered":"2024-09-14T08:43:59.398475+0000","last_unstale":"2024-09-14T08:44:10.527639+0000","last_undegraded":"2024-09-14T08:44:10.527639+0000","last_fullsized":"2024-09-14T08:44:10.527639+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:07.678890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"222'533","reported_seq":18802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525614+0000","last_change":"2024-09-14T08:44:03.397964+0000","last_active":"2024-09-14T08:44:10.525614+0000","last_peered":"2024-09-14T08:44:10.525614+0000","last_clean":"2024-09-14T08:44:10.525614+0000","last_became_active":"2024-09-14T08:44:03.395670+0000","last_became_peered":"2024-09-14T08:44:03.395670+0000","last_unstale":"2024-09-14T08:44:10.525614+0000","last_undegraded":"2024-09-14T08:44:10.525614+0000","last_fullsized":"2024-09-14T08:44:10.525614+0000","mapping_epoch":228,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":229,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:11.528255+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.040148494999999999,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":17829,"num_read_kb":57289,"num_write":620,"num_write_kb":6801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":569,"num_bytes_recovered":15227317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":383,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898157+0000","last_change":"2024-09-14T08:44:07.409575+0000","last_active":"2024-09-14T08:44:10.898157+0000","last_peered":"2024-09-14T08:44:10.898157+0000","last_clean":"2024-09-14T08:44:10.898157+0000","last_became_active":"2024-09-14T08:44:07.408549+0000","last_became_peered":"2024-09-14T08:44:07.408549+0000","last_unstale":"2024-09-14T08:44:10.898157+0000","last_undegraded":"2024-09-14T08:44:10.898157+0000","last_fullsized":"2024-09-14T08:44:10.898157+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:28.425168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":39,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527628+0000","last_change":"2024-09-14T08:43:59.432210+0000","last_active":"2024-09-14T08:44:10.527628+0000","last_peered":"2024-09-14T08:44:10.527628+0000","last_clean":"2024-09-14T08:44:10.527628+0000","last_became_active":"2024-09-14T08:43:59.418428+0000","last_became_peered":"2024-09-14T08:43:59.418428+0000","last_unstale":"2024-09-14T08:44:10.527628+0000","last_undegraded":"2024-09-14T08:44:10.527628+0000","last_fullsized":"2024-09-14T08:44:10.527628+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:56:57.805159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"222'613","reported_seq":35728,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524989+0000","last_change":"2024-09-14T08:43:53.686001+0000","last_active":"2024-09-14T08:44:10.524989+0000","last_peered":"2024-09-14T08:44:10.524989+0000","last_clean":"2024-09-14T08:44:10.524989+0000","last_became_active":"2024-09-14T08:43:53.487405+0000","last_became_peered":"2024-09-14T08:43:53.487405+0000","last_unstale":"2024-09-14T08:44:10.524989+0000","last_undegraded":"2024-09-14T08:44:10.524989+0000","last_fullsized":"2024-09-14T08:44:10.524989+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:20.351169+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.024367663000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":33488,"num_read_kb":35878,"num_write":489,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":2364662,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"214'1053","reported_seq":16852,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897513+0000","last_change":"2024-09-14T08:43:39.605741+0000","last_active":"2024-09-14T08:44:10.897513+0000","last_peered":"2024-09-14T08:44:10.897513+0000","last_clean":"2024-09-14T08:44:10.897513+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:44:10.897513+0000","last_undegraded":"2024-09-14T08:44:10.897513+0000","last_fullsized":"2024-09-14T08:44:10.897513+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:59.457424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052773719999999998,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":16233,"num_read_kb":33099,"num_write":859,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"222'681","reported_seq":14472,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525569+0000","last_change":"2024-09-14T08:44:05.402563+0000","last_active":"2024-09-14T08:44:10.525569+0000","last_peered":"2024-09-14T08:44:10.525569+0000","last_clean":"2024-09-14T08:44:10.525569+0000","last_became_active":"2024-09-14T08:44:05.398159+0000","last_became_peered":"2024-09-14T08:44:05.398159+0000","last_unstale":"2024-09-14T08:44:10.525569+0000","last_undegraded":"2024-09-14T08:44:10.525569+0000","last_fullsized":"2024-09-14T08:44:10.525569+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:12.499363+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050530626000000002,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":14875,"num_read_kb":84017,"num_write":659,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":18337410,"num_keys_recovered":105,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"222'658","reported_seq":5999,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525728+0000","last_change":"2024-09-14T08:43:53.646871+0000","last_active":"2024-09-14T08:44:10.525728+0000","last_peered":"2024-09-14T08:44:10.525728+0000","last_clean":"2024-09-14T08:44:10.525728+0000","last_became_active":"2024-09-14T08:43:53.480067+0000","last_became_peered":"2024-09-14T08:43:53.480067+0000","last_unstale":"2024-09-14T08:44:10.525728+0000","last_undegraded":"2024-09-14T08:44:10.525728+0000","last_fullsized":"2024-09-14T08:44:10.525728+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:54.483372+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.051150345999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6328,"num_read_kb":21947,"num_write":820,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":389,"num_bytes_recovered":7762120,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"222'1049","reported_seq":45235,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898566+0000","last_change":"2024-09-14T08:44:07.422801+0000","last_active":"2024-09-14T08:44:10.898566+0000","last_peered":"2024-09-14T08:44:10.898566+0000","last_clean":"2024-09-14T08:44:10.898566+0000","last_became_active":"2024-09-14T08:44:07.414903+0000","last_became_peered":"2024-09-14T08:44:07.414903+0000","last_unstale":"2024-09-14T08:44:10.898566+0000","last_undegraded":"2024-09-14T08:44:10.898566+0000","last_fullsized":"2024-09-14T08:44:10.898566+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.984066+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.068642173000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":49733,"num_read_kb":103295,"num_write":819,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":12466332,"num_keys_recovered":182,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"214'694","reported_seq":8302,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528148+0000","last_change":"2024-09-14T08:44:06.414747+0000","last_active":"2024-09-14T08:44:10.528148+0000","last_peered":"2024-09-14T08:44:10.528148+0000","last_clean":"2024-09-14T08:44:10.528148+0000","last_became_active":"2024-09-14T08:44:06.407599+0000","last_became_peered":"2024-09-14T08:44:06.407599+0000","last_unstale":"2024-09-14T08:44:10.528148+0000","last_undegraded":"2024-09-14T08:44:10.528148+0000","last_fullsized":"2024-09-14T08:44:10.528148+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:09.433157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014175520000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":9196,"num_read_kb":22714,"num_write":526,"num_write_kb":7334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":391,"num_bytes_recovered":6800384,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"222'321","reported_seq":7626,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898657+0000","last_change":"2024-09-14T08:44:07.412670+0000","last_active":"2024-09-14T08:44:10.898657+0000","last_peered":"2024-09-14T08:44:10.898657+0000","last_clean":"2024-09-14T08:44:10.898657+0000","last_became_active":"2024-09-14T08:44:07.408742+0000","last_became_peered":"2024-09-14T08:44:07.408742+0000","last_unstale":"2024-09-14T08:44:10.898657+0000","last_undegraded":"2024-09-14T08:44:10.898657+0000","last_fullsized":"2024-09-14T08:44:10.898657+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:02.288720+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.035863521000000002,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":6541,"num_read_kb":21437,"num_write":285,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":561152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"222'572","reported_seq":10035,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898548+0000","last_change":"2024-09-14T08:44:07.415164+0000","last_active":"2024-09-14T08:44:10.898548+0000","last_peered":"2024-09-14T08:44:10.898548+0000","last_clean":"2024-09-14T08:44:10.898548+0000","last_became_active":"2024-09-14T08:44:07.406874+0000","last_became_peered":"2024-09-14T08:44:07.406874+0000","last_unstale":"2024-09-14T08:44:10.898548+0000","last_undegraded":"2024-09-14T08:44:10.898548+0000","last_fullsized":"2024-09-14T08:44:10.898548+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:38.272726+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053448875,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":7838,"num_read_kb":43795,"num_write":497,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":640,"num_bytes_recovered":25134704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"222'509","reported_seq":20077,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897511+0000","last_change":"2024-09-14T08:44:07.407192+0000","last_active":"2024-09-14T08:44:10.897511+0000","last_peered":"2024-09-14T08:44:10.897511+0000","last_clean":"2024-09-14T08:44:10.897511+0000","last_became_active":"2024-09-14T08:44:07.403507+0000","last_became_peered":"2024-09-14T08:44:07.403507+0000","last_unstale":"2024-09-14T08:44:10.897511+0000","last_undegraded":"2024-09-14T08:44:10.897511+0000","last_fullsized":"2024-09-14T08:44:10.897511+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:16.328502+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.050693604000000003,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20159,"num_read_kb":55886,"num_write":485,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":360,"num_bytes_recovered":2324520,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"214'552","reported_seq":44239,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527808+0000","last_change":"2024-09-14T08:44:08.397958+0000","last_active":"2024-09-14T08:44:10.527808+0000","last_peered":"2024-09-14T08:44:10.527808+0000","last_clean":"2024-09-14T08:44:10.527808+0000","last_became_active":"2024-09-14T08:44:08.392150+0000","last_became_peered":"2024-09-14T08:44:08.392150+0000","last_unstale":"2024-09-14T08:44:10.527808+0000","last_undegraded":"2024-09-14T08:44:10.527808+0000","last_fullsized":"2024-09-14T08:44:10.527808+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:21.006773+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.0046849040000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":44159,"num_read_kb":101736,"num_write":433,"num_write_kb":14207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":14335213,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"222'639","reported_seq":7204,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893897+0000","last_change":"2024-09-14T08:44:09.396495+0000","last_active":"2024-09-14T08:44:10.893897+0000","last_peered":"2024-09-14T08:44:10.893897+0000","last_clean":"2024-09-14T08:44:10.893897+0000","last_became_active":"2024-09-14T08:44:09.394635+0000","last_became_peered":"2024-09-14T08:44:09.394635+0000","last_unstale":"2024-09-14T08:44:10.893897+0000","last_undegraded":"2024-09-14T08:44:10.893897+0000","last_fullsized":"2024-09-14T08:44:10.893897+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:32.203345+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.041958433000000003,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5789,"num_read_kb":20892,"num_write":624,"num_write_kb":8469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":542,"num_bytes_recovered":17076794,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"214'884","reported_seq":4179,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527655+0000","last_change":"2024-09-14T08:44:06.415948+0000","last_active":"2024-09-14T08:44:10.527655+0000","last_peered":"2024-09-14T08:44:10.527655+0000","last_clean":"2024-09-14T08:44:10.527655+0000","last_became_active":"2024-09-14T08:44:06.410917+0000","last_became_peered":"2024-09-14T08:44:06.410917+0000","last_unstale":"2024-09-14T08:44:10.527655+0000","last_undegraded":"2024-09-14T08:44:10.527655+0000","last_fullsized":"2024-09-14T08:44:10.527655+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:53.099036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000881582,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":5580,"num_read_kb":13815,"num_write":1250,"num_write_kb":9128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":379,"num_bytes_recovered":3502437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":464,"num_read":609824,"num_read_kb":1289029,"num_write":26487,"num_write_kb":295335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11149,"num_bytes_recovered":214886831,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30533,"internal_metadata":0},"log_size":24018,"ondisk_log_size":24018,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65900,"kb_used_data":2772,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94305940,"statfs":{"total":96636764160,"available":96569282560,"internally_reserved":0,"allocated":2838528,"data_stored":1209373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52600,"kb_used_data":3360,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319240,"statfs":{"total":96636764160,"available":96582901760,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56180,"kb_used_data":2780,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315660,"statfs":{"total":96636764160,"available":96579235840,"internally_reserved":0,"allocated":2846720,"data_stored":1214382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":221,"seq":949187772422,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":2788,"kb_used_omap":41,"kb_used_meta":30102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":2854912,"data_stored":1214420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42656,"internal_metadata":30824800},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607619,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82548,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94289292,"statfs":{"total":96636764160,"available":96552235008,"internally_reserved":0,"allocated":2850816,"data_stored":1214401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846622,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40888,"kb_used_data":3360,"kb_used_omap":22,"kb_used_meta":37481,"kb_avail":94330952,"statfs":{"total":96636764160,"available":96594894848,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":38381344},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17459,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:44:15.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T08:44:15.575 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:44:15.575 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":236,"fsid":"57b092b7-5550-41a0-8f78-531de0e7c469","created":"2024-09-14T08:38:48.610112+0000","modified":"2024-09-14T08:44:10.509456+0000","last_up_change":"2024-09-14T08:43:52.422551+0000","last_in_change":"2024-09-14T08:43:58.369219+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T08:39:00.306403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T08:39:06.370159+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T08:39:16.437713+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":38,"snap_epoch":217,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2b60ca75-7e9c-44aa-ae62-d59dbf0dd62d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":105,"last_clean_end":115,"up_from":127,"up_thru":234,"down_at":117,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6801","nonce":1732765385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6803","nonce":1732765385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6807","nonce":1732765385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1732765385},{"type":"v1","addr":"172.21.15.89:6805","nonce":1732765385}]},"public_addr":"172.21.15.89:6801/1732765385","cluster_addr":"172.21.15.89:6803/1732765385","heartbeat_back_addr":"172.21.15.89:6807/1732765385","heartbeat_front_addr":"172.21.15.89:6805/1732765385","state":["exists","up"]},{"osd":1,"uuid":"09ba1390-a0d1-48a3-9342-5f5aa64e2217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":204,"up_from":221,"up_thru":231,"down_at":205,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6809","nonce":3885254412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6811","nonce":3885254412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6815","nonce":3885254412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":3885254412},{"type":"v1","addr":"172.21.15.89:6813","nonce":3885254412}]},"public_addr":"172.21.15.89:6809/3885254412","cluster_addr":"172.21.15.89:6811/3885254412","heartbeat_back_addr":"172.21.15.89:6815/3885254412","heartbeat_front_addr":"172.21.15.89:6813/3885254412","state":["exists","up"]},{"osd":2,"uuid":"a7cd8610-d8e1-44e7-a423-4419cad90d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6817","nonce":1157205327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6819","nonce":1157205327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6823","nonce":1157205327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1157205327},{"type":"v1","addr":"172.21.15.89:6821","nonce":1157205327}]},"public_addr":"172.21.15.89:6817/1157205327","cluster_addr":"172.21.15.89:6819/1157205327","heartbeat_back_addr":"172.21.15.89:6823/1157205327","heartbeat_front_addr":"172.21.15.89:6821/1157205327","state":["exists","up"]},{"osd":3,"uuid":"1339fb05-5d1c-4c0a-8388-314119543bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":234,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6809","nonce":1656791341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6811","nonce":1656791341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6815","nonce":1656791341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1656791341},{"type":"v1","addr":"172.21.15.112:6813","nonce":1656791341}]},"public_addr":"172.21.15.112:6809/1656791341","cluster_addr":"172.21.15.112:6811/1656791341","heartbeat_back_addr":"172.21.15.112:6815/1656791341","heartbeat_front_addr":"172.21.15.112:6813/1656791341","state":["exists","up"]},{"osd":4,"uuid":"0cebba54-9019-47bd-870f-306664e390e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6817","nonce":1186206237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6819","nonce":1186206237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6823","nonce":1186206237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1186206237},{"type":"v1","addr":"172.21.15.112:6821","nonce":1186206237}]},"public_addr":"172.21.15.112:6817/1186206237","cluster_addr":"172.21.15.112:6819/1186206237","heartbeat_back_addr":"172.21.15.112:6823/1186206237","heartbeat_front_addr":"172.21.15.112:6821/1186206237","state":["exists","up"]},{"osd":5,"uuid":"e571e73b-0e9d-417d-b01c-59b651016763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6801","nonce":796623465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6803","nonce":796623465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6807","nonce":796623465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":796623465},{"type":"v1","addr":"172.21.15.112:6805","nonce":796623465}]},"public_addr":"172.21.15.112:6801/796623465","cluster_addr":"172.21.15.112:6803/796623465","heartbeat_back_addr":"172.21.15.112:6807/796623465","heartbeat_front_addr":"172.21.15.112:6805/796623465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.174731+0000","dead_epoch":117},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.475467+0000","dead_epoch":205},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.606174+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.835957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.753547+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T08:38:57.284212+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.4","osds":[5,1]},{"pgid":"3.a","osds":[2,5]},{"pgid":"3.16","osds":[4,3]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T08:44:16.593 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T08:44:16.593 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T08:44:16.749 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:44:16.749 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T08:44:16.749 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:44:16.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T08:44:17.047 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T08:44:17.064 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T08:44:17.064 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T08:44:17.202 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:44:17.202 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-14T08:44:17.202 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:44:17.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T08:44:17.497 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T08:44:17.516 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T08:44:17.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T08:44:17.651 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:44:17.651 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T08:44:17.651 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:44:17.665 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T08:44:17.959 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T08:44:17.978 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T08:44:17.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T08:44:18.123 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:44:18.123 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T08:44:18.123 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:44:18.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T08:44:18.414 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T08:44:18.432 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T08:44:18.432 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T08:44:18.575 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:44:18.575 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T08:44:18.576 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:44:18.590 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T08:44:18.870 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T08:44:18.887 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T08:44:18.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T08:44:19.026 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-14T08:44:19.026 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T08:44:19.026 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-14T08:44:19.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T08:44:19.308 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T08:44:19.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:44:19.615 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:44:19.615 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:44:19.631 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-09-14T08:44:18.354702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":472,"num_object_clones":0,"num_object_copies":944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":472,"num_whiteouts":464,"num_read":609890,"num_read_kb":1289084,"num_write":26590,"num_write_kb":296965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11164,"num_bytes_recovered":218429077,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24093,"ondisk_log_size":24093,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":331080,"kb_used_data":17856,"kb_used_omap":70,"kb_used_meta":313017,"kb_avail":565899960,"statfs":{"total":579820584960,"available":579481559040,"internally_reserved":0,"allocated":18284544,"data_stored":8467104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71786,"internal_metadata":320530326},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-659,"num_objects_misplaced":-136,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":262,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.968674"},"pg_stats":[{"pgid":"3.1f","version":"217'460","reported_seq":5330,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894001+0000","last_change":"2024-09-14T08:44:08.390806+0000","last_active":"2024-09-14T08:44:10.894001+0000","last_peered":"2024-09-14T08:44:10.894001+0000","last_clean":"2024-09-14T08:44:10.894001+0000","last_became_active":"2024-09-14T08:44:08.389408+0000","last_became_peered":"2024-09-14T08:44:08.389408+0000","last_unstale":"2024-09-14T08:44:10.894001+0000","last_undegraded":"2024-09-14T08:44:10.894001+0000","last_fullsized":"2024-09-14T08:44:10.894001+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:56.620484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016438780000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":3901,"num_read_kb":17036,"num_write":490,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":482,"num_bytes_recovered":8172556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"222'381","reported_seq":30464,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525981+0000","last_change":"2024-09-14T08:44:06.408757+0000","last_active":"2024-09-14T08:44:10.525981+0000","last_peered":"2024-09-14T08:44:10.525981+0000","last_clean":"2024-09-14T08:44:10.525981+0000","last_became_active":"2024-09-14T08:44:06.406436+0000","last_became_peered":"2024-09-14T08:44:06.406436+0000","last_unstale":"2024-09-14T08:44:10.525981+0000","last_undegraded":"2024-09-14T08:44:10.525981+0000","last_fullsized":"2024-09-14T08:44:10.525981+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:37.062114+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.042684857,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":28761,"num_read_kb":35233,"num_write":368,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":355,"num_bytes_recovered":515120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"222'750","reported_seq":8689,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898303+0000","last_change":"2024-09-14T08:44:07.416202+0000","last_active":"2024-09-14T08:44:10.898303+0000","last_peered":"2024-09-14T08:44:10.898303+0000","last_clean":"2024-09-14T08:44:10.898303+0000","last_became_active":"2024-09-14T08:44:07.410893+0000","last_became_peered":"2024-09-14T08:44:07.410893+0000","last_unstale":"2024-09-14T08:44:10.898303+0000","last_undegraded":"2024-09-14T08:44:10.898303+0000","last_fullsized":"2024-09-14T08:44:10.898303+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:26.339107+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.049489020000000002,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":10164,"num_read_kb":40300,"num_write":735,"num_write_kb":5110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":1147934,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"222'760","reported_seq":9287,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898348+0000","last_change":"2024-09-14T08:44:07.422741+0000","last_active":"2024-09-14T08:44:10.898348+0000","last_peered":"2024-09-14T08:44:10.898348+0000","last_clean":"2024-09-14T08:44:10.898348+0000","last_became_active":"2024-09-14T08:44:07.415742+0000","last_became_peered":"2024-09-14T08:44:07.415742+0000","last_unstale":"2024-09-14T08:44:10.898348+0000","last_undegraded":"2024-09-14T08:44:10.898348+0000","last_fullsized":"2024-09-14T08:44:10.898348+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:37.288749+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.059401431999999997,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":15,"num_read":8755,"num_read_kb":53187,"num_write":901,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":3698222,"num_keys_recovered":59,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"215'929","reported_seq":11250,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894125+0000","last_change":"2024-09-14T08:43:39.658480+0000","last_active":"2024-09-14T08:44:10.894125+0000","last_peered":"2024-09-14T08:44:10.894125+0000","last_clean":"2024-09-14T08:44:10.894125+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:44:10.894125+0000","last_undegraded":"2024-09-14T08:44:10.894125+0000","last_fullsized":"2024-09-14T08:44:10.894125+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:14.682609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001641146,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":11941,"num_read_kb":55626,"num_write":963,"num_write_kb":5928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"222'535","reported_seq":12802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897623+0000","last_change":"2024-09-14T08:43:53.753438+0000","last_active":"2024-09-14T08:44:10.897623+0000","last_peered":"2024-09-14T08:44:10.897623+0000","last_clean":"2024-09-14T08:44:10.897623+0000","last_became_active":"2024-09-14T08:43:53.474287+0000","last_became_peered":"2024-09-14T08:43:53.474287+0000","last_unstale":"2024-09-14T08:44:10.897623+0000","last_undegraded":"2024-09-14T08:44:10.897623+0000","last_fullsized":"2024-09-14T08:44:10.897623+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:17.015900+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.058553644000000002,"stat_sum":{"num_bytes":19,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":11827,"num_read_kb":31605,"num_write":546,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":6116492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"222'755","reported_seq":7459,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525223+0000","last_change":"2024-09-14T08:43:53.556657+0000","last_active":"2024-09-14T08:44:10.525223+0000","last_peered":"2024-09-14T08:44:10.525223+0000","last_clean":"2024-09-14T08:44:10.525223+0000","last_became_active":"2024-09-14T08:43:53.452873+0000","last_became_peered":"2024-09-14T08:43:53.452873+0000","last_unstale":"2024-09-14T08:44:10.525223+0000","last_undegraded":"2024-09-14T08:44:10.525223+0000","last_fullsized":"2024-09-14T08:44:10.525223+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:35.049723+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.036162803,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7603,"num_read_kb":22143,"num_write":748,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":3588110,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"214'592","reported_seq":7881,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524932+0000","last_change":"2024-09-14T08:43:39.592789+0000","last_active":"2024-09-14T08:44:10.524932+0000","last_peered":"2024-09-14T08:44:10.524932+0000","last_clean":"2024-09-14T08:44:10.524932+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:44:10.524932+0000","last_undegraded":"2024-09-14T08:44:10.524932+0000","last_fullsized":"2024-09-14T08:44:10.524932+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:25.103017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018468670000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":7942,"num_read_kb":29510,"num_write":481,"num_write_kb":3303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"216'791","reported_seq":7561,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894118+0000","last_change":"2024-09-14T08:44:05.406114+0000","last_active":"2024-09-14T08:44:10.894118+0000","last_peered":"2024-09-14T08:44:10.894118+0000","last_clean":"2024-09-14T08:44:10.894118+0000","last_became_active":"2024-09-14T08:44:05.404094+0000","last_became_peered":"2024-09-14T08:44:05.404094+0000","last_unstale":"2024-09-14T08:44:10.894118+0000","last_undegraded":"2024-09-14T08:44:10.894118+0000","last_fullsized":"2024-09-14T08:44:10.894118+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:04:22.949426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001891085,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":8172,"num_read_kb":36701,"num_write":1066,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":397,"num_bytes_recovered":4642734,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"222'664","reported_seq":7139,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897892+0000","last_change":"2024-09-14T08:44:02.406710+0000","last_active":"2024-09-14T08:44:10.897892+0000","last_peered":"2024-09-14T08:44:10.897892+0000","last_clean":"2024-09-14T08:44:10.897892+0000","last_became_active":"2024-09-14T08:44:02.400561+0000","last_became_peered":"2024-09-14T08:44:02.400561+0000","last_unstale":"2024-09-14T08:44:10.897892+0000","last_undegraded":"2024-09-14T08:44:10.897892+0000","last_fullsized":"2024-09-14T08:44:10.897892+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:44.768637+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050148086000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":31023,"num_read_kb":35394,"num_write":669,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":3628604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"216'1107","reported_seq":8313,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527890+0000","last_change":"2024-09-14T08:44:09.401728+0000","last_active":"2024-09-14T08:44:10.527890+0000","last_peered":"2024-09-14T08:44:10.527890+0000","last_clean":"2024-09-14T08:44:10.527890+0000","last_became_active":"2024-09-14T08:44:09.397717+0000","last_became_peered":"2024-09-14T08:44:09.397717+0000","last_unstale":"2024-09-14T08:44:10.527890+0000","last_undegraded":"2024-09-14T08:44:10.527890+0000","last_fullsized":"2024-09-14T08:44:10.527890+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.117371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371021,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12242,"num_read_kb":26406,"num_write":1299,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":535,"num_bytes_recovered":14245931,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"217'414","reported_seq":33294,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527734+0000","last_change":"2024-09-14T08:44:01.399150+0000","last_active":"2024-09-14T08:44:10.527734+0000","last_peered":"2024-09-14T08:44:10.527734+0000","last_clean":"2024-09-14T08:44:10.527734+0000","last_became_active":"2024-09-14T08:44:01.395419+0000","last_became_peered":"2024-09-14T08:44:01.395419+0000","last_unstale":"2024-09-14T08:44:10.527734+0000","last_undegraded":"2024-09-14T08:44:10.527734+0000","last_fullsized":"2024-09-14T08:44:10.527734+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:46.518606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052741680000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":32260,"num_read_kb":39536,"num_write":469,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":2619100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528347+0000","last_change":"2024-09-14T08:43:59.418934+0000","last_active":"2024-09-14T08:44:10.528347+0000","last_peered":"2024-09-14T08:44:10.528347+0000","last_clean":"2024-09-14T08:44:10.528347+0000","last_became_active":"2024-09-14T08:43:59.412933+0000","last_became_peered":"2024-09-14T08:43:59.412933+0000","last_unstale":"2024-09-14T08:44:10.528347+0000","last_undegraded":"2024-09-14T08:44:10.528347+0000","last_fullsized":"2024-09-14T08:44:10.528347+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:09.547187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"222'2432","reported_seq":59036,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.894044+0000","last_change":"2024-09-14T08:43:53.823293+0000","last_active":"2024-09-14T08:44:10.894044+0000","last_peered":"2024-09-14T08:44:10.894044+0000","last_clean":"2024-09-14T08:44:10.894044+0000","last_became_active":"2024-09-14T08:43:53.493591+0000","last_became_peered":"2024-09-14T08:43:53.493591+0000","last_unstale":"2024-09-14T08:44:10.894044+0000","last_undegraded":"2024-09-14T08:44:10.894044+0000","last_fullsized":"2024-09-14T08:44:10.894044+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":2432,"log_dups_size":0,"ondisk_log_size":2432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:38.040189+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.066703469000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":67566,"num_read_kb":68156,"num_write":3798,"num_write_kb":9140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":455,"num_bytes_recovered":11715346,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526107+0000","last_change":"2024-09-14T08:43:59.420342+0000","last_active":"2024-09-14T08:44:10.526107+0000","last_peered":"2024-09-14T08:44:10.526107+0000","last_clean":"2024-09-14T08:44:10.526107+0000","last_became_active":"2024-09-14T08:43:59.417188+0000","last_became_peered":"2024-09-14T08:43:59.417188+0000","last_unstale":"2024-09-14T08:44:10.526107+0000","last_undegraded":"2024-09-14T08:44:10.526107+0000","last_fullsized":"2024-09-14T08:44:10.526107+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:19.062815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"222'771","reported_seq":59115,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.526084+0000","last_change":"2024-09-14T08:43:53.590126+0000","last_active":"2024-09-14T08:44:10.526084+0000","last_peered":"2024-09-14T08:44:10.526084+0000","last_clean":"2024-09-14T08:44:10.526084+0000","last_became_active":"2024-09-14T08:43:53.485749+0000","last_became_peered":"2024-09-14T08:43:53.485749+0000","last_unstale":"2024-09-14T08:44:10.526084+0000","last_undegraded":"2024-09-14T08:44:10.526084+0000","last_fullsized":"2024-09-14T08:44:10.526084+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:40:38.092608+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.029629143,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":52542,"num_read_kb":50304,"num_write":575,"num_write_kb":32325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":262,"num_bytes_recovered":6496921,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528066+0000","last_change":"2024-09-14T08:43:59.410903+0000","last_active":"2024-09-14T08:44:10.528066+0000","last_peered":"2024-09-14T08:44:10.528066+0000","last_clean":"2024-09-14T08:44:10.528066+0000","last_became_active":"2024-09-14T08:43:59.410081+0000","last_became_peered":"2024-09-14T08:43:59.410081+0000","last_unstale":"2024-09-14T08:44:10.528066+0000","last_undegraded":"2024-09-14T08:44:10.528066+0000","last_fullsized":"2024-09-14T08:44:10.528066+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:07.401067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"222'641","reported_seq":6465,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898822+0000","last_change":"2024-09-14T08:44:07.414796+0000","last_active":"2024-09-14T08:44:10.898822+0000","last_peered":"2024-09-14T08:44:10.898822+0000","last_clean":"2024-09-14T08:44:10.898822+0000","last_became_active":"2024-09-14T08:44:07.405923+0000","last_became_peered":"2024-09-14T08:44:07.405923+0000","last_unstale":"2024-09-14T08:44:10.898822+0000","last_undegraded":"2024-09-14T08:44:10.898822+0000","last_fullsized":"2024-09-14T08:44:10.898822+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:57.074695+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.040351541999999997,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":6460,"num_read_kb":17251,"num_write":625,"num_write_kb":20411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":498,"num_bytes_recovered":6627757,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525679+0000","last_change":"2024-09-14T08:43:53.481113+0000","last_active":"2024-09-14T08:44:10.525679+0000","last_peered":"2024-09-14T08:44:10.525679+0000","last_clean":"2024-09-14T08:44:10.525679+0000","last_became_active":"2024-09-14T08:43:53.480382+0000","last_became_peered":"2024-09-14T08:43:53.480382+0000","last_unstale":"2024-09-14T08:44:10.525679+0000","last_undegraded":"2024-09-14T08:44:10.525679+0000","last_fullsized":"2024-09-14T08:44:10.525679+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:40.958509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"222'805","reported_seq":11063,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898417+0000","last_change":"2024-09-14T08:44:07.411700+0000","last_active":"2024-09-14T08:44:10.898417+0000","last_peered":"2024-09-14T08:44:10.898417+0000","last_clean":"2024-09-14T08:44:10.898417+0000","last_became_active":"2024-09-14T08:44:07.406747+0000","last_became_peered":"2024-09-14T08:44:07.406747+0000","last_unstale":"2024-09-14T08:44:10.898417+0000","last_undegraded":"2024-09-14T08:44:10.898417+0000","last_fullsized":"2024-09-14T08:44:10.898417+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:31.593890+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.034384078999999998,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":11288,"num_read_kb":43310,"num_write":1070,"num_write_kb":21593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":311,"num_bytes_recovered":4578256,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"217'1582","reported_seq":21530,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898225+0000","last_change":"2024-09-14T08:43:39.607463+0000","last_active":"2024-09-14T08:44:10.898225+0000","last_peered":"2024-09-14T08:44:10.898225+0000","last_clean":"2024-09-14T08:44:10.898225+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:44:10.898225+0000","last_undegraded":"2024-09-14T08:44:10.898225+0000","last_fullsized":"2024-09-14T08:44:10.898225+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1582,"log_dups_size":0,"ondisk_log_size":1582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:50.821083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050029469999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":22,"num_read":24909,"num_read_kb":27100,"num_write":2438,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":69,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898104+0000","last_change":"2024-09-14T08:44:07.404347+0000","last_active":"2024-09-14T08:44:10.898104+0000","last_peered":"2024-09-14T08:44:10.898104+0000","last_clean":"2024-09-14T08:44:10.898104+0000","last_became_active":"2024-09-14T08:44:07.403501+0000","last_became_peered":"2024-09-14T08:44:07.403501+0000","last_unstale":"2024-09-14T08:44:10.898104+0000","last_undegraded":"2024-09-14T08:44:10.898104+0000","last_fullsized":"2024-09-14T08:44:10.898104+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:22:14.375160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"222'466","reported_seq":28009,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525210+0000","last_change":"2024-09-14T08:43:53.620465+0000","last_active":"2024-09-14T08:44:10.525210+0000","last_peered":"2024-09-14T08:44:10.525210+0000","last_clean":"2024-09-14T08:44:10.525210+0000","last_became_active":"2024-09-14T08:43:53.464437+0000","last_became_peered":"2024-09-14T08:43:53.464437+0000","last_unstale":"2024-09-14T08:44:10.525210+0000","last_undegraded":"2024-09-14T08:44:10.525210+0000","last_fullsized":"2024-09-14T08:44:10.525210+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:53.362716+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.055535908000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":26972,"num_read_kb":27595,"num_write":457,"num_write_kb":3537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":3380924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":477,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525243+0000","last_change":"2024-09-14T08:43:53.459922+0000","last_active":"2024-09-14T08:44:10.525243+0000","last_peered":"2024-09-14T08:44:10.525243+0000","last_clean":"2024-09-14T08:44:10.525243+0000","last_became_active":"2024-09-14T08:43:53.458867+0000","last_became_peered":"2024-09-14T08:43:53.458867+0000","last_unstale":"2024-09-14T08:44:10.525243+0000","last_undegraded":"2024-09-14T08:44:10.525243+0000","last_fullsized":"2024-09-14T08:44:10.525243+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:58.597461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"214'425","reported_seq":8808,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893899+0000","last_change":"2024-09-14T08:43:39.657773+0000","last_active":"2024-09-14T08:44:10.893899+0000","last_peered":"2024-09-14T08:44:10.893899+0000","last_clean":"2024-09-14T08:44:10.893899+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:44:10.893899+0000","last_undegraded":"2024-09-14T08:44:10.893899+0000","last_fullsized":"2024-09-14T08:44:10.893899+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:15.972399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001097399,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7748,"num_read_kb":16836,"num_write":423,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527639+0000","last_change":"2024-09-14T08:43:59.401455+0000","last_active":"2024-09-14T08:44:10.527639+0000","last_peered":"2024-09-14T08:44:10.527639+0000","last_clean":"2024-09-14T08:44:10.527639+0000","last_became_active":"2024-09-14T08:43:59.398475+0000","last_became_peered":"2024-09-14T08:43:59.398475+0000","last_unstale":"2024-09-14T08:44:10.527639+0000","last_undegraded":"2024-09-14T08:44:10.527639+0000","last_fullsized":"2024-09-14T08:44:10.527639+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:07.678890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"222'533","reported_seq":18802,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525614+0000","last_change":"2024-09-14T08:44:03.397964+0000","last_active":"2024-09-14T08:44:10.525614+0000","last_peered":"2024-09-14T08:44:10.525614+0000","last_clean":"2024-09-14T08:44:10.525614+0000","last_became_active":"2024-09-14T08:44:03.395670+0000","last_became_peered":"2024-09-14T08:44:03.395670+0000","last_unstale":"2024-09-14T08:44:10.525614+0000","last_undegraded":"2024-09-14T08:44:10.525614+0000","last_fullsized":"2024-09-14T08:44:10.525614+0000","mapping_epoch":228,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":229,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:11.528255+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.040148494999999999,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":17829,"num_read_kb":57289,"num_write":620,"num_write_kb":6801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":569,"num_bytes_recovered":15227317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":383,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898157+0000","last_change":"2024-09-14T08:44:07.409575+0000","last_active":"2024-09-14T08:44:10.898157+0000","last_peered":"2024-09-14T08:44:10.898157+0000","last_clean":"2024-09-14T08:44:10.898157+0000","last_became_active":"2024-09-14T08:44:07.408549+0000","last_became_peered":"2024-09-14T08:44:07.408549+0000","last_unstale":"2024-09-14T08:44:10.898157+0000","last_undegraded":"2024-09-14T08:44:10.898157+0000","last_fullsized":"2024-09-14T08:44:10.898157+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:07.098446+0000","last_clean_scrub_stamp":"2024-09-14T08:39:07.098446+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:28.425168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":39,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527628+0000","last_change":"2024-09-14T08:43:59.432210+0000","last_active":"2024-09-14T08:44:10.527628+0000","last_peered":"2024-09-14T08:44:10.527628+0000","last_clean":"2024-09-14T08:44:10.527628+0000","last_became_active":"2024-09-14T08:43:59.418428+0000","last_became_peered":"2024-09-14T08:43:59.418428+0000","last_unstale":"2024-09-14T08:44:10.527628+0000","last_undegraded":"2024-09-14T08:44:10.527628+0000","last_fullsized":"2024-09-14T08:44:10.527628+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:00.908063+0000","last_clean_scrub_stamp":"2024-09-14T08:39:00.908063+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:56:57.805159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"222'613","reported_seq":35728,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.524989+0000","last_change":"2024-09-14T08:43:53.686001+0000","last_active":"2024-09-14T08:44:10.524989+0000","last_peered":"2024-09-14T08:44:10.524989+0000","last_clean":"2024-09-14T08:44:10.524989+0000","last_became_active":"2024-09-14T08:43:53.487405+0000","last_became_peered":"2024-09-14T08:43:53.487405+0000","last_unstale":"2024-09-14T08:44:10.524989+0000","last_undegraded":"2024-09-14T08:44:10.524989+0000","last_fullsized":"2024-09-14T08:44:10.524989+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:20.351169+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.024367663000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":33488,"num_read_kb":35878,"num_write":489,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":2364662,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"214'1053","reported_seq":16852,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897513+0000","last_change":"2024-09-14T08:43:39.605741+0000","last_active":"2024-09-14T08:44:10.897513+0000","last_peered":"2024-09-14T08:44:10.897513+0000","last_clean":"2024-09-14T08:44:10.897513+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:44:10.897513+0000","last_undegraded":"2024-09-14T08:44:10.897513+0000","last_fullsized":"2024-09-14T08:44:10.897513+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:59.457424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052773719999999998,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":16233,"num_read_kb":33099,"num_write":859,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"222'681","reported_seq":14472,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525569+0000","last_change":"2024-09-14T08:44:05.402563+0000","last_active":"2024-09-14T08:44:10.525569+0000","last_peered":"2024-09-14T08:44:10.525569+0000","last_clean":"2024-09-14T08:44:10.525569+0000","last_became_active":"2024-09-14T08:44:05.398159+0000","last_became_peered":"2024-09-14T08:44:05.398159+0000","last_unstale":"2024-09-14T08:44:10.525569+0000","last_undegraded":"2024-09-14T08:44:10.525569+0000","last_fullsized":"2024-09-14T08:44:10.525569+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:12.499363+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.050530626000000002,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":14875,"num_read_kb":84017,"num_write":659,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":18337410,"num_keys_recovered":105,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"222'658","reported_seq":5999,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.525728+0000","last_change":"2024-09-14T08:43:53.646871+0000","last_active":"2024-09-14T08:44:10.525728+0000","last_peered":"2024-09-14T08:44:10.525728+0000","last_clean":"2024-09-14T08:44:10.525728+0000","last_became_active":"2024-09-14T08:43:53.480067+0000","last_became_peered":"2024-09-14T08:43:53.480067+0000","last_unstale":"2024-09-14T08:44:10.525728+0000","last_undegraded":"2024-09-14T08:44:10.525728+0000","last_fullsized":"2024-09-14T08:44:10.525728+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:54.483372+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.051150345999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6328,"num_read_kb":21947,"num_write":820,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":389,"num_bytes_recovered":7762120,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"222'1049","reported_seq":45235,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898566+0000","last_change":"2024-09-14T08:44:07.422801+0000","last_active":"2024-09-14T08:44:10.898566+0000","last_peered":"2024-09-14T08:44:10.898566+0000","last_clean":"2024-09-14T08:44:10.898566+0000","last_became_active":"2024-09-14T08:44:07.414903+0000","last_became_peered":"2024-09-14T08:44:07.414903+0000","last_unstale":"2024-09-14T08:44:10.898566+0000","last_undegraded":"2024-09-14T08:44:10.898566+0000","last_fullsized":"2024-09-14T08:44:10.898566+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.984066+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.068642173000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":49733,"num_read_kb":103295,"num_write":819,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":12466332,"num_keys_recovered":182,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"214'694","reported_seq":8302,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.528148+0000","last_change":"2024-09-14T08:44:06.414747+0000","last_active":"2024-09-14T08:44:10.528148+0000","last_peered":"2024-09-14T08:44:10.528148+0000","last_clean":"2024-09-14T08:44:10.528148+0000","last_became_active":"2024-09-14T08:44:06.407599+0000","last_became_peered":"2024-09-14T08:44:06.407599+0000","last_unstale":"2024-09-14T08:44:10.528148+0000","last_undegraded":"2024-09-14T08:44:10.528148+0000","last_fullsized":"2024-09-14T08:44:10.528148+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:09.433157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014175520000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":9196,"num_read_kb":22714,"num_write":526,"num_write_kb":7334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":391,"num_bytes_recovered":6800384,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"222'321","reported_seq":7626,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898657+0000","last_change":"2024-09-14T08:44:07.412670+0000","last_active":"2024-09-14T08:44:10.898657+0000","last_peered":"2024-09-14T08:44:10.898657+0000","last_clean":"2024-09-14T08:44:10.898657+0000","last_became_active":"2024-09-14T08:44:07.408742+0000","last_became_peered":"2024-09-14T08:44:07.408742+0000","last_unstale":"2024-09-14T08:44:10.898657+0000","last_undegraded":"2024-09-14T08:44:10.898657+0000","last_fullsized":"2024-09-14T08:44:10.898657+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:02.288720+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.035863521000000002,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":6541,"num_read_kb":21437,"num_write":285,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":561152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"222'572","reported_seq":10035,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.898548+0000","last_change":"2024-09-14T08:44:07.415164+0000","last_active":"2024-09-14T08:44:10.898548+0000","last_peered":"2024-09-14T08:44:10.898548+0000","last_clean":"2024-09-14T08:44:10.898548+0000","last_became_active":"2024-09-14T08:44:07.406874+0000","last_became_peered":"2024-09-14T08:44:07.406874+0000","last_unstale":"2024-09-14T08:44:10.898548+0000","last_undegraded":"2024-09-14T08:44:10.898548+0000","last_fullsized":"2024-09-14T08:44:10.898548+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:38.272726+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053448875,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":7838,"num_read_kb":43795,"num_write":497,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":640,"num_bytes_recovered":25134704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"222'509","reported_seq":20077,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.897511+0000","last_change":"2024-09-14T08:44:07.407192+0000","last_active":"2024-09-14T08:44:10.897511+0000","last_peered":"2024-09-14T08:44:10.897511+0000","last_clean":"2024-09-14T08:44:10.897511+0000","last_became_active":"2024-09-14T08:44:07.403507+0000","last_became_peered":"2024-09-14T08:44:07.403507+0000","last_unstale":"2024-09-14T08:44:10.897511+0000","last_undegraded":"2024-09-14T08:44:10.897511+0000","last_fullsized":"2024-09-14T08:44:10.897511+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:16.328502+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.050693604000000003,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20159,"num_read_kb":55886,"num_write":485,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":360,"num_bytes_recovered":2324520,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"214'552","reported_seq":44239,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527808+0000","last_change":"2024-09-14T08:44:08.397958+0000","last_active":"2024-09-14T08:44:10.527808+0000","last_peered":"2024-09-14T08:44:10.527808+0000","last_clean":"2024-09-14T08:44:10.527808+0000","last_became_active":"2024-09-14T08:44:08.392150+0000","last_became_peered":"2024-09-14T08:44:08.392150+0000","last_unstale":"2024-09-14T08:44:10.527808+0000","last_undegraded":"2024-09-14T08:44:10.527808+0000","last_fullsized":"2024-09-14T08:44:10.527808+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:21.006773+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.0046849040000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":44159,"num_read_kb":101736,"num_write":433,"num_write_kb":14207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":14335213,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"222'639","reported_seq":7204,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.893897+0000","last_change":"2024-09-14T08:44:09.396495+0000","last_active":"2024-09-14T08:44:10.893897+0000","last_peered":"2024-09-14T08:44:10.893897+0000","last_clean":"2024-09-14T08:44:10.893897+0000","last_became_active":"2024-09-14T08:44:09.394635+0000","last_became_peered":"2024-09-14T08:44:09.394635+0000","last_unstale":"2024-09-14T08:44:10.893897+0000","last_undegraded":"2024-09-14T08:44:10.893897+0000","last_fullsized":"2024-09-14T08:44:10.893897+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:32.203345+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.041958433000000003,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5789,"num_read_kb":20892,"num_write":624,"num_write_kb":8469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":542,"num_bytes_recovered":17076794,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"214'884","reported_seq":4179,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:10.527655+0000","last_change":"2024-09-14T08:44:06.415948+0000","last_active":"2024-09-14T08:44:10.527655+0000","last_peered":"2024-09-14T08:44:10.527655+0000","last_clean":"2024-09-14T08:44:10.527655+0000","last_became_active":"2024-09-14T08:44:06.410917+0000","last_became_peered":"2024-09-14T08:44:06.410917+0000","last_unstale":"2024-09-14T08:44:10.527655+0000","last_undegraded":"2024-09-14T08:44:10.527655+0000","last_fullsized":"2024-09-14T08:44:10.527655+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:39:17.345361+0000","last_clean_scrub_stamp":"2024-09-14T08:39:17.345361+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:53.099036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000881582,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":5580,"num_read_kb":13815,"num_write":1250,"num_write_kb":9128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":379,"num_bytes_recovered":3502437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":464,"num_read":609824,"num_read_kb":1289029,"num_write":26487,"num_write_kb":295335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11149,"num_bytes_recovered":214886831,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30533,"internal_metadata":0},"log_size":24018,"ondisk_log_size":24018,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65908,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94305932,"statfs":{"total":96636764160,"available":96569274368,"internally_reserved":0,"allocated":2850816,"data_stored":1214401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52600,"kb_used_data":3360,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319240,"statfs":{"total":96636764160,"available":96582901760,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56180,"kb_used_data":2780,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315660,"statfs":{"total":96636764160,"available":96579235840,"internally_reserved":0,"allocated":2846720,"data_stored":1214382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":221,"seq":949187772423,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":2788,"kb_used_omap":41,"kb_used_meta":30102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":2854912,"data_stored":1214420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42656,"internal_metadata":30824800},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607620,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82548,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94289292,"statfs":{"total":96636764160,"available":96552235008,"internally_reserved":0,"allocated":2850816,"data_stored":1214401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846622,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40888,"kb_used_data":3360,"kb_used_omap":22,"kb_used_meta":37481,"kb_avail":94330952,"statfs":{"total":96636764160,"available":96594894848,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":38381344},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17459,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:44:19.636 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.637 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.637 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.637 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.637 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.638 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.638 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.638 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.638 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.638 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.638 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.638 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.638 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T08:39:07.098446+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.638 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.639 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T08:39:07.098446+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.639 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.639 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T08:39:07.098446+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.639 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.639 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T08:39:07.098446+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.639 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.639 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.639 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T08:39:07.098446+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.640 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.640 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T08:39:07.098446+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.640 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.640 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T08:39:07.098446+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.640 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.640 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T08:39:07.098446+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.641 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T08:39:00.908063+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.641 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.641 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.642 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.642 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.642 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.642 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.642 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.642 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.642 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.643 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.643 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.643 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T08:39:17.345361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=39, tm_sec=17, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=8, tm_min=44, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T08:44:19.643 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T08:44:39.644 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T08:44:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-14T08:44:39.959 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-14T08:44:39.975 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-09-14T08:44:38.361359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":472,"num_object_clones":0,"num_object_copies":944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":472,"num_whiteouts":464,"num_read":609890,"num_read_kb":1289084,"num_write":26590,"num_write_kb":296965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11164,"num_bytes_recovered":218429077,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24565,"ondisk_log_size":24565,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":318560,"kb_used_data":17856,"kb_used_omap":70,"kb_used_meta":300537,"kb_avail":565912480,"statfs":{"total":579820584960,"available":579494379520,"internally_reserved":0,"allocated":18284544,"data_stored":8467104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71786,"internal_metadata":307750806},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003721"},"pg_stats":[{"pgid":"3.1f","version":"236'480","reported_seq":5359,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:21.521735+0000","last_change":"2024-09-14T08:44:21.521589+0000","last_active":"2024-09-14T08:44:21.521735+0000","last_peered":"2024-09-14T08:44:21.521735+0000","last_clean":"2024-09-14T08:44:21.521735+0000","last_became_active":"2024-09-14T08:44:08.389408+0000","last_became_peered":"2024-09-14T08:44:08.389408+0000","last_unstale":"2024-09-14T08:44:21.521735+0000","last_undegraded":"2024-09-14T08:44:21.521735+0000","last_fullsized":"2024-09-14T08:44:21.521735+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'480","last_scrub_stamp":"2024-09-14T08:44:21.521373+0000","last_deep_scrub":"236'480","last_deep_scrub_stamp":"2024-09-14T08:44:21.521373+0000","last_clean_scrub_stamp":"2024-09-14T08:44:21.521373+0000","objects_scrubbed":20,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:36.628400+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0016438780000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":3901,"num_read_kb":17036,"num_write":490,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":482,"num_bytes_recovered":8172556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"236'397","reported_seq":30488,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:20.705165+0000","last_change":"2024-09-14T08:44:20.705165+0000","last_active":"2024-09-14T08:44:20.705165+0000","last_peered":"2024-09-14T08:44:20.705165+0000","last_clean":"2024-09-14T08:44:20.705165+0000","last_became_active":"2024-09-14T08:44:06.406436+0000","last_became_peered":"2024-09-14T08:44:06.406436+0000","last_unstale":"2024-09-14T08:44:20.705165+0000","last_undegraded":"2024-09-14T08:44:20.705165+0000","last_fullsized":"2024-09-14T08:44:20.705165+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'397","last_scrub_stamp":"2024-09-14T08:44:20.704974+0000","last_deep_scrub":"236'397","last_deep_scrub_stamp":"2024-09-14T08:44:20.704974+0000","last_clean_scrub_stamp":"2024-09-14T08:44:20.704974+0000","objects_scrubbed":16,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:04:54.215021+0000","scrub_duration":23,"objects_trimmed":10,"snaptrim_duration":0.042684857,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":28761,"num_read_kb":35233,"num_write":368,"num_write_kb":3490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":355,"num_bytes_recovered":515120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"236'766","reported_seq":8713,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:28.397398+0000","last_change":"2024-09-14T08:44:28.397398+0000","last_active":"2024-09-14T08:44:28.397398+0000","last_peered":"2024-09-14T08:44:28.397398+0000","last_clean":"2024-09-14T08:44:28.397398+0000","last_became_active":"2024-09-14T08:44:07.410893+0000","last_became_peered":"2024-09-14T08:44:07.410893+0000","last_unstale":"2024-09-14T08:44:28.397398+0000","last_undegraded":"2024-09-14T08:44:28.397398+0000","last_fullsized":"2024-09-14T08:44:28.397398+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'766","last_scrub_stamp":"2024-09-14T08:44:28.397157+0000","last_deep_scrub":"236'766","last_deep_scrub_stamp":"2024-09-14T08:44:28.397157+0000","last_clean_scrub_stamp":"2024-09-14T08:44:28.397157+0000","objects_scrubbed":16,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:43.273895+0000","scrub_duration":31,"objects_trimmed":10,"snaptrim_duration":0.049489020000000002,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":10164,"num_read_kb":40300,"num_write":735,"num_write_kb":5110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":1147934,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"236'776","reported_seq":9311,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:27.355773+0000","last_change":"2024-09-14T08:44:27.355773+0000","last_active":"2024-09-14T08:44:27.355773+0000","last_peered":"2024-09-14T08:44:27.355773+0000","last_clean":"2024-09-14T08:44:27.355773+0000","last_became_active":"2024-09-14T08:44:07.415742+0000","last_became_peered":"2024-09-14T08:44:07.415742+0000","last_unstale":"2024-09-14T08:44:27.355773+0000","last_undegraded":"2024-09-14T08:44:27.355773+0000","last_fullsized":"2024-09-14T08:44:27.355773+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'776","last_scrub_stamp":"2024-09-14T08:44:27.355518+0000","last_deep_scrub":"236'776","last_deep_scrub_stamp":"2024-09-14T08:44:27.355518+0000","last_clean_scrub_stamp":"2024-09-14T08:44:27.355518+0000","objects_scrubbed":16,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:52.481673+0000","scrub_duration":31,"objects_trimmed":6,"snaptrim_duration":0.059401431999999997,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":15,"num_read":8755,"num_read_kb":53187,"num_write":901,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":3698222,"num_keys_recovered":59,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"236'940","reported_seq":11269,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:22.555689+0000","last_change":"2024-09-14T08:44:22.555689+0000","last_active":"2024-09-14T08:44:22.555689+0000","last_peered":"2024-09-14T08:44:22.555689+0000","last_clean":"2024-09-14T08:44:22.555689+0000","last_became_active":"2024-09-14T08:42:22.385160+0000","last_became_peered":"2024-09-14T08:42:22.385160+0000","last_unstale":"2024-09-14T08:44:22.555689+0000","last_undegraded":"2024-09-14T08:44:22.555689+0000","last_fullsized":"2024-09-14T08:44:22.555689+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'940","last_scrub_stamp":"2024-09-14T08:44:22.555465+0000","last_deep_scrub":"236'940","last_deep_scrub_stamp":"2024-09-14T08:44:22.555465+0000","last_clean_scrub_stamp":"2024-09-14T08:44:22.555465+0000","objects_scrubbed":11,"log_size":940,"log_dups_size":0,"ondisk_log_size":940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:11.263175+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0.001641146,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":11941,"num_read_kb":55626,"num_write":963,"num_write_kb":5928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":3454202,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"236'544","reported_seq":12820,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:22.908200+0000","last_change":"2024-09-14T08:44:22.908200+0000","last_active":"2024-09-14T08:44:22.908200+0000","last_peered":"2024-09-14T08:44:22.908200+0000","last_clean":"2024-09-14T08:44:22.908200+0000","last_became_active":"2024-09-14T08:43:53.474287+0000","last_became_peered":"2024-09-14T08:43:53.474287+0000","last_unstale":"2024-09-14T08:44:22.908200+0000","last_undegraded":"2024-09-14T08:44:22.908200+0000","last_fullsized":"2024-09-14T08:44:22.908200+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'544","last_scrub_stamp":"2024-09-14T08:44:22.908010+0000","last_deep_scrub":"236'544","last_deep_scrub_stamp":"2024-09-14T08:44:22.908010+0000","last_clean_scrub_stamp":"2024-09-14T08:44:22.908010+0000","objects_scrubbed":9,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:52.497962+0000","scrub_duration":15,"objects_trimmed":10,"snaptrim_duration":0.058553644000000002,"stat_sum":{"num_bytes":19,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":11827,"num_read_kb":31605,"num_write":546,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":6116492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"236'772","reported_seq":7484,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:22.703128+0000","last_change":"2024-09-14T08:44:22.703128+0000","last_active":"2024-09-14T08:44:22.703128+0000","last_peered":"2024-09-14T08:44:22.703128+0000","last_clean":"2024-09-14T08:44:22.703128+0000","last_became_active":"2024-09-14T08:43:53.452873+0000","last_became_peered":"2024-09-14T08:43:53.452873+0000","last_unstale":"2024-09-14T08:44:22.703128+0000","last_undegraded":"2024-09-14T08:44:22.703128+0000","last_fullsized":"2024-09-14T08:44:22.703128+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'772","last_scrub_stamp":"2024-09-14T08:44:22.702900+0000","last_deep_scrub":"236'772","last_deep_scrub_stamp":"2024-09-14T08:44:22.702900+0000","last_clean_scrub_stamp":"2024-09-14T08:44:22.702900+0000","objects_scrubbed":17,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:54.213415+0000","scrub_duration":39,"objects_trimmed":4,"snaptrim_duration":0.036162803,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7603,"num_read_kb":22143,"num_write":748,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":3588110,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"236'616","reported_seq":7913,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:23.735584+0000","last_change":"2024-09-14T08:44:23.735584+0000","last_active":"2024-09-14T08:44:23.735584+0000","last_peered":"2024-09-14T08:44:23.735584+0000","last_clean":"2024-09-14T08:44:23.735584+0000","last_became_active":"2024-09-14T08:42:21.375466+0000","last_became_peered":"2024-09-14T08:42:21.375466+0000","last_unstale":"2024-09-14T08:44:23.735584+0000","last_undegraded":"2024-09-14T08:44:23.735584+0000","last_fullsized":"2024-09-14T08:44:23.735584+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'616","last_scrub_stamp":"2024-09-14T08:44:23.735346+0000","last_deep_scrub":"236'616","last_deep_scrub_stamp":"2024-09-14T08:44:23.735346+0000","last_clean_scrub_stamp":"2024-09-14T08:44:23.735346+0000","objects_scrubbed":24,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:11.788688+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0018468670000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":7942,"num_read_kb":29510,"num_write":481,"num_write_kb":3303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":934854,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"236'804","reported_seq":7582,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:20.549118+0000","last_change":"2024-09-14T08:44:20.549118+0000","last_active":"2024-09-14T08:44:20.549118+0000","last_peered":"2024-09-14T08:44:20.549118+0000","last_clean":"2024-09-14T08:44:20.549118+0000","last_became_active":"2024-09-14T08:44:05.404094+0000","last_became_peered":"2024-09-14T08:44:05.404094+0000","last_unstale":"2024-09-14T08:44:20.549118+0000","last_undegraded":"2024-09-14T08:44:20.549118+0000","last_fullsized":"2024-09-14T08:44:20.549118+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'804","last_scrub_stamp":"2024-09-14T08:44:20.548925+0000","last_deep_scrub":"236'804","last_deep_scrub_stamp":"2024-09-14T08:44:20.548925+0000","last_clean_scrub_stamp":"2024-09-14T08:44:20.548925+0000","objects_scrubbed":13,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:35.920022+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0.001891085,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":8172,"num_read_kb":36701,"num_write":1066,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":397,"num_bytes_recovered":4642734,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"236'676","reported_seq":7159,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:21.865729+0000","last_change":"2024-09-14T08:44:21.865729+0000","last_active":"2024-09-14T08:44:21.865729+0000","last_peered":"2024-09-14T08:44:21.865729+0000","last_clean":"2024-09-14T08:44:21.865729+0000","last_became_active":"2024-09-14T08:44:02.400561+0000","last_became_peered":"2024-09-14T08:44:02.400561+0000","last_unstale":"2024-09-14T08:44:21.865729+0000","last_undegraded":"2024-09-14T08:44:21.865729+0000","last_fullsized":"2024-09-14T08:44:21.865729+0000","mapping_epoch":227,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'676","last_scrub_stamp":"2024-09-14T08:44:21.865490+0000","last_deep_scrub":"236'676","last_deep_scrub_stamp":"2024-09-14T08:44:21.865490+0000","last_clean_scrub_stamp":"2024-09-14T08:44:21.865490+0000","objects_scrubbed":12,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:22.616696+0000","scrub_duration":23,"objects_trimmed":10,"snaptrim_duration":0.050148086000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":31023,"num_read_kb":35394,"num_write":669,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":3628604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"236'1121","reported_seq":8335,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:27.068761+0000","last_change":"2024-09-14T08:44:27.068761+0000","last_active":"2024-09-14T08:44:27.068761+0000","last_peered":"2024-09-14T08:44:27.068761+0000","last_clean":"2024-09-14T08:44:27.068761+0000","last_became_active":"2024-09-14T08:44:09.397717+0000","last_became_peered":"2024-09-14T08:44:09.397717+0000","last_unstale":"2024-09-14T08:44:27.068761+0000","last_undegraded":"2024-09-14T08:44:27.068761+0000","last_fullsized":"2024-09-14T08:44:27.068761+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'1121","last_scrub_stamp":"2024-09-14T08:44:27.068517+0000","last_deep_scrub":"236'1121","last_deep_scrub_stamp":"2024-09-14T08:44:27.068517+0000","last_clean_scrub_stamp":"2024-09-14T08:44:27.068517+0000","objects_scrubbed":14,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:37.796416+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.001371021,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12242,"num_read_kb":26406,"num_write":1299,"num_write_kb":10050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":535,"num_bytes_recovered":14245931,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"236'426","reported_seq":33314,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:26.033090+0000","last_change":"2024-09-14T08:44:26.033090+0000","last_active":"2024-09-14T08:44:26.033090+0000","last_peered":"2024-09-14T08:44:26.033090+0000","last_clean":"2024-09-14T08:44:26.033090+0000","last_became_active":"2024-09-14T08:44:01.395419+0000","last_became_peered":"2024-09-14T08:44:01.395419+0000","last_unstale":"2024-09-14T08:44:26.033090+0000","last_undegraded":"2024-09-14T08:44:26.033090+0000","last_fullsized":"2024-09-14T08:44:26.033090+0000","mapping_epoch":226,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":227,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'426","last_scrub_stamp":"2024-09-14T08:44:26.032753+0000","last_deep_scrub":"236'426","last_deep_scrub_stamp":"2024-09-14T08:44:26.032753+0000","last_clean_scrub_stamp":"2024-09-14T08:44:26.032753+0000","objects_scrubbed":12,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:17.741196+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0.0052741680000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":32260,"num_read_kb":39536,"num_write":469,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":2619100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:21.939526+0000","last_change":"2024-09-14T08:44:21.939526+0000","last_active":"2024-09-14T08:44:21.939526+0000","last_peered":"2024-09-14T08:44:21.939526+0000","last_clean":"2024-09-14T08:44:21.939526+0000","last_became_active":"2024-09-14T08:43:59.412933+0000","last_became_peered":"2024-09-14T08:43:59.412933+0000","last_unstale":"2024-09-14T08:44:21.939526+0000","last_undegraded":"2024-09-14T08:44:21.939526+0000","last_fullsized":"2024-09-14T08:44:21.939526+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:44:21.939345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:44:21.939345+0000","last_clean_scrub_stamp":"2024-09-14T08:44:21.939345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:35.967820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"236'2448","reported_seq":59061,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:18.517155+0000","last_change":"2024-09-14T08:44:18.517105+0000","last_active":"2024-09-14T08:44:18.517155+0000","last_peered":"2024-09-14T08:44:18.517155+0000","last_clean":"2024-09-14T08:44:18.517155+0000","last_became_active":"2024-09-14T08:43:53.493591+0000","last_became_peered":"2024-09-14T08:43:53.493591+0000","last_unstale":"2024-09-14T08:44:18.517155+0000","last_undegraded":"2024-09-14T08:44:18.517155+0000","last_fullsized":"2024-09-14T08:44:18.517155+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'2448","last_scrub_stamp":"2024-09-14T08:44:18.516891+0000","last_deep_scrub":"236'2448","last_deep_scrub_stamp":"2024-09-14T08:44:18.516891+0000","last_clean_scrub_stamp":"2024-09-14T08:44:18.516891+0000","objects_scrubbed":16,"log_size":2448,"log_dups_size":0,"ondisk_log_size":2448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:27.349314+0000","scrub_duration":27,"objects_trimmed":10,"snaptrim_duration":0.066703469000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":67566,"num_read_kb":68156,"num_write":3798,"num_write_kb":9140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":455,"num_bytes_recovered":11715346,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:19.691342+0000","last_change":"2024-09-14T08:44:19.691342+0000","last_active":"2024-09-14T08:44:19.691342+0000","last_peered":"2024-09-14T08:44:19.691342+0000","last_clean":"2024-09-14T08:44:19.691342+0000","last_became_active":"2024-09-14T08:43:59.417188+0000","last_became_peered":"2024-09-14T08:43:59.417188+0000","last_unstale":"2024-09-14T08:44:19.691342+0000","last_undegraded":"2024-09-14T08:44:19.691342+0000","last_fullsized":"2024-09-14T08:44:19.691342+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:44:19.691273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:44:19.691273+0000","last_clean_scrub_stamp":"2024-09-14T08:44:19.691273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:25.432536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001135437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"236'786","reported_seq":59138,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:19.728100+0000","last_change":"2024-09-14T08:44:19.728100+0000","last_active":"2024-09-14T08:44:19.728100+0000","last_peered":"2024-09-14T08:44:19.728100+0000","last_clean":"2024-09-14T08:44:19.728100+0000","last_became_active":"2024-09-14T08:43:53.485749+0000","last_became_peered":"2024-09-14T08:43:53.485749+0000","last_unstale":"2024-09-14T08:44:19.728100+0000","last_undegraded":"2024-09-14T08:44:19.728100+0000","last_fullsized":"2024-09-14T08:44:19.728100+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'786","last_scrub_stamp":"2024-09-14T08:44:19.727891+0000","last_deep_scrub":"236'786","last_deep_scrub_stamp":"2024-09-14T08:44:19.727891+0000","last_clean_scrub_stamp":"2024-09-14T08:44:19.727891+0000","objects_scrubbed":15,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:46.821483+0000","scrub_duration":31,"objects_trimmed":8,"snaptrim_duration":0.029629143,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":52542,"num_read_kb":50304,"num_write":575,"num_write_kb":32325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":262,"num_bytes_recovered":6496921,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:19.961827+0000","last_change":"2024-09-14T08:44:19.961827+0000","last_active":"2024-09-14T08:44:19.961827+0000","last_peered":"2024-09-14T08:44:19.961827+0000","last_clean":"2024-09-14T08:44:19.961827+0000","last_became_active":"2024-09-14T08:43:59.410081+0000","last_became_peered":"2024-09-14T08:43:59.410081+0000","last_unstale":"2024-09-14T08:44:19.961827+0000","last_undegraded":"2024-09-14T08:44:19.961827+0000","last_fullsized":"2024-09-14T08:44:19.961827+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:44:19.961640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:44:19.961640+0000","last_clean_scrub_stamp":"2024-09-14T08:44:19.961640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:18.053632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011502490000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"236'660","reported_seq":6492,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:20.385012+0000","last_change":"2024-09-14T08:44:20.385012+0000","last_active":"2024-09-14T08:44:20.385012+0000","last_peered":"2024-09-14T08:44:20.385012+0000","last_clean":"2024-09-14T08:44:20.385012+0000","last_became_active":"2024-09-14T08:44:07.405923+0000","last_became_peered":"2024-09-14T08:44:07.405923+0000","last_unstale":"2024-09-14T08:44:20.385012+0000","last_undegraded":"2024-09-14T08:44:20.385012+0000","last_fullsized":"2024-09-14T08:44:20.385012+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'660","last_scrub_stamp":"2024-09-14T08:44:20.384782+0000","last_deep_scrub":"236'660","last_deep_scrub_stamp":"2024-09-14T08:44:20.384782+0000","last_clean_scrub_stamp":"2024-09-14T08:44:20.384782+0000","objects_scrubbed":19,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:55.132557+0000","scrub_duration":31,"objects_trimmed":6,"snaptrim_duration":0.040351541999999997,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":6460,"num_read_kb":17251,"num_write":625,"num_write_kb":20411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":498,"num_bytes_recovered":6627757,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:17.675724+0000","last_change":"2024-09-14T08:44:17.675724+0000","last_active":"2024-09-14T08:44:17.675724+0000","last_peered":"2024-09-14T08:44:17.675724+0000","last_clean":"2024-09-14T08:44:17.675724+0000","last_became_active":"2024-09-14T08:43:53.480382+0000","last_became_peered":"2024-09-14T08:43:53.480382+0000","last_unstale":"2024-09-14T08:44:17.675724+0000","last_undegraded":"2024-09-14T08:44:17.675724+0000","last_fullsized":"2024-09-14T08:44:17.675724+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:44:17.675650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:44:17.675650+0000","last_clean_scrub_stamp":"2024-09-14T08:44:17.675650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:33.829916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001157305,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"236'825","reported_seq":11091,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:22.333589+0000","last_change":"2024-09-14T08:44:22.333589+0000","last_active":"2024-09-14T08:44:22.333589+0000","last_peered":"2024-09-14T08:44:22.333589+0000","last_clean":"2024-09-14T08:44:22.333589+0000","last_became_active":"2024-09-14T08:44:07.406747+0000","last_became_peered":"2024-09-14T08:44:07.406747+0000","last_unstale":"2024-09-14T08:44:22.333589+0000","last_undegraded":"2024-09-14T08:44:22.333589+0000","last_fullsized":"2024-09-14T08:44:22.333589+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'825","last_scrub_stamp":"2024-09-14T08:44:22.333372+0000","last_deep_scrub":"236'825","last_deep_scrub_stamp":"2024-09-14T08:44:22.333372+0000","last_clean_scrub_stamp":"2024-09-14T08:44:22.333372+0000","objects_scrubbed":20,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:51.160353+0000","scrub_duration":35,"objects_trimmed":6,"snaptrim_duration":0.034384078999999998,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":11288,"num_read_kb":43310,"num_write":1070,"num_write_kb":21593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":311,"num_bytes_recovered":4578256,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"236'1605","reported_seq":21561,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:19.881148+0000","last_change":"2024-09-14T08:44:19.881148+0000","last_active":"2024-09-14T08:44:19.881148+0000","last_peered":"2024-09-14T08:44:19.881148+0000","last_clean":"2024-09-14T08:44:19.881148+0000","last_became_active":"2024-09-14T08:42:22.391522+0000","last_became_peered":"2024-09-14T08:42:22.391522+0000","last_unstale":"2024-09-14T08:44:19.881148+0000","last_undegraded":"2024-09-14T08:44:19.881148+0000","last_fullsized":"2024-09-14T08:44:19.881148+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'1605","last_scrub_stamp":"2024-09-14T08:44:19.880939+0000","last_deep_scrub":"236'1605","last_deep_scrub_stamp":"2024-09-14T08:44:19.880939+0000","last_clean_scrub_stamp":"2024-09-14T08:44:19.880939+0000","objects_scrubbed":23,"log_size":1605,"log_dups_size":0,"ondisk_log_size":1605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:33.151920+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0050029469999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":22,"num_read":24909,"num_read_kb":27100,"num_write":2438,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1498771,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"236'3","reported_seq":78,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:19.382735+0000","last_change":"2024-09-14T08:44:19.382735+0000","last_active":"2024-09-14T08:44:19.382735+0000","last_peered":"2024-09-14T08:44:19.382735+0000","last_clean":"2024-09-14T08:44:19.382735+0000","last_became_active":"2024-09-14T08:44:07.403501+0000","last_became_peered":"2024-09-14T08:44:07.403501+0000","last_unstale":"2024-09-14T08:44:19.382735+0000","last_undegraded":"2024-09-14T08:44:19.382735+0000","last_fullsized":"2024-09-14T08:44:19.382735+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'3","last_scrub_stamp":"2024-09-14T08:44:19.382533+0000","last_deep_scrub":"236'3","last_deep_scrub_stamp":"2024-09-14T08:44:19.382533+0000","last_clean_scrub_stamp":"2024-09-14T08:44:19.382533+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:14.950478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001094523,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"236'475","reported_seq":28026,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:20.740787+0000","last_change":"2024-09-14T08:44:20.740787+0000","last_active":"2024-09-14T08:44:20.740787+0000","last_peered":"2024-09-14T08:44:20.740787+0000","last_clean":"2024-09-14T08:44:20.740787+0000","last_became_active":"2024-09-14T08:43:53.464437+0000","last_became_peered":"2024-09-14T08:43:53.464437+0000","last_unstale":"2024-09-14T08:44:20.740787+0000","last_undegraded":"2024-09-14T08:44:20.740787+0000","last_fullsized":"2024-09-14T08:44:20.740787+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'475","last_scrub_stamp":"2024-09-14T08:44:20.740589+0000","last_deep_scrub":"236'475","last_deep_scrub_stamp":"2024-09-14T08:44:20.740589+0000","last_clean_scrub_stamp":"2024-09-14T08:44:20.740589+0000","objects_scrubbed":9,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:14.505328+0000","scrub_duration":19,"objects_trimmed":8,"snaptrim_duration":0.055535908000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":26972,"num_read_kb":27595,"num_write":457,"num_write_kb":3537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":3380924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":485,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:18.677865+0000","last_change":"2024-09-14T08:44:18.677865+0000","last_active":"2024-09-14T08:44:18.677865+0000","last_peered":"2024-09-14T08:44:18.677865+0000","last_clean":"2024-09-14T08:44:18.677865+0000","last_became_active":"2024-09-14T08:43:53.458867+0000","last_became_peered":"2024-09-14T08:43:53.458867+0000","last_unstale":"2024-09-14T08:44:18.677865+0000","last_undegraded":"2024-09-14T08:44:18.677865+0000","last_fullsized":"2024-09-14T08:44:18.677865+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:44:18.677792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:44:18.677792+0000","last_clean_scrub_stamp":"2024-09-14T08:44:18.677792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:51.113071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057915099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"236'434","reported_seq":8826,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:17.523428+0000","last_change":"2024-09-14T08:44:17.523379+0000","last_active":"2024-09-14T08:44:17.523428+0000","last_peered":"2024-09-14T08:44:17.523428+0000","last_clean":"2024-09-14T08:44:17.523428+0000","last_became_active":"2024-09-14T08:42:20.370718+0000","last_became_peered":"2024-09-14T08:42:20.370718+0000","last_unstale":"2024-09-14T08:44:17.523428+0000","last_undegraded":"2024-09-14T08:44:17.523428+0000","last_fullsized":"2024-09-14T08:44:17.523428+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'434","last_scrub_stamp":"2024-09-14T08:44:17.523307+0000","last_deep_scrub":"236'434","last_deep_scrub_stamp":"2024-09-14T08:44:17.523307+0000","last_clean_scrub_stamp":"2024-09-14T08:44:17.523307+0000","objects_scrubbed":9,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:40.564626+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0.001097399,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7748,"num_read_kb":16836,"num_write":423,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":1158730,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:20.925884+0000","last_change":"2024-09-14T08:44:20.925884+0000","last_active":"2024-09-14T08:44:20.925884+0000","last_peered":"2024-09-14T08:44:20.925884+0000","last_clean":"2024-09-14T08:44:20.925884+0000","last_became_active":"2024-09-14T08:43:59.398475+0000","last_became_peered":"2024-09-14T08:43:59.398475+0000","last_unstale":"2024-09-14T08:44:20.925884+0000","last_undegraded":"2024-09-14T08:44:20.925884+0000","last_fullsized":"2024-09-14T08:44:20.925884+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T08:44:20.925701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T08:44:20.925701+0000","last_clean_scrub_stamp":"2024-09-14T08:44:20.925701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:31.934940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"236'542","reported_seq":18819,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:18.718250+0000","last_change":"2024-09-14T08:44:18.718250+0000","last_active":"2024-09-14T08:44:18.718250+0000","last_peered":"2024-09-14T08:44:18.718250+0000","last_clean":"2024-09-14T08:44:18.718250+0000","last_became_active":"2024-09-14T08:44:03.395670+0000","last_became_peered":"2024-09-14T08:44:03.395670+0000","last_unstale":"2024-09-14T08:44:18.718250+0000","last_undegraded":"2024-09-14T08:44:18.718250+0000","last_fullsized":"2024-09-14T08:44:18.718250+0000","mapping_epoch":228,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":229,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'542","last_scrub_stamp":"2024-09-14T08:44:18.718163+0000","last_deep_scrub":"236'542","last_deep_scrub_stamp":"2024-09-14T08:44:18.718163+0000","last_clean_scrub_stamp":"2024-09-14T08:44:18.718163+0000","objects_scrubbed":9,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:13.468611+0000","scrub_duration":11,"objects_trimmed":4,"snaptrim_duration":0.040148494999999999,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":17829,"num_read_kb":57289,"num_write":620,"num_write_kb":6801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":569,"num_bytes_recovered":15227317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"236'2","reported_seq":392,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:21.310859+0000","last_change":"2024-09-14T08:44:21.310859+0000","last_active":"2024-09-14T08:44:21.310859+0000","last_peered":"2024-09-14T08:44:21.310859+0000","last_clean":"2024-09-14T08:44:21.310859+0000","last_became_active":"2024-09-14T08:44:07.408549+0000","last_became_peered":"2024-09-14T08:44:07.408549+0000","last_unstale":"2024-09-14T08:44:21.310859+0000","last_undegraded":"2024-09-14T08:44:21.310859+0000","last_fullsized":"2024-09-14T08:44:21.310859+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'2","last_scrub_stamp":"2024-09-14T08:44:21.310678+0000","last_deep_scrub":"236'2","last_deep_scrub_stamp":"2024-09-14T08:44:21.310678+0000","last_clean_scrub_stamp":"2024-09-14T08:44:21.310678+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:09.446779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"236'74","reported_seq":49,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:18.999787+0000","last_change":"2024-09-14T08:44:18.999787+0000","last_active":"2024-09-14T08:44:18.999787+0000","last_peered":"2024-09-14T08:44:18.999787+0000","last_clean":"2024-09-14T08:44:18.999787+0000","last_became_active":"2024-09-14T08:43:59.418428+0000","last_became_peered":"2024-09-14T08:43:59.418428+0000","last_unstale":"2024-09-14T08:44:18.999787+0000","last_undegraded":"2024-09-14T08:44:18.999787+0000","last_fullsized":"2024-09-14T08:44:18.999787+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'74","last_scrub_stamp":"2024-09-14T08:44:18.999598+0000","last_deep_scrub":"236'74","last_deep_scrub_stamp":"2024-09-14T08:44:18.999598+0000","last_clean_scrub_stamp":"2024-09-14T08:44:18.999598+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:04.767843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"236'627","reported_seq":35750,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:22.686815+0000","last_change":"2024-09-14T08:44:22.686815+0000","last_active":"2024-09-14T08:44:22.686815+0000","last_peered":"2024-09-14T08:44:22.686815+0000","last_clean":"2024-09-14T08:44:22.686815+0000","last_became_active":"2024-09-14T08:43:53.487405+0000","last_became_peered":"2024-09-14T08:43:53.487405+0000","last_unstale":"2024-09-14T08:44:22.686815+0000","last_undegraded":"2024-09-14T08:44:22.686815+0000","last_fullsized":"2024-09-14T08:44:22.686815+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'627","last_scrub_stamp":"2024-09-14T08:44:22.686539+0000","last_deep_scrub":"236'627","last_deep_scrub_stamp":"2024-09-14T08:44:22.686539+0000","last_clean_scrub_stamp":"2024-09-14T08:44:22.686539+0000","objects_scrubbed":14,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:37:16.926544+0000","scrub_duration":31,"objects_trimmed":4,"snaptrim_duration":0.024367663000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":33488,"num_read_kb":35878,"num_write":489,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":2364662,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"236'1069","reported_seq":16876,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:20.858678+0000","last_change":"2024-09-14T08:44:20.858678+0000","last_active":"2024-09-14T08:44:20.858678+0000","last_peered":"2024-09-14T08:44:20.858678+0000","last_clean":"2024-09-14T08:44:20.858678+0000","last_became_active":"2024-09-14T08:41:11.607604+0000","last_became_peered":"2024-09-14T08:41:11.607604+0000","last_unstale":"2024-09-14T08:44:20.858678+0000","last_undegraded":"2024-09-14T08:44:20.858678+0000","last_fullsized":"2024-09-14T08:44:20.858678+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'1069","last_scrub_stamp":"2024-09-14T08:44:20.858449+0000","last_deep_scrub":"236'1069","last_deep_scrub_stamp":"2024-09-14T08:44:20.858449+0000","last_clean_scrub_stamp":"2024-09-14T08:44:20.858449+0000","objects_scrubbed":16,"log_size":1069,"log_dups_size":0,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:11.506589+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.0052773719999999998,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":16233,"num_read_kb":33099,"num_write":859,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":773222,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"236'694","reported_seq":14493,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:21.662378+0000","last_change":"2024-09-14T08:44:21.662378+0000","last_active":"2024-09-14T08:44:21.662378+0000","last_peered":"2024-09-14T08:44:21.662378+0000","last_clean":"2024-09-14T08:44:21.662378+0000","last_became_active":"2024-09-14T08:44:05.398159+0000","last_became_peered":"2024-09-14T08:44:05.398159+0000","last_unstale":"2024-09-14T08:44:21.662378+0000","last_undegraded":"2024-09-14T08:44:21.662378+0000","last_fullsized":"2024-09-14T08:44:21.662378+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'694","last_scrub_stamp":"2024-09-14T08:44:21.662164+0000","last_deep_scrub":"236'694","last_deep_scrub_stamp":"2024-09-14T08:44:21.662164+0000","last_clean_scrub_stamp":"2024-09-14T08:44:21.662164+0000","objects_scrubbed":13,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:21.385367+0000","scrub_duration":23,"objects_trimmed":10,"snaptrim_duration":0.050530626000000002,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":14875,"num_read_kb":84017,"num_write":659,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":18337410,"num_keys_recovered":105,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"236'669","reported_seq":6018,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:21.709028+0000","last_change":"2024-09-14T08:44:21.709028+0000","last_active":"2024-09-14T08:44:21.709028+0000","last_peered":"2024-09-14T08:44:21.709028+0000","last_clean":"2024-09-14T08:44:21.709028+0000","last_became_active":"2024-09-14T08:43:53.480067+0000","last_became_peered":"2024-09-14T08:43:53.480067+0000","last_unstale":"2024-09-14T08:44:21.709028+0000","last_undegraded":"2024-09-14T08:44:21.709028+0000","last_fullsized":"2024-09-14T08:44:21.709028+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'669","last_scrub_stamp":"2024-09-14T08:44:21.708794+0000","last_deep_scrub":"236'669","last_deep_scrub_stamp":"2024-09-14T08:44:21.708794+0000","last_clean_scrub_stamp":"2024-09-14T08:44:21.708794+0000","objects_scrubbed":11,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:30.391588+0000","scrub_duration":27,"objects_trimmed":8,"snaptrim_duration":0.051150345999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6328,"num_read_kb":21947,"num_write":820,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":389,"num_bytes_recovered":7762120,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"236'1069","reported_seq":45264,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:25.403428+0000","last_change":"2024-09-14T08:44:25.403428+0000","last_active":"2024-09-14T08:44:25.403428+0000","last_peered":"2024-09-14T08:44:25.403428+0000","last_clean":"2024-09-14T08:44:25.403428+0000","last_became_active":"2024-09-14T08:44:07.414903+0000","last_became_peered":"2024-09-14T08:44:07.414903+0000","last_unstale":"2024-09-14T08:44:25.403428+0000","last_undegraded":"2024-09-14T08:44:25.403428+0000","last_fullsized":"2024-09-14T08:44:25.403428+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'1069","last_scrub_stamp":"2024-09-14T08:44:25.403210+0000","last_deep_scrub":"236'1069","last_deep_scrub_stamp":"2024-09-14T08:44:25.403210+0000","last_clean_scrub_stamp":"2024-09-14T08:44:25.403210+0000","objects_scrubbed":20,"log_size":1069,"log_dups_size":0,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:18.149582+0000","scrub_duration":35,"objects_trimmed":10,"snaptrim_duration":0.068642173000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":49733,"num_read_kb":103295,"num_write":819,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":12466332,"num_keys_recovered":182,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"236'699","reported_seq":8315,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:22.981310+0000","last_change":"2024-09-14T08:44:22.981310+0000","last_active":"2024-09-14T08:44:22.981310+0000","last_peered":"2024-09-14T08:44:22.981310+0000","last_clean":"2024-09-14T08:44:22.981310+0000","last_became_active":"2024-09-14T08:44:06.407599+0000","last_became_peered":"2024-09-14T08:44:06.407599+0000","last_unstale":"2024-09-14T08:44:22.981310+0000","last_undegraded":"2024-09-14T08:44:22.981310+0000","last_fullsized":"2024-09-14T08:44:22.981310+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'699","last_scrub_stamp":"2024-09-14T08:44:22.981115+0000","last_deep_scrub":"236'699","last_deep_scrub_stamp":"2024-09-14T08:44:22.981115+0000","last_clean_scrub_stamp":"2024-09-14T08:44:22.981115+0000","objects_scrubbed":5,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:58.698933+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0014175520000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":9196,"num_read_kb":22714,"num_write":526,"num_write_kb":7334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":391,"num_bytes_recovered":6800384,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"236'335","reported_seq":7648,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:23.353746+0000","last_change":"2024-09-14T08:44:23.353746+0000","last_active":"2024-09-14T08:44:23.353746+0000","last_peered":"2024-09-14T08:44:23.353746+0000","last_clean":"2024-09-14T08:44:23.353746+0000","last_became_active":"2024-09-14T08:44:07.408742+0000","last_became_peered":"2024-09-14T08:44:07.408742+0000","last_unstale":"2024-09-14T08:44:23.353746+0000","last_undegraded":"2024-09-14T08:44:23.353746+0000","last_fullsized":"2024-09-14T08:44:23.353746+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'335","last_scrub_stamp":"2024-09-14T08:44:23.353528+0000","last_deep_scrub":"236'335","last_deep_scrub_stamp":"2024-09-14T08:44:23.353528+0000","last_clean_scrub_stamp":"2024-09-14T08:44:23.353528+0000","objects_scrubbed":14,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:57.298918+0000","scrub_duration":27,"objects_trimmed":4,"snaptrim_duration":0.035863521000000002,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":6541,"num_read_kb":21437,"num_write":285,"num_write_kb":2870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":561152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"236'587","reported_seq":10058,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:24.370356+0000","last_change":"2024-09-14T08:44:24.370356+0000","last_active":"2024-09-14T08:44:24.370356+0000","last_peered":"2024-09-14T08:44:24.370356+0000","last_clean":"2024-09-14T08:44:24.370356+0000","last_became_active":"2024-09-14T08:44:07.406874+0000","last_became_peered":"2024-09-14T08:44:07.406874+0000","last_unstale":"2024-09-14T08:44:24.370356+0000","last_undegraded":"2024-09-14T08:44:24.370356+0000","last_fullsized":"2024-09-14T08:44:24.370356+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'587","last_scrub_stamp":"2024-09-14T08:44:24.370134+0000","last_deep_scrub":"236'587","last_deep_scrub_stamp":"2024-09-14T08:44:24.370134+0000","last_clean_scrub_stamp":"2024-09-14T08:44:24.370134+0000","objects_scrubbed":15,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:11.543769+0000","scrub_duration":27,"objects_trimmed":16,"snaptrim_duration":0.053448875,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":7838,"num_read_kb":43795,"num_write":497,"num_write_kb":9224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":640,"num_bytes_recovered":25134704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"236'520","reported_seq":20096,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:26.371367+0000","last_change":"2024-09-14T08:44:26.371367+0000","last_active":"2024-09-14T08:44:26.371367+0000","last_peered":"2024-09-14T08:44:26.371367+0000","last_clean":"2024-09-14T08:44:26.371367+0000","last_became_active":"2024-09-14T08:44:07.403507+0000","last_became_peered":"2024-09-14T08:44:07.403507+0000","last_unstale":"2024-09-14T08:44:26.371367+0000","last_undegraded":"2024-09-14T08:44:26.371367+0000","last_fullsized":"2024-09-14T08:44:26.371367+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'520","last_scrub_stamp":"2024-09-14T08:44:26.371171+0000","last_deep_scrub":"236'520","last_deep_scrub_stamp":"2024-09-14T08:44:26.371171+0000","last_clean_scrub_stamp":"2024-09-14T08:44:26.371171+0000","objects_scrubbed":11,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:56.501420+0000","scrub_duration":15,"objects_trimmed":8,"snaptrim_duration":0.050693604000000003,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20159,"num_read_kb":55886,"num_write":485,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":360,"num_bytes_recovered":2324520,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"236'569","reported_seq":44264,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:24.018069+0000","last_change":"2024-09-14T08:44:24.018069+0000","last_active":"2024-09-14T08:44:24.018069+0000","last_peered":"2024-09-14T08:44:24.018069+0000","last_clean":"2024-09-14T08:44:24.018069+0000","last_became_active":"2024-09-14T08:44:08.392150+0000","last_became_peered":"2024-09-14T08:44:08.392150+0000","last_unstale":"2024-09-14T08:44:24.018069+0000","last_undegraded":"2024-09-14T08:44:24.018069+0000","last_fullsized":"2024-09-14T08:44:24.018069+0000","mapping_epoch":233,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":234,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'569","last_scrub_stamp":"2024-09-14T08:44:24.017848+0000","last_deep_scrub":"236'569","last_deep_scrub_stamp":"2024-09-14T08:44:24.017848+0000","last_clean_scrub_stamp":"2024-09-14T08:44:24.017848+0000","objects_scrubbed":17,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:11.982419+0000","scrub_duration":35,"objects_trimmed":10,"snaptrim_duration":0.0046849040000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":44159,"num_read_kb":101736,"num_write":433,"num_write_kb":14207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":14335213,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"236'651","reported_seq":7224,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:19.556096+0000","last_change":"2024-09-14T08:44:19.556096+0000","last_active":"2024-09-14T08:44:19.556096+0000","last_peered":"2024-09-14T08:44:19.556096+0000","last_clean":"2024-09-14T08:44:19.556096+0000","last_became_active":"2024-09-14T08:44:09.394635+0000","last_became_peered":"2024-09-14T08:44:09.394635+0000","last_unstale":"2024-09-14T08:44:19.556096+0000","last_undegraded":"2024-09-14T08:44:19.556096+0000","last_fullsized":"2024-09-14T08:44:19.556096+0000","mapping_epoch":234,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":235,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'651","last_scrub_stamp":"2024-09-14T08:44:19.555911+0000","last_deep_scrub":"236'651","last_deep_scrub_stamp":"2024-09-14T08:44:19.555911+0000","last_clean_scrub_stamp":"2024-09-14T08:44:19.555911+0000","objects_scrubbed":12,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:45.132032+0000","scrub_duration":19,"objects_trimmed":10,"snaptrim_duration":0.041958433000000003,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5789,"num_read_kb":20892,"num_write":624,"num_write_kb":8469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":542,"num_bytes_recovered":17076794,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"236'904","reported_seq":4207,"reported_epoch":236,"state":"active+clean","last_fresh":"2024-09-14T08:44:25.007821+0000","last_change":"2024-09-14T08:44:25.007821+0000","last_active":"2024-09-14T08:44:25.007821+0000","last_peered":"2024-09-14T08:44:25.007821+0000","last_clean":"2024-09-14T08:44:25.007821+0000","last_became_active":"2024-09-14T08:44:06.410917+0000","last_became_peered":"2024-09-14T08:44:06.410917+0000","last_unstale":"2024-09-14T08:44:25.007821+0000","last_undegraded":"2024-09-14T08:44:25.007821+0000","last_fullsized":"2024-09-14T08:44:25.007821+0000","mapping_epoch":231,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"236'904","last_scrub_stamp":"2024-09-14T08:44:25.007603+0000","last_deep_scrub":"236'904","last_deep_scrub_stamp":"2024-09-14T08:44:25.007603+0000","last_clean_scrub_stamp":"2024-09-14T08:44:25.007603+0000","objects_scrubbed":20,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:47:05.463329+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.000881582,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":5580,"num_read_kb":13815,"num_write":1250,"num_write_kb":9128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":379,"num_bytes_recovered":3502437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":464,"num_read":609824,"num_read_kb":1289029,"num_write":26487,"num_write_kb":295335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11149,"num_bytes_recovered":214886831,"num_keys_recovered":901,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30533,"internal_metadata":0},"log_size":24486,"ondisk_log_size":24486,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3542208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":5}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65904,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94305936,"statfs":{"total":96636764160,"available":96569278464,"internally_reserved":0,"allocated":2850816,"data_stored":1214401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52592,"kb_used_data":3360,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319248,"statfs":{"total":96636764160,"available":96582909952,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60332,"kb_used_data":2780,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311508,"statfs":{"total":96636764160,"available":96574984192,"internally_reserved":0,"allocated":2846720,"data_stored":1214382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":221,"seq":949187772427,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":2788,"kb_used_omap":41,"kb_used_meta":30102,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":2854912,"data_stored":1214420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42656,"internal_metadata":30824800},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607624,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65904,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94305936,"statfs":{"total":96636764160,"available":96569278464,"internally_reserved":0,"allocated":2850816,"data_stored":1214401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":127,"seq":545460846626,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":3360,"kb_used_omap":22,"kb_used_meta":37481,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":3440640,"data_stored":1804750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22752,"internal_metadata":38381344},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13074,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17459,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T08:44:39.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T08:44:40.287 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T08:44:40.287 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T08:44:40.287 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T08:44:40.287 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:44:40.369 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T08:44:40.370 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T08:44:40.370 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:44:40.442 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T08:44:40.443 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T08:44:40.443 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:44:41.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-14T08:44:46.544 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T08:44:46.544 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T08:44:46.545 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:44:46.601 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T08:44:46.601 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T08:44:46.601 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:44:46.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-09-14T08:44:52.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-14T08:44:52.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-14T08:44:52.702 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T08:44:52.703 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T08:44:52.703 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:44:52.776 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T08:44:52.776 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T08:44:52.776 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T08:44:52.776 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:44:52.807 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T08:44:52.807 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T08:44:52.807 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T08:44:52.807 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:44:52.828 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T08:44:52.828 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T08:44:52.829 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:44:52.893 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T08:44:52.893 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T08:44:52.893 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T08:44:52.918 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T08:44:52.919 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T08:44:52.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-14T08:44:52.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:44:52.955 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T08:44:53.240 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:44:53.241 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T08:44:53.508 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:44:53.508 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T08:44:53.697 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-14T08:44:53.697 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T08:44:53.959 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-14T08:44:53.959 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T08:44:54.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-14T08:44:54.142 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T08:44:54.318 INFO:tasks.ceph:Archiving mon data... 2024-09-14T08:44:54.319 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/data/mon.a.tgz 2024-09-14T08:44:54.319 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-14T08:44:54.325 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.A81rVgKMay 2024-09-14T08:44:54.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.A81rVgKMay 2024-09-14T08:44:54.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.A81rVgKMay 2024-09-14T08:44:54.544 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.A81rVgKMay is 463KB 2024-09-14T08:44:54.606 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.A81rVgKMay 2024-09-14T08:44:54.611 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/data/mon.c.tgz 2024-09-14T08:44:54.611 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-14T08:44:54.660 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.Gp91EwOuk2 2024-09-14T08:44:54.660 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Gp91EwOuk2 2024-09-14T08:44:54.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.Gp91EwOuk2 2024-09-14T08:44:54.924 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.Gp91EwOuk2 is 629KB 2024-09-14T08:44:54.986 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.Gp91EwOuk2 2024-09-14T08:44:54.992 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/data/mon.b.tgz 2024-09-14T08:44:54.993 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-14T08:44:54.999 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.roRMFovmN5 2024-09-14T08:44:54.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.roRMFovmN5 2024-09-14T08:44:55.197 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.roRMFovmN5 2024-09-14T08:44:55.258 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.roRMFovmN5 is 629KB 2024-09-14T08:44:55.321 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.roRMFovmN5 2024-09-14T08:44:55.327 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T08:44:55.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T08:44:55.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T08:44:55.372 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T08:44:55.392 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T08:44:55.435 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T08:44:55.441 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T08:44:55.441 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T08:44:55.442 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/remote/smithi089/crash 2024-09-14T08:44:55.443 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T08:44:55.457 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/remote/smithi112/crash 2024-09-14T08:44:55.458 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T08:44:55.490 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/remote/smithi188/crash 2024-09-14T08:44:55.491 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T08:44:55.504 INFO:tasks.ceph:Compressing logs... 2024-09-14T08:44:55.505 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T08:44:55.507 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T08:44:55.529 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40674.log 2024-09-14T08:44:55.530 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47723.log 2024-09-14T08:44:55.533 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37990.log 2024-09-14T08:44:55.533 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40674.log.gz 2024-09-14T08:44:55.533 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30604.log 2024-09-14T08:44:55.533 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47723.log.gz 2024-09-14T08:44:55.533 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48867.log 2024-09-14T08:44:55.533 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37990.log.gz 2024-09-14T08:44:55.533 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30828.log 2024-09-14T08:44:55.533 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30604.log.gz 2024-09-14T08:44:55.533 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48867.log.gz 2024-09-14T08:44:55.533 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.31912.log 2024-09-14T08:44:55.534 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38688.log 2024-09-14T08:44:55.534 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30828.log.gz 2024-09-14T08:44:55.534 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/objectstore_tool.31912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42829.log 2024-09-14T08:44:55.540 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42740.log 2024-09-14T08:44:55.540 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38688.log.gz 2024-09-14T08:44:55.540 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34241.log 2024-09-14T08:44:55.540 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42829.log.gz 2024-09-14T08:44:55.540 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47924.log 2024-09-14T08:44:55.540 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42740.log.gz 2024-09-14T08:44:55.540 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42496.log 2024-09-14T08:44:55.540 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34241.log: /var/log/ceph/ceph-client.admin.47924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48373.log 2024-09-14T08:44:55.540 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34241.log.gz 2024-09-14T08:44:55.540 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47924.log.gz 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42496.log.gz 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30027.log 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30903.log 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48373.log.gz 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48293.log 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30027.log.gz 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30347.log 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30903.log.gz 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48225.log 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48293.log.gz 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41056.log 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30347.log.gz 2024-09-14T08:44:55.541 INFO:teuthology.orchestra.run.smithi089.stderr: 95.1% -- replaced with /var/log/ceph/objectstore_tool.31912.log.gz 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36293.log 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48225.log.gz 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29863.log 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41056.log.gz 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32920.log 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36293.log.gz 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48685.log 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29863.log.gz 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35208.log 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32920.log.gz 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40898.log 2024-09-14T08:44:55.542 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48685.log.gz 2024-09-14T08:44:55.550 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T08:44:55.567 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35520.log 2024-09-14T08:44:55.567 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35208.log.gz 2024-09-14T08:44:55.567 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30487.log 2024-09-14T08:44:55.567 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40898.log.gz 2024-09-14T08:44:55.567 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29399.log 2024-09-14T08:44:55.567 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35520.log.gz 2024-09-14T08:44:55.567 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30487.log.gz 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30729.log 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31094.log 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29399.log.gz 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30729.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30729.log.gz 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36401.log 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31094.log.gz 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44024.log 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36401.log.gz 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47922.log 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41019.log 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44024.log.gz 2024-09-14T08:44:55.568 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35694.log 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr:gzip/var/log/ceph/ceph-client.admin.41019.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48659.log 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41019.log.gz 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35694.log.gz 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40080.log 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43079.log 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48659.log.gz 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48737.log 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40080.log.gz 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35975.log 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43079.log.gz 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34362.log 2024-09-14T08:44:55.569 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48737.log.gz 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35975.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.35975.log.gz --verbose 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph.tmp-client.admin.21526.log 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43121.log 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34362.log.gz 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.tmp-client.admin.21526.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21526.log.gz 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42145.log 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37706.log 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43121.log.gz 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42145.log.gz 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30939.log 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.37706.log: -- /var/log/ceph/ceph-client.admin.36497.log 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37706.log.gz 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41966.log 2024-09-14T08:44:55.570 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30939.log.gz 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36147.log 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36497.log.gz 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41966.log.gz 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29416.log 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38765.log 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36147.log.gz 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29416.log.gz 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42947.log 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48221.log 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38765.log.gz 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42947.log.gz 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34337.log 2024-09-14T08:44:55.571 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41859.log 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48221.log.gz 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40225.log 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34337.log.gz 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr:gzip/var/log/ceph/ceph-client.admin.41859.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36062.log 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41859.log.gz 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40225.log.gz 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29244.log 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38165.log 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36062.log.gz 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30104.log 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29244.log.gz 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38165.log.gz 2024-09-14T08:44:55.572 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35949.log 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38943.log 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30104.log.gz 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35949.log.gz 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43303.log 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48451.log 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38943.log.gz 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43303.log.gz 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35895.log 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43590.log 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48451.log.gz 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35895.log.gz 2024-09-14T08:44:55.573 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34789.log 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42417.log 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43590.log.gz 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30703.log 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34789.log.gz 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42417.log.gz 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43328.log 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44165.log 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30703.log.gz 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38534.log 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43328.log.gz 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29257.log 2024-09-14T08:44:55.574 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44165.log.gz 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33653.log 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38534.log.gz 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29257.log.gz 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29759.log 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47697.log 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33653.log.gz 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29759.log.gz 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37597.log 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30248.log 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47697.log.gz 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36066.log 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37597.log.gz 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30248.log.gz 2024-09-14T08:44:55.575 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43925.log 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48815.log 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36066.log.gz 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43925.log.gz 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42669.log 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40795.log 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48815.log.gz 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47879.log 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42669.log.gz 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40795.log.gz 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29406.log 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47879.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47879.log.gz -5 2024-09-14T08:44:55.576 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37925.log 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29406.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29406.log.gz 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37925.log.gz 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37895.log 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36326.log 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43204.log 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37895.log.gz 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36326.log.gz 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35016.log 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40841.log 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43204.log.gz 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35016.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.35016.log.gz 2024-09-14T08:44:55.577 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37652.log 2024-09-14T08:44:55.578 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39899.log 2024-09-14T08:44:55.578 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40841.log.gz 2024-09-14T08:44:55.578 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37652.log.gz 2024-09-14T08:44:55.578 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41697.log 2024-09-14T08:44:55.578 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35354.log 2024-09-14T08:44:55.578 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39899.log.gz 2024-09-14T08:44:55.578 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41697.log.gz 2024-09-14T08:44:55.578 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33823.log 2024-09-14T08:44:55.588 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25138.log 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25186.log 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25138.log: /var/log/ceph/ceph-client.admin.25186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25186.log.gz 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25138.log.gz 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25162.log 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25210.log 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.25162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25162.log.gz 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25258.log 2024-09-14T08:44:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25210.log.gz 2024-09-14T08:44:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25234.log 2024-09-14T08:44:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25258.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T08:44:55.590 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25258.log.gz 2024-09-14T08:44:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25234.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T08:44:55.590 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25234.log.gz 2024-09-14T08:44:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T08:44:55.590 INFO:teuthology.orchestra.run.smithi112.stderr: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T08:44:55.671 INFO:teuthology.orchestra.run.smithi112.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T08:44:55.676 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23990.log 2024-09-14T08:44:55.676 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21952.log 2024-09-14T08:44:55.676 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23990.log: gzip 25.3% -- replaced with /var/log/ceph/ceph-client.admin.23990.log.gz -5 2024-09-14T08:44:55.676 INFO:teuthology.orchestra.run.smithi188.stderr: --verbose -- /var/log/ceph/ceph-client.admin.21540.log 2024-09-14T08:44:55.676 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21882.log 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.21952.log.gz 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23349.log 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr: 52.1% -- replaced with /var/log/ceph/ceph-client.admin.21540.log.gz 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22727.log 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr: 58.7% -- replaced with /var/log/ceph/ceph-client.admin.21882.log.gz 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23349.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23349.log.gz 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22614.log 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21909.log 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.22727.log.gz 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21839.log 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22614.log.gz 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.21510.log 2024-09-14T08:44:55.677 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21909.log: /var/log/ceph/ceph-client.admin.21839.log: 19.6% 19.0% -- replaced with /var/log/ceph/ceph-client.admin.21839.log.gz 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr: -- replaced with /var/log/ceph/ceph-client.admin.21909.log.gz 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23535.log 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.0.21510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22482.log 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.21510.log.gz 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21742.log 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22473.log 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.23535.log.gz 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.22482.log.gz 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/ceph-client.admin.21742.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.21662.log 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.21742.log.gz 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22833.log 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.22473.log.gz 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24060.log 2024-09-14T08:44:55.678 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.21662.log.gz 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/ceph-client.admin.22833.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24096.log 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr: 53.4% -- replaced with /var/log/ceph/ceph-client.admin.22833.log.gz 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24060.log: 53.2% -- replaced with /var/log/ceph/ceph-client.admin.24060.log.gz 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24017.log 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21602.log 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.24096.log.gz 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23911.log/var/log/ceph/ceph-client.admin.24017.log: 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.24017.log.gz 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21602.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.21602.log.gz 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21593.log 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23746.log 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23911.log.gz 2024-09-14T08:44:55.679 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/ceph-client.admin.21593.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22964.log 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.21593.log.gz 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23816.log 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.23746.log.gz 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.22964.log: /var/log/ceph/ceph-client.admin.22376.log 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22964.log.gz 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21531.log 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.23816.log.gz 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21943.log 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr: 51.9% -- replaced with /var/log/ceph/ceph-client.admin.22376.log.gz 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23920.log 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.21531.log.gz 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21733.log 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr: 18.4% -- replaced with /var/log/ceph/ceph-client.admin.21943.log.gz 2024-09-14T08:44:55.680 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23920.log: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.23920.log.gz 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22507.log 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23780.log 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.21733.log.gz 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.22507.log: /var/log/ceph/ceph-client.admin.23956.log 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22507.log.gz 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23596.log 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr: 56.2% -- replaced with /var/log/ceph/ceph-client.admin.23780.log.gz 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23850.log 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23456.log 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23596.log: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.23956.log.gz 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23596.log.gz 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23218.log 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr: 54.5% -- replaced with /var/log/ceph/ceph-client.admin.23850.log.gz 2024-09-14T08:44:55.681 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22858.log 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23456.log.gz 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22657.log 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23218.log.gz 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23841.log 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22858.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22858.log.gz 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22297.log 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.22657.log.gz 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22013.log 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.23841.log.gz 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22797.log 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22297.log.gz 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23675.log 2024-09-14T08:44:55.682 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22013.log.gz 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22342.log 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.22797.log.gz 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22059.log 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23709.log 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr: 75.9% -- replaced with /var/log/ceph/ceph-client.admin.22342.log.gz 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/ceph-client.admin.22059.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22998.log 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.23675.log.gz 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22165.log 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr: 51.9% -- replaced with /var/log/ceph/ceph-client.admin.23709.log.gz 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23209.log 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.22998.log.gz 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22263.log 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.22059.log.gz 2024-09-14T08:44:55.683 INFO:teuthology.orchestra.run.smithi188.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.22165.log.gz 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23981.log 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.23209.log.gz 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22022.log 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22263.log.gz 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23429.log 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23981.log.gz 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22648.log 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.22022.log.gz 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22516.log 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr: 55.5% -- replaced with /var/log/ceph/ceph-client.admin.23429.log.gz 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22684.log 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22648.log.gz 2024-09-14T08:44:55.684 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5/var/log/ceph/ceph-client.admin.22516.log: --verbose -- /var/log/ceph/ceph-client.admin.22718.log 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.22516.log.gz 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22684.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22684.log.gz 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22122.log 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/ceph-client.admin.22718.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23034.log 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22718.log.gz 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23139.log 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22122.log.gz 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23007.log 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23034.log.gz 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.23139.log: /var/log/ceph/ceph-client.admin.23771.log 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23139.log.gz 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24026.log 2024-09-14T08:44:55.685 INFO:teuthology.orchestra.run.smithi188.stderr: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.23007.log.gz 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22867.log 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23771.log.gz 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/ceph-client.admin.24026.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22193.log 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.24026.log.gz 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23605.log 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.22867.log.gz 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23886.log 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22193.log.gz 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22894.log 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21637.log 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.23886.log.gz 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.23605.log.gz 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21812.log 2024-09-14T08:44:55.686 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.22894.log.gz 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22156.log 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr: 51.9% -- replaced with /var/log/ceph/ceph-client.admin.21637.log.gz 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23324.log 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.21812.log.gz 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23105.log 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.22156.log.gz 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22446.log 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21671.log 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23105.log.gz 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.23324.log.gz 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23490.log 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.22446.log.gz 2024-09-14T08:44:55.687 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23569.log 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.21671.log.gz 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22928.log 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.23490.log.gz 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/ceph-client.admin.23569.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23947.log 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.23569.log.gz 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22928.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22928.log.gz 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22093.log 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21988.log 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.23947.log.gz 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23254.log 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22093.log: /var/log/ceph/ceph-client.admin.21988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23630.log 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.22093.log.gz 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.21988.log.gz 2024-09-14T08:44:55.688 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22412.log 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.23254.log.gz 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23807.log 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.23630.log.gz 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23184.log 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.22412.log.gz 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21803.log 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23807.log.gz 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22437.log 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23184.log: /var/log/ceph/ceph-client.admin.21803.log: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.21803.log.gz 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22623.log 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.23184.log.gz 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22236.log 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.22437.log.gz 2024-09-14T08:44:55.689 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21628.log 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr: 53.4% -- replaced with /var/log/ceph/ceph-client.admin.22623.log.gz 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22236.log: 23.5% -- replaced with /var/log/ceph/ceph-client.admin.22236.log.gz 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22973.log 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23279.log 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.21628.log.gz 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23666.log 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.22973.log.gz 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23279.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23279.log.gz 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22577.log 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22050.log 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23666.log.gz 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22693.log 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22577.log.gz 2024-09-14T08:44:55.690 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22050.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22050.log.gz 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22903.log 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23526.log 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22903.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.22693.log.gz 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22937.log 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23526.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23526.log.gz 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22131.log 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.22937.log: /var/log/ceph/ceph-client.admin.21708.log 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.22903.log.gz 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr: 75.2% -- replaced with /var/log/ceph/ceph-client.admin.22937.log.gz 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22131.log: gzip -5 --verbose -- 91.5% /var/log/ceph/ceph-client.admin.22586.log -- replaced with /var/log/ceph/ceph-client.admin.22131.log.gz 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23420.log 2024-09-14T08:44:55.691 INFO:teuthology.orchestra.run.smithi188.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.21708.log.gz 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21778.log 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr: 24.7%/var/log/ceph/ceph-client.admin.23420.log: -- replaced with /var/log/ceph/ceph-client.admin.22586.log.gz 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr:gzip 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23420.log.gz -5 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr: --verbose -- /var/log/ceph/ceph-client.admin.21918.log 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22227.log 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.21778.log.gz 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21979.log 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21918.log: /var/log/ceph/ceph-client.admin.22227.log: 53.4% -- replaced with /var/log/ceph/ceph-client.admin.21918.log.gz 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22333.log 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.22227.log.gz 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21979.log: 19.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.21979.log.gz 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23386.log 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22543.log 2024-09-14T08:44:55.692 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.22333.log.gz 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22403.log 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23386.log.gz 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22824.log 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22543.log.gz 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23358.log 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.22403.log.gz 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/ceph-client.admin.22824.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.21769.log 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22824.log.gz 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22202.log 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.23358.log.gz 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23639.log 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.21769.log.gz 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22754.log 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr: 52.5% -- replaced with /var/log/ceph/ceph-client.admin.22202.log.gz 2024-09-14T08:44:55.693 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22763.log 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23639.log: 56.5% -- replaced with /var/log/ceph/ceph-client.admin.23639.log.gz/var/log/ceph/ceph-client.admin.22754.log: 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22754.log.gz 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23175.log 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23114.log 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.22763.log.gz 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21699.log 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23175.log.gz 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23245.log 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.23114.log.gz 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21699.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.21699.log.gz 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23288.log 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21873.log 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23245.log.gz 2024-09-14T08:44:55.694 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23077.log 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.23288.log.gz 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21873.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.21873.log.gz 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23043.log 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22788.log 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.23077.log.gz 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22367.log 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21848.log 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.22788.log.gz 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.23043.log.gz 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22367.log: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.22367.log.gz 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22306.log 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22084.log 2024-09-14T08:44:55.695 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21848.log: /var/log/ceph/ceph-client.admin.22306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23148.log 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr: 53.4% -- replaced with /var/log/ceph/ceph-client.admin.22306.log.gz 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.21848.log.gz 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24051.log 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.22084.log.gz 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr:gzip/var/log/ceph/ceph-client.admin.23148.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23465.log 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr: 52.8% -- replaced with /var/log/ceph/ceph-client.admin.23148.log.gz 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24051.log: gzip 19.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.24051.log.gz --verbose 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr: -- /var/log/ceph/ceph-client.admin.24087.log 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23560.log 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23315.log 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24087.log: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.23465.log.gz 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.24087.log.gz 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23737.log 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23560.log.gz 2024-09-14T08:44:55.696 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23068.log 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23315.log.gz 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23737.log: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.23737.log.gz 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22552.log 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23395.log 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23068.log.gz 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22272.log 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22552.log: /var/log/ceph/ceph-client.admin.23395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23877.log 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.22552.log.gz 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr: 55.3% -- replaced with /var/log/ceph/ceph-client.admin.23395.log.gz 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23700.log 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.22272.log: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.22272.log.gz 2024-09-14T08:44:55.697 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23499.log 2024-09-14T08:44:55.698 INFO:teuthology.orchestra.run.smithi188.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.23877.log.gz 2024-09-14T08:44:55.698 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23700.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.23700.log.gz 2024-09-14T08:44:55.698 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.23499.log: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.23499.log.gz 2024-09-14T08:44:55.698 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-09-14T08:44:55.698 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m0.070s 2024-09-14T08:44:55.698 INFO:teuthology.orchestra.run.smithi188.stderr:user 0m0.114s 2024-09-14T08:44:55.698 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m0.058s 2024-09-14T08:44:55.744 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44838.log 2024-09-14T08:44:55.744 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35354.log.gz 2024-09-14T08:44:55.744 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33823.log.gz 2024-09-14T08:44:55.744 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47484.log 2024-09-14T08:44:55.744 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38202.log 2024-09-14T08:44:55.744 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44838.log.gz 2024-09-14T08:44:55.744 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47484.log.gz 2024-09-14T08:44:55.744 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-09-14T08:44:55.744 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29935.log 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38202.log.gz 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42526.log 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29115.log 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29935.log.gz 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42526.log.gz 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38074.log 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42062.log 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29115.log.gz 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38074.log.gz 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45945.log 2024-09-14T08:44:55.745 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47775.log 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42062.log.gz 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45945.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45945.log.gz 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29893.log 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47775.log.gz 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35396.log 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29893.log.gz 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34102.log 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35396.log.gz 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34102.log.gz 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.48268.log: /var/log/ceph/ceph-client.admin.34021.log 2024-09-14T08:44:55.746 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30149.log 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34021.log.gz 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30203.log 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38875.log 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30149.log.gz 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30203.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.30203.log.gz -- 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.34648.log 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38875.log.gz 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29161.log 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29631.log 2024-09-14T08:44:55.747 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34648.log.gz 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29161.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.29161.log.gz /var/log/ceph/ceph-client.admin.41550.log 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29631.log.gz 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42234.log 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.41550.log: -- /var/log/ceph/ceph-client.admin.37863.log 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41550.log.gz 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42234.log.gz 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44211.log 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25126.log 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37863.log.gz 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34474.log 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44211.log.gz 2024-09-14T08:44:55.748 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42890.log 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.25126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25126.log.gz 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43453.log 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34474.log.gz 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42890.log: 28.1% -- replaced with /var/log/ceph/ceph-client.admin.42890.log.gz 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35251.log 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31290.log 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43453.log.gz 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35251.log.gz 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41609.log 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41310.log 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31290.log.gz 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43894.log 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41609.log.gz 2024-09-14T08:44:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41310.log.gz 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40274.log 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47925.log 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43894.log.gz 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44299.log 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40274.log.gz 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47925.log.gz 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42036.log 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.31483.log 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44299.log.gz 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36596.log 0.0% 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42036.log.gz 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/objectstore_tool.31483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38449.log 2024-09-14T08:44:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31385.log 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36596.log.gz 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39952.log 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38449.log.gz 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41505.log 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31385.log.gz 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr: 94.5% -- replaced with /var/log/ceph/objectstore_tool.31483.log.gz 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39982.log 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39952.log.gz 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35634.log 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41505.log.gz 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39982.log.gz 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40165.log 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34217.log 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35634.log.gz 2024-09-14T08:44:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40165.log.gz 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.32702.log 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.44634.log 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34217.log.gz 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/objectstore_tool.32702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33762.log 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/objectstore_tool.44634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30974.log 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40542.log 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33762.log.gz 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43765.log 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30974.log.gz 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40542.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35609.log 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40542.log.gz 2024-09-14T08:44:55.752 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43765.log: 94.8% -- replaced with /var/log/ceph/objectstore_tool.44634.log.gz 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47593.log 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43765.log.gz 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38496.log 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35609.log: 0.0%/var/log/ceph/ceph-client.admin.47593.log: -- replaced with /var/log/ceph/ceph-client.admin.35609.log.gz 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43830.log 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47593.log.gz 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42264.log 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38496.log.gz 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42613.log 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43830.log.gz 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31004.log 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42264.log.gz 2024-09-14T08:44:55.753 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33858.log 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42613.log.gz 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42773.log 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31004.log.gz 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33858.log.gz 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44058.log 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42773.log.gz 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37470.log 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr: 95.2% -- replaced with /var/log/ceph/objectstore_tool.32702.log.gz 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41761.log 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44058.log.gz 2024-09-14T08:44:55.754 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41410.log 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37470.log.gz 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41761.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41761.log.gz -5 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48089.log 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41105.log 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41410.log.gz 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48089.log.gz 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43560.log 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30346.log 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41105.log.gz 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43560.log.gz 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35123.log 2024-09-14T08:44:55.755 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30641.log 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30346.log.gz 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47827.log 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35123.log.gz 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35550.log 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30641.log.gz 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47827.log.gz 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47853.log 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37799.log 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35550.log.gz 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47853.log.gz 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47921.log 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44351.log 2024-09-14T08:44:55.756 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37799.log.gz 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47921.log.gz 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29608.log 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35814.log 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44351.log.gz 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29608.log.gz 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48503.log 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35814.log.gz 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.31704.log 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29603.log 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48503.log.gz 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/objectstore_tool.31704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31118.log 2024-09-14T08:44:55.757 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34416.log 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29603.log.gz 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31118.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31118.log.gz 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34721.log 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34416.log.gz 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr: 94.8% -- replaced with /var/log/ceph/objectstore_tool.31704.log.gz 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40055.log 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34559.log 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34721.log.gz 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40453.log 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40055.log.gz 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37702.log 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34559.log.gz 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34583.log 2024-09-14T08:44:55.758 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40453.log.gz 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29135.log 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37702.log.gz 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43706.log 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34583.log.gz 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33882.log 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29135.log.gz 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43706.log.gz 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35089.log 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33882.log.gz 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48917.log 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz 2024-09-14T08:44:55.759 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29407.log 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35089.log.gz 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43707.log 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48917.log.gz 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47917.log 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29407.log.gz 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37774.log 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43707.log.gz 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42086.log 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47917.log.gz 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41155.log 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37774.log.gz 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29551.log 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42086.log.gz 2024-09-14T08:44:55.760 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35158.log 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41155.log.gz 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30061.log 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29551.log.gz 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29213.log 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35158.log.gz 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38639.log 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30061.log.gz 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34156.log 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29213.log.gz 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42769.log 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38639.log.gz 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34927.log 2024-09-14T08:44:55.761 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34156.log.gz 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41762.log 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42769.log.gz 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34644.log 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34927.log.gz 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36182.log 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41762.log.gz 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37209.log 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34644.log.gz 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48633.log 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36182.log.gz 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38731.log 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37209.log.gz 2024-09-14T08:44:55.762 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39865.log 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48633.log.gz 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31923.log 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38731.log.gz 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41667.log 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39865.log.gz 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34294.log 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31923.log.gz 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41667.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41667.log.gz 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38584.log 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34294.log.gz 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.45715.log 2024-09-14T08:44:55.763 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33977.log 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38584.log.gz 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/objectstore_tool.45715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43503.log 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48711.log 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33977.log.gz 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43503.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31064.log 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48711.log.gz 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40320.log 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29707.log 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31064.log.gz 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40320.log.gz 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35465.log 2024-09-14T08:44:55.764 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47458.log 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29707.log: /var/log/ceph/ceph-client.admin.35465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47645.log 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29707.log.gz 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35465.log.gz 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47458.log.gz 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48044.log 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43804.log 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47645.log: /var/log/ceph/ceph-client.admin.48044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38585.log 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48044.log.gz 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47645.log.gz 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43804.log.gz 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34131.log 2024-09-14T08:44:55.765 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44262.log 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38585.log.gz 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31034.log 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34131.log.gz 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44111.log 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44262.log: 95.2% -- replaced with /var/log/ceph/objectstore_tool.45715.log.gz 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35775.log 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44262.log.gz 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31034.log.gz 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40633.log 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44111.log.gz 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41159.log 2024-09-14T08:44:55.766 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35775.log.gz 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48477.log 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40633.log.gz 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40357.log 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41159.log.gz 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36536.log 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48477.log.gz 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34764.log 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40357.log.gz 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31231.log 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36536.log.gz 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36000.log 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34764.log.gz 2024-09-14T08:44:55.767 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31231.log.gz 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44085.log 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36000.log.gz 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42413.log 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29785.log 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44085.log.gz 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48072.log 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42413.log.gz 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31145.log 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29785.log.gz 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29837.log 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48072.log.gz 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41930.log 2024-09-14T08:44:55.768 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31145.log.gz 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48607.log 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29837.log.gz 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41930.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41930.log.gz 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35722.log 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48607.log.gz 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45301.log 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35722.log.gz 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29258.log 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33908.log 2024-09-14T08:44:55.769 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45301.log.gz 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40943.log 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29258.log.gz 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48090.log 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33908.log: /var/log/ceph/ceph-client.admin.40943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41315.log 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr: 28.6% -- replaced with /var/log/ceph/ceph-client.admin.33908.log.gz 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40943.log.gz 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48090.log.gz 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44404.log 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38980.log 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41315.log.gz 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48555.log 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44404.log.gz 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30865.log 2024-09-14T08:44:55.770 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38980.log: /var/log/ceph/ceph-client.admin.48555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41232.log 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38980.log.gz 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48555.log.gz 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30865.log.gz 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48581.log 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33935.log 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41232.log: /var/log/ceph/ceph-client.admin.48581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40399.log 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41232.log.gz 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48581.log.gz 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33935.log.gz 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29187.log 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42316.log 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40399.log: /var/log/ceph/ceph-client.admin.29187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48763.log 2024-09-14T08:44:55.771 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40399.log.gz 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29187.log.gz 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42316.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36386.log 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42316.log.gz 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48763.log.gz 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40758.log 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37521.log 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36386.log: /var/log/ceph/ceph-client.admin.40758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36386.log.gz 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29065.log 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40758.log.gz 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37521.log.gz 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31335.log 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41435.log 2024-09-14T08:44:55.772 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29065.log.gz 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45719.log 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31335.log.gz 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30753.log 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41435.log.gz/var/log/ceph/ceph-client.admin.45719.log: 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.29090.log 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45719.log.gz 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30753.log.gz 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34952.log 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40497.log 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29090.log.gz 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34952.log.gz 2024-09-14T08:44:55.773 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35925.log 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29811.log 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40497.log.gz 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35925.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.35925.log.gz --verbose 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph.audit.log 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25243.log 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29811.log.gz 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47541.log 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.25243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40134.log 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25243.log.gz 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47541.log.gz 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34389.log 2024-09-14T08:44:55.774 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31480.log 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40134.log.gz 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34389.log.gz 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48399.log 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35012.log 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31480.log.gz 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48399.log.gz 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35288.log 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35012.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.44885.log 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35012.log.gz 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43979.log 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35288.log.gz 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/objectstore_tool.44885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43653.log 2024-09-14T08:44:55.775 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43860.log 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43979.log.gz 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42200.log 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43653.log: /var/log/ceph/ceph-client.admin.43860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43653.log.gz 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43860.log.gz 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35328.log 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48217.log 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42200.log.gz 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35328.log: 95.1% -- replaced with /var/log/ceph/objectstore_tool.44885.log.gz 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35328.log.gz 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30289.log 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47801.log 2024-09-14T08:44:55.776 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48217.log.gz 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35852.log 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30289.log.gz 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34051.log 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35852.log: /var/log/ceph/ceph-client.admin.47801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35852.log.gz 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37834.log 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47801.log.gz 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29555.log 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34051.log.gz 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42589.log 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37834.log.gz 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47910.log 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29555.log: /var/log/ceph/ceph-client.admin.42589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34816.log 2024-09-14T08:44:55.777 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42589.log.gz 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29555.log.gz 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47910.log.gz 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29733.log 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37623.log 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34816.log: /var/log/ceph/ceph-client.admin.29733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29932.log 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34816.log.gz 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29733.log.gz 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29937.log 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37623.log.gz 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41284.log 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29932.log: /var/log/ceph/ceph-client.admin.29937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46592.log 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29932.log.gz 2024-09-14T08:44:55.778 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29937.log.gz 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41284.log.gz 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48893.log 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42702.log 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46592.log: /var/log/ceph/ceph-client.admin.48893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48841.log 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46592.log.gz 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48893.log.gz 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33568.log 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42702.log.gz 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40894.log 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48841.log: /var/log/ceph/ceph-client.admin.33568.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.44433.log 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48841.log.gz 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33568.log.gz 2024-09-14T08:44:55.779 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40894.log.gz 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29259.log 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38106.log 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/objectstore_tool.44433.log: /var/log/ceph/ceph-client.admin.29259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42857.log 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29259.log.gz 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38106.log.gz 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr: 94.8% -- replaced with /var/log/ceph/objectstore_tool.44433.log.gz 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42943.log 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42857.log: /var/log/ceph/ceph-client.admin.43926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48789.log 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42857.log.gz 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2024-09-14T08:44:55.780 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42943.log.gz 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41820.log 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31422.log 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48789.log: /var/log/ceph/ceph-client.admin.41820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47567.log 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48789.log.gz 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41820.log.gz 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31422.log.gz 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40673.log 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48297.log 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47567.log: /var/log/ceph/ceph-client.admin.40673.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43042.log 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47567.log.gz 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40673.log.gz 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48297.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40394.log 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48297.log.gz 2024-09-14T08:44:55.781 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43042.log.gz 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39822.log 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38029.log 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40394.log: /var/log/ceph/ceph-client.admin.39822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29008.log 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40394.log.gz 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39822.log.gz 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38029.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.38029.log.gz /var/log/ceph/ceph-client.admin.36254.log 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37526.log 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29008.log: /var/log/ceph/ceph-client.admin.36254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29315.log 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gz 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36254.log.gz 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37955.log 2024-09-14T08:44:55.782 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37526.log.gz 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33517.log 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29315.log: /var/log/ceph/ceph-client.admin.37955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31203.log 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29315.log.gz 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37955.log.gz 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33517.log.gz 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42355.log 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47510.log 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31203.log: /var/log/ceph/ceph-client.admin.42355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48529.log 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31203.log.gz 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42355.log.gz 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47510.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.47510.log.gz --verbose 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-client.admin.33738.log 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29254.log 2024-09-14T08:44:55.783 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48529.log: /var/log/ceph/ceph-client.admin.33738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44893.log 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48529.log.gz 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33738.log.gz 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29254.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.29254.log.gz --verbose 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-client.admin.38832.log 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30480.log 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44893.log: /var/log/ceph/ceph-client.admin.38832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33601.log 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38832.log.gz 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44893.log.gz 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30480.log.gz 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48425.log 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30563.log 2024-09-14T08:44:55.784 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33601.log: /var/log/ceph/ceph-client.admin.48425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41965.log 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48425.log.gz 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33601.log.gz 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30563.log.gz 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34500.log 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29250.log 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41965.log: /var/log/ceph/ceph-client.admin.34500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47619.log 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34500.log.gz 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41965.log.gz 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29250.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33679.log 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29250.log.gz 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42144.log 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47619.log: /var/log/ceph/ceph-client.admin.33679.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41546.log 2024-09-14T08:44:55.785 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33679.log.gz 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47619.log.gz 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42144.log.gz 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43158.log 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40570.log 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41546.log: /var/log/ceph/ceph-client.admin.43158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41258.log 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43158.log.gz 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41546.log.gz 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40570.log.gz 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47671.log 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41258.log: /var/log/ceph/ceph-client.admin.47671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41258.log.gz 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41205.log 2024-09-14T08:44:55.786 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47671.log.gz 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41885.log 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34854.log 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41205.log: /var/log/ceph/ceph-client.admin.41885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29579.log 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41885.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41205.log.gz 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34854.log.gz 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25320.log 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35392.log 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29579.log: /var/log/ceph/ceph-client.admin.25320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43366.log 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29579.log.gz 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25320.log.gz 2024-09-14T08:44:55.787 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35392.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.35392.log.gz 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.30442.log 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29417.log 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43366.log: /var/log/ceph/ceph-client.admin.30442.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.38206.log 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43366.log.gz 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30442.log.gz 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29417.log.gz 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48063.log 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43231.log 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/objectstore_tool.38206.log: /var/log/ceph/ceph-client.admin.48063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34849.log 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48063.log.gz 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43231.log.gz 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr: 94.8% -- replaced with /var/log/ceph/objectstore_tool.38206.log.gz 2024-09-14T08:44:55.788 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47749.log 2024-09-14T08:44:55.789 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34849.log.gz 2024-09-14T08:44:55.789 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47749.log.gz 2024-09-14T08:44:55.789 INFO:teuthology.orchestra.run.smithi112.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T08:44:55.897 INFO:teuthology.orchestra.run.smithi089.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T08:44:56.039 INFO:teuthology.orchestra.run.smithi089.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T08:44:57.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-14T08:45:00.159 INFO:teuthology.orchestra.run.smithi112.stderr: 96.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T08:45:00.189 INFO:teuthology.orchestra.run.smithi089.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T08:45:02.265 INFO:teuthology.orchestra.run.smithi112.stderr: 96.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T08:45:08.760 INFO:teuthology.orchestra.run.smithi112.stderr: 96.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T08:45:08.762 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-14T08:45:08.762 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m13.216s 2024-09-14T08:45:08.762 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m23.827s 2024-09-14T08:45:08.762 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m0.948s 2024-09-14T08:45:09.723 INFO:teuthology.orchestra.run.smithi089.stderr: 96.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T08:45:11.700 INFO:teuthology.orchestra.run.smithi089.stderr: 96.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T08:45:11.708 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-14T08:45:11.708 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m16.193s 2024-09-14T08:45:11.708 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m34.606s 2024-09-14T08:45:11.708 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m1.450s 2024-09-14T08:45:11.708 INFO:tasks.ceph:Archiving logs... 2024-09-14T08:45:11.709 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/remote/smithi089/log 2024-09-14T08:45:11.710 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T08:45:15.363 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/remote/smithi112/log 2024-09-14T08:45:15.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T08:45:17.907 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/remote/smithi188/log 2024-09-14T08:45:17.908 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T08:45:18.032 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T08:45:18.049 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T08:45:18.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T08:45:18.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T08:45:18.055 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T08:45:18.142 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T08:45:18.155 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T08:45:18.155 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T08:45:18.158 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T08:45:18.160 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T08:45:18.169 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T08:45:18.170 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2024-09-14T08:45:18.170 INFO:teuthology.orchestra.run.smithi089.stdout:*hv01.front.sepi 67.205.162.81 3 u 14 64 377 0.097 -2.457 3.499 2024-09-14T08:45:18.170 INFO:teuthology.orchestra.run.smithi089.stdout:+hv02.front.sepi 63.231.80.2 3 u 9 64 377 0.075 -2.072 3.112 2024-09-14T08:45:18.170 INFO:teuthology.orchestra.run.smithi089.stdout:+hv03.front.sepi 74.6.168.72 3 u 7 64 377 0.068 -2.426 4.939 2024-09-14T08:45:18.170 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:45:18.171 INFO:teuthology.orchestra.run.smithi188.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T08:45:18.171 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================== 2024-09-14T08:45:18.171 INFO:teuthology.orchestra.run.smithi188.stdout:*hv01.front.sepi 67.205.162.81 3 u 10 64 377 0.092 -3.527 1.607 2024-09-14T08:45:18.171 INFO:teuthology.orchestra.run.smithi188.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.097 -3.213 1.566 2024-09-14T08:45:18.171 INFO:teuthology.orchestra.run.smithi188.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 64 377 0.091 +1.402 1.698 2024-09-14T08:45:18.171 INFO:teuthology.orchestra.run.smithi188.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:45:18.172 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T08:45:18.173 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-14T08:45:18.173 INFO:teuthology.orchestra.run.smithi112.stdout:+hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.079 -8.285 3.490 2024-09-14T08:45:18.173 INFO:teuthology.orchestra.run.smithi112.stdout:+hv02.front.sepi 63.231.80.2 3 u 9 64 377 0.072 -3.798 2.517 2024-09-14T08:45:18.173 INFO:teuthology.orchestra.run.smithi112.stdout:*hv03.front.sepi 74.6.168.72 3 u 17 64 377 0.076 +3.068 3.819 2024-09-14T08:45:18.173 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T08:45:18.174 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T08:45:18.182 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T08:45:18.183 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T08:45:18.211 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T08:45:18.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T08:45:18.309 INFO:teuthology.task.internal:Duration was 998.560747 seconds 2024-09-14T08:45:18.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T08:45:18.321 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T08:45:18.322 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T08:45:18.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T08:45:18.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T08:45:18.367 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T08:45:18.367 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-09-14T08:45:18.367 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T08:45:18.413 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-14T08:45:18.413 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T08:45:18.423 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2024-09-14T08:45:18.423 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T08:45:18.433 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T08:45:18.434 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T08:45:18.460 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T08:45:18.467 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T08:45:18.509 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T08:45:18.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T08:45:18.534 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T08:45:18.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T08:45:18.618 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T08:45:18.628 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T08:45:18.628 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T08:45:18.640 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T08:45:18.651 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T08:45:18.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T08:45:18.671 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T08:45:18.685 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T08:45:18.692 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-09-14T08:45:18.695 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T08:45:18.704 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-14T08:45:18.712 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2024-09-14T08:45:18.831 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T08:45:18.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:45:18.837 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T08:45:18.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:45:18.879 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T08:45:18.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:45:18.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T08:45:18.893 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T08:45:18.894 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/remote/smithi089 2024-09-14T08:45:18.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T08:45:18.917 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/remote/smithi112 2024-09-14T08:45:18.917 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T08:45:18.946 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900500/remote/smithi188 2024-09-14T08:45:18.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T08:45:18.972 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T08:45:18.972 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T08:45:18.974 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T08:45:18.988 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T08:45:19.017 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T08:45:19.028 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T08:45:19.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T08:45:19.124 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T08:45:19.125 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T08:45:19.128 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T08:45:19.131 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T08:45:19.134 INFO:teuthology.orchestra.run.smithi089.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 08:45 /home/ubuntu/cephtest 2024-09-14T08:45:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 08:45 /home/ubuntu/cephtest 2024-09-14T08:45:19.138 INFO:teuthology.orchestra.run.smithi188.stdout: 658653 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 08:45 /home/ubuntu/cephtest 2024-09-14T08:45:19.140 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T08:45:19.215 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T08:45:19.338 INFO:teuthology.run:Summary data: description: rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} duration: 998.5607469081879 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T08:45:19.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T08:45:19.441 INFO:teuthology.run:pass